SlideShare a Scribd company logo
Learning with me mate
Analytics of social networks in higher education
Dragan Gasevic
@dgasevic
March 16, 2016
MCSHE, University of Melbourne
Joint work with Srecko Joksimovic, Vitomir Kovanovic, and many great collaborators
as cited in the presentation
Benefits of social learning
Social networks
Ties as channels for
flow of resources
The Strength of Weak Ties
Connections through
strong ties
Connections through
weak ties
Granovetter, M. S. (1973). The strength of weak ties. American journal of sociology, 1360-1380.
A common assumption
Higher social network centrality
leads to higher achievement
Burt, R. S. (2000). The network structure of social capital. Research in organizational behavior, 22, 345-423.
Network
Mike
Jill
Emma
Liz
Bob
Leah
ShaneJohn
Allen Lisa
Degree Centrality
Mike
Jill
Emma
Liz
Bob
Leah
ShaneJohn
Allen Lisa
Betweenness centrality
Mike
Jill
Emma
Liz
Bob
Leah
ShaneJohn
Allen Lisa
a.k.a. network broker
Results in reality are
inconsistent and contradictory
Network centrality and performance
What is the source of this
inconsistency?
THEORY IN NETWORK ANALYSIS
Learning with me Mate: Analytics of Social Networks in Higher Education
Theory-informed learning analytics
Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The
effects of instructional conditions in predicting academic success. The Internet and Higher Education, 28, 68-84.
Simmel’s theory of social interactions
 Networks based on super strong ties
 Triads as the unit of analysis
Study objective
Network
structural
properties
Learning
outcome
Social
dynamic
processes?
Tie dynamics:
• Homophily/
heterophily
• Reciprocity
• Triadic closure
Joksimović, S., Manataki, A., Gašević, D., Dawson, S., Kovanović, K., de Kereki, I. F. (2016). Translating network position
into performance: Importance of Centrality in Different Network Configurations. In Proceedings of the 6th International
Conference on Learning Analytics & Knowledge (LAK 2016), Edinburgh, Scotland, UK (in press).
Method (Data)
Code Yourself! (English), ¡A Programar! (Spanish)
Certificate: 50% for the coursework;
75% - distinction
0
10000
20000
30000
40000
50000
60000
70000
Enrolled Engaged Engaged with
forum
Course participants
Codeyourself Aprogramar
0
200
400
600
800
1000
1200
1400
1600
1800
Codeyourself Aprogramar
Obtained certificate
Normal Disctinction
Method (Analysis)
Results - network characteristics
-8 -6 -4 -2 0 2 4 6
Expansiveness
Popularity
Simmelian
Reciprocity
Gender
Domestic
Achievement (Normal)
Achievement (None)
Achievement (Distinct)
Edges
Aprogramar Codeyourself
***
***
***
***
***
**
***
**
***
***
***
***
***
***
Note: * p<.05; ** p<.01; *** p<.001,
Analysis of the estimates for the two ERG models
Results of the multinomial regression analysis, * p<.05; ** p<.01; *** p<.001
In order to provide meaningful visualizations, estimates for betweenness centrality were
multiplied by 100 (only for the presentation purposes)
-0.15 -0.1 -0.05 0 0.05 0.1
Betweenness (normal)
Betweenness (distinct)
Closeness (normal)
Closeness (distinct)
W. Degree (normal)
W. Degree (distinct)
Aprgoramar Codeyourself
***
**
***
*
**
***
***
Results – centrality vs. performance
“Super-strong” ties
Social centrality does not
necessarily imply benefits
Methodological implications
Traditional (descriptive) + statistical
network analysis
When and how are networks with
super-strong ties formed?
DISCOURSE IN
NETWORK FORMATION
Learning and discourse
Graesser, A., Mcnamara, D., & Kulikowich, J. (2011). Coh-Metrix: Providing Multilevel Analyses of Text Characteristics.
Educational Researcher, 40(5), 223–234. http://doi.org/10.3102/0013189X11413260
Language and social ties
Granovetter, M. S. (1973). The strength of weak ties. American journal of sociology, 1360-1380.
Interaction strategy,
social networks, and performance
Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., & Adesope, O. (2015). Analytics of communities of inquiry: Effects
of learning technology use on cognitive presence in asynchronous online discussions. The Internet and Higher
Education, 27, 74-89.
Method (data)
Courses: Delft Design Approach (DDA), Introduction to
Drinking Water (CTB), Functional Programming (FP)
Certificate: 60% for the coursework
730
135
645
281
1064
1962
0
500
1000
1500
2000
2500
Engaged with forum Obtained certificate
Forum participation & obtained
certificates
DDA CTB FP
11336 8484
316711397
1128
6560
0
10000
20000
30000
40000
50000
DDA CTB FP
Students overview
Enrolled Submitted
Joksimović, S., Kovanović, V., Milikić, N., Jovanović, J., Gasević, D., Zouaq, A., Dawson, S. (2016). Effects of discourse on
network formation and achievement in massive open online courses. Computers & Education (in preparation).
Discussion forum
extract
Weighted,
directed graph
Statistical
network analysis
 Exponential random graph models
 Homophily
 Achievement
 Transition count
 Post count
 Reciprocity
 Popularity
 Expansiveness
 Simmelian ties
Discussion forum
extract
Weighted,
directed graph
Statistical
network analysis
 Exponential random graph models
 Homophily
 Achievement
 Transition count
 Post count
 Reciprocity
 Popularity
 Expansiveness
 Simmelian ties
student, post, timestamp
post => keywords Alchemy API
post_id, parent_post_id, student_id, keywords
Block HMM
Dominant topics Topic coherence
Interpretation
Paul, M. J. (2012). Mixed membership Markov models for unsupervised conversation modeling. In Proc. 2012 Joint Conf.
on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (pp. 94-104).
Discussion forum
extract
Weighted,
directed graph
Statistical
network analysis
 Exponential random graph models
 Homophily
 Achievement
 Transition count
 Post count
 Reciprocity
 Popularity
 Expansiveness
 Simmelian ties
student, post, timestamp
post => keywords Alchemy API
post_id, parent_post_id, student_id, keywords
Block HMM
Dominant topics Topic coherence
Association?
Interpretation
Regression analysis
Interpretation
 Transition count
 Post count
 Replies count
 Betweenness centrality
 Closeness centrality
 Degree centrality
CTB DDA FP
Results (topic transition)
Common ground as a key factor in
shaping network structures
Clark, H., & Brennan, S. E. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.),
Perspectives on socially shared cognition (pp. 127–149). Washington, DC, US: American Psychological Association.
The principle of least effort in
communication
Clark, H., & Krych, M. A. (2004). Speaking while Monitoring Addressees for Understanding. Journal of Memory and
Language, 50(1), 62–81.
DDA topics
Topic 11: Video concept
- video making,
- upload
- particular assignment that included
video making
Topic 5: Course information
- resources,
- readings,
- discussions
Topic 7: Design thinking
- thinking about design process,
- different approaches to design
-8 -6 -4 -2 0 2 4 6
Expansiveness
Popularity
Assortative mixing
Simmelian ties
Simmelian cliques
Reciprocity
Post count
Transition count
Achievement
Edges
CTB DDA FP
***
***
***
***
***
*
***
Analysis of the estimates for the three ERG models
Note: * p<.05; ** p<.01; *** p<.001
***
***
***
***
***
***
**
***
***
***
***
***
***
***
Results - network characteristics
Results
(centrality vs. performance)
-0.04 -0.02 0 0.02 0.04 0.06 0.08 0.1 0.12
Betweenness
Closeness
W. Degree
Post count
Replies count
Transition count
CTB DDA FP
R2
CTB = .17
R2
DDA = .21
R2
FP = .08
Results of the three regression analysis
Note: * p<.05; ** p<.01; *** p<.001
***
***
*
***
***
***
***
***
FINAL REMARKS
One size fits all does not work in
learning analytics
Gašević, D., Dawson, S., Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1),
64-71.
Theory as a driver of the study of
networked learning
Interplay of language, network
structure, and network dynamics
How to inform teaching practice?
Teaching to recognize structural
wholes in networks
Burt, R. S., & Ronchi, D. (2007). Teaching executives to see social capital: Results from a field experiment. Social
Science Research, 36(3), 1156-1183.
Social presence in
network formation
Kovanovic, V., Joksimovic, S., Gasevic, D., & Hatala, M. (2014). What is the source of social capital? The association
between social network position and social presence in communities of inquiry. Proceedings of 7th International
Conference on Educational Data Mining – Workshops, London, UK, 2014
Scaling up qualitative
research methods
Kovanović, V., Joksimović, S., Waters, Z., Gašević, D., Kitto, K., Hatala, M., Siemens, G. (2016). Towards Automated
Content Analysis of Discussion Transcripts: A Cognitive Presence Case In Proceedings of the 6th International Conference
on Learning Analytics & Knowledge (LAK 2016), Edinburgh, Scotland, UK (in press).
To what extent instructional design
can affect network structures?
Class size as an important factor
Skrypnyk, O., Joksimović, S., Kovanović, V., Gašević, D., & Dawson, S. (2015). Roles of course facilitators, learners, and
technology in the flow of information of a cMOOC. The International Review of Research in Open and Distributed
Learning, 16(3).
Media, networks, and language
Personal agency and
network structures
Adapting language to
different situations
Tie building approach less important
than experience in networks
Burt, R. S., & Ronchi, D. (2007). Teaching executives to see social capital: Results from a field experiment. Social
Science Research, 36(3), 1156-1183.
Ideally suited
method
Not ideally suited
method
Ideally suited method,
but context dependent
Azevedo, R. (2015). Defining and measuring engagement and learning in science: Conceptual, theoretical,
methodological, and analytical issues. Educational Psychologist, 50(1), 84-94.
Capturing and
measurement of
engagement-
related processes
Analytics-based feedback for
networked learning
Thanks you!

More Related Content

PPTX
Learning analytics are more than measurement
PPTX
Learning analytics are more than a technology
PPTX
Technologies to support self-directed learning through social interaction
PPTX
Learning analytics and MOOCs: What have we learned so far and where to go?
PPTX
Wearable technologies should promote adaptive learners
PPTX
Learning analytics are about learning
PDF
Towards Strengthening Links between Learning Analytics and Assessment
PPTX
Social network analysis and learning design
Learning analytics are more than measurement
Learning analytics are more than a technology
Technologies to support self-directed learning through social interaction
Learning analytics and MOOCs: What have we learned so far and where to go?
Wearable technologies should promote adaptive learners
Learning analytics are about learning
Towards Strengthening Links between Learning Analytics and Assessment
Social network analysis and learning design

What's hot (20)

PDF
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
PDF
Can learning analytics offer meaningful assessment?
PPTX
Learning analytics: An opportunity for higher education?
PPTX
LACE Spring Briefing - Learning analytics are more than measurement
PPTX
State and Directions of Learning Analytics Adoption (Second edition)
PDF
Learning Analytics in Medical Education
PPTX
Social network analysis and understanding of massive open online courses
PDF
Let’s get there! Towards policy for adoption of learning analytics
PDF
What Should I Do Next? Adaptive Sequencing in the Context of Open Social Stu...
PDF
edmedia2014-learning-analytics-keynote
PDF
Data-Driven Education 2020: Using Big Educational Data to Improve Teaching an...
PPT
Unisa2019 keynote2
PPTX
Using Mentimeter to gauge and engage science students in information skills -...
PPTX
Learning Analytics & the Changing Landscape of Higher Education
PDF
Log Vis All 0729
PPTX
Using Learning analytics to support learners and teachers at the Open University
PPTX
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
PDF
Learning analytics in higher education: Promising practices and lessons learned
PPTX
E-Research Open Learning Conference Unisa 2018
PDF
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Can learning analytics offer meaningful assessment?
Learning analytics: An opportunity for higher education?
LACE Spring Briefing - Learning analytics are more than measurement
State and Directions of Learning Analytics Adoption (Second edition)
Learning Analytics in Medical Education
Social network analysis and understanding of massive open online courses
Let’s get there! Towards policy for adoption of learning analytics
What Should I Do Next? Adaptive Sequencing in the Context of Open Social Stu...
edmedia2014-learning-analytics-keynote
Data-Driven Education 2020: Using Big Educational Data to Improve Teaching an...
Unisa2019 keynote2
Using Mentimeter to gauge and engage science students in information skills -...
Learning Analytics & the Changing Landscape of Higher Education
Log Vis All 0729
Using Learning analytics to support learners and teachers at the Open University
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
Learning analytics in higher education: Promising practices and lessons learned
E-Research Open Learning Conference Unisa 2018
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...
Ad

Viewers also liked (12)

PPTX
Bringing Your Textbook to Life: 15+ Tips & Resources
PPTX
Social network analysis and social presence
PDF
15 Teaching Ideas for 2017
PDF
SHEILA Project - Workshop Slides Online Educa Berlin 2016
PDF
50 Most Social CIOs in Higher Education
PDF
Will Learning Analytics Transform Higher Education?
PPTX
I see i think- i wonder
PDF
Frightful Learning! Zombies, Monsters, Oh My!
PDF
100 Business Insights from Fortune 500, Startup CEOs, Venture Capitalists, an...
PDF
100 Most Social CIOs on Twitter 2015
PDF
Top 100 CIOs to Follow on Twitter
PPT
Social Network Analysis
Bringing Your Textbook to Life: 15+ Tips & Resources
Social network analysis and social presence
15 Teaching Ideas for 2017
SHEILA Project - Workshop Slides Online Educa Berlin 2016
50 Most Social CIOs in Higher Education
Will Learning Analytics Transform Higher Education?
I see i think- i wonder
Frightful Learning! Zombies, Monsters, Oh My!
100 Business Insights from Fortune 500, Startup CEOs, Venture Capitalists, an...
100 Most Social CIOs on Twitter 2015
Top 100 CIOs to Follow on Twitter
Social Network Analysis
Ad

Similar to Learning with me Mate: Analytics of Social Networks in Higher Education (20)

PPTX
Social network analysis and creative potential
PDF
Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
PDF
Dissertation Social Network Sites
PDF
Co-located Collaboration Analytics
PPT
Assessing new media literacies in social work education.
PPT
Design based for lisbon 2011
PPTX
Scholarship in the Digital Age
PPT
Tcetc2010
ODP
Tcetc2010
PPTX
Introduction into Social Network Analysis
DOC
Did we become a community - A Literature Review
PPTX
Analysing social presence in online discussions through network and text anal...
PDF
Ties that matter: Effects of the network context on the association between s...
PPTX
EDEN seminar introduction to Community of Inquiry Model
PPTX
Learning Relations from Social Tagging Data
PPTX
6610module3mbracea
PPTX
6610module3mbracea
PPTX
Lake Como 2021
PDF
Simple Program for Enhancing Quality in Discussion Boards
PPT
Authentic CMCL
Social network analysis and creative potential
Multimodal Learning Analytics for Collaborative Learning Understanding and Su...
Dissertation Social Network Sites
Co-located Collaboration Analytics
Assessing new media literacies in social work education.
Design based for lisbon 2011
Scholarship in the Digital Age
Tcetc2010
Tcetc2010
Introduction into Social Network Analysis
Did we become a community - A Literature Review
Analysing social presence in online discussions through network and text anal...
Ties that matter: Effects of the network context on the association between s...
EDEN seminar introduction to Community of Inquiry Model
Learning Relations from Social Tagging Data
6610module3mbracea
6610module3mbracea
Lake Como 2021
Simple Program for Enhancing Quality in Discussion Boards
Authentic CMCL

More from Dragan Gasevic (13)

PPTX
Personal Learning Graph (PLeG)
PPTX
Social network analysis and academic performance
PPTX
Sensemaking of social network analysis for the study of learning
PPTX
Network modularity and community identification
PPTX
Network measures used in social network analysis
PPTX
Network structure and data sources
PPTX
Tools and Methods to Enhance Information Seeking, Sensemaking and Learning
PPTX
SoLAR Activities
PDF
Learning Analytics - A New Discipline and Linked Data
PPT
Learning Analytics - A New Discipline and Bits of Semantics
PPT
Learning Analytics -Towards a New Discipline-
PPT
Modeling Flexible Business Processes with Business Rule Patterns
PPTX
Evidence-based Semantic Web Just a Dream or the Way to Go?
Personal Learning Graph (PLeG)
Social network analysis and academic performance
Sensemaking of social network analysis for the study of learning
Network modularity and community identification
Network measures used in social network analysis
Network structure and data sources
Tools and Methods to Enhance Information Seeking, Sensemaking and Learning
SoLAR Activities
Learning Analytics - A New Discipline and Linked Data
Learning Analytics - A New Discipline and Bits of Semantics
Learning Analytics -Towards a New Discipline-
Modeling Flexible Business Processes with Business Rule Patterns
Evidence-based Semantic Web Just a Dream or the Way to Go?

Recently uploaded (20)

PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
Updated Idioms and Phrasal Verbs in English subject
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
Orientation - ARALprogram of Deped to the Parents.pptx
PPTX
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PPTX
master seminar digital applications in india
PDF
Complications of Minimal Access Surgery at WLH
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
2.FourierTransform-ShortQuestionswithAnswers.pdf
Weekly quiz Compilation Jan -July 25.pdf
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
Updated Idioms and Phrasal Verbs in English subject
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Orientation - ARALprogram of Deped to the Parents.pptx
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
Final Presentation General Medicine 03-08-2024.pptx
Supply Chain Operations Speaking Notes -ICLT Program
History, Philosophy and sociology of education (1).pptx
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
Module 4: Burden of Disease Tutorial Slides S2 2025
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
master seminar digital applications in india
Complications of Minimal Access Surgery at WLH
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf

Learning with me Mate: Analytics of Social Networks in Higher Education

  • 1. Learning with me mate Analytics of social networks in higher education Dragan Gasevic @dgasevic March 16, 2016 MCSHE, University of Melbourne Joint work with Srecko Joksimovic, Vitomir Kovanovic, and many great collaborators as cited in the presentation
  • 3. Social networks Ties as channels for flow of resources
  • 4. The Strength of Weak Ties Connections through strong ties Connections through weak ties Granovetter, M. S. (1973). The strength of weak ties. American journal of sociology, 1360-1380.
  • 5. A common assumption Higher social network centrality leads to higher achievement Burt, R. S. (2000). The network structure of social capital. Research in organizational behavior, 22, 345-423.
  • 9. Results in reality are inconsistent and contradictory
  • 10. Network centrality and performance
  • 11. What is the source of this inconsistency?
  • 12. THEORY IN NETWORK ANALYSIS
  • 14. Theory-informed learning analytics Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education, 28, 68-84.
  • 15. Simmel’s theory of social interactions  Networks based on super strong ties  Triads as the unit of analysis
  • 16. Study objective Network structural properties Learning outcome Social dynamic processes? Tie dynamics: • Homophily/ heterophily • Reciprocity • Triadic closure Joksimović, S., Manataki, A., Gašević, D., Dawson, S., Kovanović, K., de Kereki, I. F. (2016). Translating network position into performance: Importance of Centrality in Different Network Configurations. In Proceedings of the 6th International Conference on Learning Analytics & Knowledge (LAK 2016), Edinburgh, Scotland, UK (in press).
  • 17. Method (Data) Code Yourself! (English), ¡A Programar! (Spanish) Certificate: 50% for the coursework; 75% - distinction 0 10000 20000 30000 40000 50000 60000 70000 Enrolled Engaged Engaged with forum Course participants Codeyourself Aprogramar 0 200 400 600 800 1000 1200 1400 1600 1800 Codeyourself Aprogramar Obtained certificate Normal Disctinction
  • 19. Results - network characteristics -8 -6 -4 -2 0 2 4 6 Expansiveness Popularity Simmelian Reciprocity Gender Domestic Achievement (Normal) Achievement (None) Achievement (Distinct) Edges Aprogramar Codeyourself *** *** *** *** *** ** *** ** *** *** *** *** *** *** Note: * p<.05; ** p<.01; *** p<.001, Analysis of the estimates for the two ERG models
  • 20. Results of the multinomial regression analysis, * p<.05; ** p<.01; *** p<.001 In order to provide meaningful visualizations, estimates for betweenness centrality were multiplied by 100 (only for the presentation purposes) -0.15 -0.1 -0.05 0 0.05 0.1 Betweenness (normal) Betweenness (distinct) Closeness (normal) Closeness (distinct) W. Degree (normal) W. Degree (distinct) Aprgoramar Codeyourself *** ** *** * ** *** *** Results – centrality vs. performance
  • 21. “Super-strong” ties Social centrality does not necessarily imply benefits
  • 23. When and how are networks with super-strong ties formed?
  • 25. Learning and discourse Graesser, A., Mcnamara, D., & Kulikowich, J. (2011). Coh-Metrix: Providing Multilevel Analyses of Text Characteristics. Educational Researcher, 40(5), 223–234. http://doi.org/10.3102/0013189X11413260
  • 26. Language and social ties Granovetter, M. S. (1973). The strength of weak ties. American journal of sociology, 1360-1380.
  • 27. Interaction strategy, social networks, and performance Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., & Adesope, O. (2015). Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions. The Internet and Higher Education, 27, 74-89.
  • 28. Method (data) Courses: Delft Design Approach (DDA), Introduction to Drinking Water (CTB), Functional Programming (FP) Certificate: 60% for the coursework 730 135 645 281 1064 1962 0 500 1000 1500 2000 2500 Engaged with forum Obtained certificate Forum participation & obtained certificates DDA CTB FP 11336 8484 316711397 1128 6560 0 10000 20000 30000 40000 50000 DDA CTB FP Students overview Enrolled Submitted Joksimović, S., Kovanović, V., Milikić, N., Jovanović, J., Gasević, D., Zouaq, A., Dawson, S. (2016). Effects of discourse on network formation and achievement in massive open online courses. Computers & Education (in preparation).
  • 29. Discussion forum extract Weighted, directed graph Statistical network analysis  Exponential random graph models  Homophily  Achievement  Transition count  Post count  Reciprocity  Popularity  Expansiveness  Simmelian ties
  • 30. Discussion forum extract Weighted, directed graph Statistical network analysis  Exponential random graph models  Homophily  Achievement  Transition count  Post count  Reciprocity  Popularity  Expansiveness  Simmelian ties student, post, timestamp post => keywords Alchemy API post_id, parent_post_id, student_id, keywords Block HMM Dominant topics Topic coherence Interpretation Paul, M. J. (2012). Mixed membership Markov models for unsupervised conversation modeling. In Proc. 2012 Joint Conf. on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (pp. 94-104).
  • 31. Discussion forum extract Weighted, directed graph Statistical network analysis  Exponential random graph models  Homophily  Achievement  Transition count  Post count  Reciprocity  Popularity  Expansiveness  Simmelian ties student, post, timestamp post => keywords Alchemy API post_id, parent_post_id, student_id, keywords Block HMM Dominant topics Topic coherence Association? Interpretation Regression analysis Interpretation  Transition count  Post count  Replies count  Betweenness centrality  Closeness centrality  Degree centrality
  • 32. CTB DDA FP Results (topic transition)
  • 33. Common ground as a key factor in shaping network structures Clark, H., & Brennan, S. E. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 127–149). Washington, DC, US: American Psychological Association.
  • 34. The principle of least effort in communication Clark, H., & Krych, M. A. (2004). Speaking while Monitoring Addressees for Understanding. Journal of Memory and Language, 50(1), 62–81.
  • 35. DDA topics Topic 11: Video concept - video making, - upload - particular assignment that included video making Topic 5: Course information - resources, - readings, - discussions Topic 7: Design thinking - thinking about design process, - different approaches to design
  • 36. -8 -6 -4 -2 0 2 4 6 Expansiveness Popularity Assortative mixing Simmelian ties Simmelian cliques Reciprocity Post count Transition count Achievement Edges CTB DDA FP *** *** *** *** *** * *** Analysis of the estimates for the three ERG models Note: * p<.05; ** p<.01; *** p<.001 *** *** *** *** *** *** ** *** *** *** *** *** *** *** Results - network characteristics
  • 37. Results (centrality vs. performance) -0.04 -0.02 0 0.02 0.04 0.06 0.08 0.1 0.12 Betweenness Closeness W. Degree Post count Replies count Transition count CTB DDA FP R2 CTB = .17 R2 DDA = .21 R2 FP = .08 Results of the three regression analysis Note: * p<.05; ** p<.01; *** p<.001 *** *** * *** *** *** *** ***
  • 39. One size fits all does not work in learning analytics Gašević, D., Dawson, S., Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64-71.
  • 40. Theory as a driver of the study of networked learning
  • 41. Interplay of language, network structure, and network dynamics
  • 42. How to inform teaching practice?
  • 43. Teaching to recognize structural wholes in networks Burt, R. S., & Ronchi, D. (2007). Teaching executives to see social capital: Results from a field experiment. Social Science Research, 36(3), 1156-1183.
  • 44. Social presence in network formation Kovanovic, V., Joksimovic, S., Gasevic, D., & Hatala, M. (2014). What is the source of social capital? The association between social network position and social presence in communities of inquiry. Proceedings of 7th International Conference on Educational Data Mining – Workshops, London, UK, 2014
  • 45. Scaling up qualitative research methods Kovanović, V., Joksimović, S., Waters, Z., Gašević, D., Kitto, K., Hatala, M., Siemens, G. (2016). Towards Automated Content Analysis of Discussion Transcripts: A Cognitive Presence Case In Proceedings of the 6th International Conference on Learning Analytics & Knowledge (LAK 2016), Edinburgh, Scotland, UK (in press).
  • 46. To what extent instructional design can affect network structures? Class size as an important factor Skrypnyk, O., Joksimović, S., Kovanović, V., Gašević, D., & Dawson, S. (2015). Roles of course facilitators, learners, and technology in the flow of information of a cMOOC. The International Review of Research in Open and Distributed Learning, 16(3).
  • 50. Tie building approach less important than experience in networks Burt, R. S., & Ronchi, D. (2007). Teaching executives to see social capital: Results from a field experiment. Social Science Research, 36(3), 1156-1183.
  • 51. Ideally suited method Not ideally suited method Ideally suited method, but context dependent Azevedo, R. (2015). Defining and measuring engagement and learning in science: Conceptual, theoretical, methodological, and analytical issues. Educational Psychologist, 50(1), 84-94. Capturing and measurement of engagement- related processes

Editor's Notes

  • #3: As the field of learning analytics continues to mature, there is a corresponding evolution and sophistication of the associated analytical methods and techniques. In this regard social network analysis (SNA) has emerged as one of the cornerstones of learning analytics methodologies. However, despite the noted importance of social networks for facilitating the learning process, it remains unclear how and to what extent such network measures are associated with specific learning outcomes. Motivated by Simmel's theory of social interactions and building on the argument that social centrality does not always imply benefits, this study aimed to further contribute to the understanding of the association between students' social centrality and their academic performance. The study reveals that learning analytics research drawing on SNA should incorporate both – descriptive and statistical methods to provide a more comprehensive and holistic understanding of a students' network position. In so doing researchers can undertake more nuanced and contextually salient inferences about learning in network settings. Specifically, we show how differences in the factors framing students' interactions within two instances of a MOOC affect the association between the three social network centrality measures (i.e., degree, closeness, and betweenness) and the final course outcome.
  • #4: As the field of learning analytics continues to mature, there is a corresponding evolution and sophistication of the associated analytical methods and techniques. In this regard social network analysis (SNA) has emerged as one of the cornerstones of learning analytics methodologies. However, despite the noted importance of social networks for facilitating the learning process, it remains unclear how and to what extent such network measures are associated with specific learning outcomes. Motivated by Simmel's theory of social interactions and building on the argument that social centrality does not always imply benefits, this study aimed to further contribute to the understanding of the association between students' social centrality and their academic performance. The study reveals that learning analytics research drawing on SNA should incorporate both – descriptive and statistical methods to provide a more comprehensive and holistic understanding of a students' network position. In so doing researchers can undertake more nuanced and contextually salient inferences about learning in network settings. Specifically, we show how differences in the factors framing students' interactions within two instances of a MOOC affect the association between the three social network centrality measures (i.e., degree, closeness, and betweenness) and the final course outcome.
  • #10: As the field of learning analytics continues to mature, there is a corresponding evolution and sophistication of the associated analytical methods and techniques. In this regard social network analysis (SNA) has emerged as one of the cornerstones of learning analytics methodologies. However, despite the noted importance of social networks for facilitating the learning process, it remains unclear how and to what extent such network measures are associated with specific learning outcomes. Motivated by Simmel's theory of social interactions and building on the argument that social centrality does not always imply benefits, this study aimed to further contribute to the understanding of the association between students' social centrality and their academic performance. The study reveals that learning analytics research drawing on SNA should incorporate both – descriptive and statistical methods to provide a more comprehensive and holistic understanding of a students' network position. In so doing researchers can undertake more nuanced and contextually salient inferences about learning in network settings. Specifically, we show how differences in the factors framing students' interactions within two instances of a MOOC affect the association between the three social network centrality measures (i.e., degree, closeness, and betweenness) and the final course outcome.
  • #12: As the field of learning analytics continues to mature, there is a corresponding evolution and sophistication of the associated analytical methods and techniques. In this regard social network analysis (SNA) has emerged as one of the cornerstones of learning analytics methodologies. However, despite the noted importance of social networks for facilitating the learning process, it remains unclear how and to what extent such network measures are associated with specific learning outcomes. Motivated by Simmel's theory of social interactions and building on the argument that social centrality does not always imply benefits, this study aimed to further contribute to the understanding of the association between students' social centrality and their academic performance. The study reveals that learning analytics research drawing on SNA should incorporate both – descriptive and statistical methods to provide a more comprehensive and holistic understanding of a students' network position. In so doing researchers can undertake more nuanced and contextually salient inferences about learning in network settings. Specifically, we show how differences in the factors framing students' interactions within two instances of a MOOC affect the association between the three social network centrality measures (i.e., degree, closeness, and betweenness) and the final course outcome.
  • #16: Benefits of network centrality are possible in networks with weak ties Network centrality does (not) necessarily imply less constraints and more benefit otherwise Simmel’s theory of social interactions allows for investigation whether networks are based on super strong ties. This can be analyzed with statistical methods for social network analysis (SNA) such as exponential random growth models (ERGMs) that allow for the use of triads as units of analysis, unlike commonly used dyads in descriptive SNA
  • #20: This diagram shows the results of the analysis conducted with the ERG models. It shows a significant effect of homphilic relationships between students (e.g., those who are similar in terms of achievement, country of origin) are more likely to connect. Likewise, there is a high level of reciprocity in both networks (e.g., if student A ask something student B, student B replied back to student A). The most striking results was that the social network in CodeYourself! was based on Simmelian ties (i.e., super strong ties), while this was not the case for the social network in Aprogramar. Therefore, theoretically, we expected that network centrality would be a significant predictor of achievement (i.e., grades and completion) in Aprogramar as its network was based on weak ties, while this was not the case for CodeYourself due to the nature of its network.
  • #21: The hypothesized statements from the previous slide were confirmed: network centrality was a significant predictor of achievement (i.e., grades and completion) in Aprogramar as its network was based on weak ties, while this was not the case for CodeYourself due to the nature of its network.
  • #26: Psychological models of discourse comprehension and learning, such as the construction-integration, constructionist, and indexical-embodiment models, lend themselves nicely to the exploration of learning related phenomena in computer-mediated educational environments. These psychological frameworks have identified the representations, structures, strategies, and processes at multiple levels of discourse (Graesser & McNamara, 2011; Kintsch, 1998; Snow, 2002). Five levels have frequently been identified in these frameworks: (1) words, (2) syntax, (3) the explicit textbase, (4) the situation model (sometimes called the mental model), and (5) the discourse genre and rhetorical structure (the type of discourse and its composition). The computational linguistic facility used in the correct study, Coh-Metrix (described more in the methods), allows us to capture these main levels of discourse. In the learning context, learners can experience communication misalignments and comprehension breakdowns at different levels. Such breakdowns and misalignments have important implications for the learning process.
  • #27: Language is a primary means for expressing and exchanging content through a network. It is through language that participants are able to build connections and define social ties with other actors. With regard to analytical approaches, there has been extensive knowledge gleaned from manual content analyses of learners’ discourse during educational interactions. For instance, the early research of Bernstein (1971) highlighted that individuals with more complex social networks tend to demonstrate more formal and elaborated speech forms than those with more simple and densely connected personal networks. Milroy and Margrain (1980) reported that the variety of language in use is dependent on the density of the social network and the multiplexity of the ties. According to Granovetter (1973), the intensity of ties established between actors affords an opportunity to track the linguistic phenomenon of code-switching, whereby speakers change conversational styles as they converse with interlocutors from the different parts of their sub-networks. These earlier studies illustrate the relationship between social ties and language. However, the manual content analysis methods used in those studies are no longer a viable option with the increasing scale of educational data. Consequently, researchers have been incorporating automated linguistic analysis that range from shallow level word counts to deeper level discourse analysis.
  • #45: Talk about social presence – affective, interactive and cohesive and indicating that interactive is typically always playing the role, while affective plays in betweenness, while cohesive plays in degree as well. Also indicated that affective emerges as a separate construct within social presence scales.
  • #46: Talk about social presence – affective, interactive and cohesive and indicating that interactive is typically always playing the role, while affective plays in betweenness, while cohesive plays in degree as well. Also indicated that affective emerges as a separate construct within social presence scales.