SlideShare a Scribd company logo
PERSONAL LEARNING GRAPHS
(PLeG)
George Siemens
Dragan Gasevic
Ryan Baker
Presented to:
International Educational Data Mining Conference
Madrid
June 27, 2015
The so-called “holy grail” of education:
personalized and adaptive learning
Personalized learning models
Keller Plan (Personalized System of Instruction)
Static learner profile (old school)
Objective based (adaptivecourseware)
Intelligent tutors (CMU OLI, cognitive tutor,
ALEKS)
Personalized (outer-loop, i.e. Knewton)
Smart Sparrow (teacher at center)
Parallel developing partners
Platform Publisher
Knewton Pearson
Smart Sparrow McGraw-Hill
Desire2Learn adaptcourseware
LoudCloud CMU OLI
Introducing PLG
Learner owned
API-like interface to systems that need
information
Related to existing work:
eportfolios
Personal learning networks
Existing toolsets (Learning Locker)
Elements
Cognitive
Process & strategy (meta-cognitive)
Affective/Engagement
Social
Why PLeG?
Jobs: disappearing & new
Automation
(Frey & Osborne, 2013)
Knowledge work
(US Bureau of Economic Analysis,
McKinsey & Co, 2012)
http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Em
ployment.pdf
http://www.bea.gov/industry/gdpbyind_data.htm
http://www.mckinsey.com/insights/organization/preparing_for_a_new_era_
of_work
McKinsey Quarterly, 2012
Personal Learning Graph (PLeG)
Personal Learning Graph (PLeG)
Student profiles
Diversifying
(OECD)
Less than 50% now full time
(US Census Bureau)
http://www.oecd.org/edu/skills-beyond-school/EDIF%202013--
N%C2%B015.pdf
http://www.census.gov/prod/2013pubs/acsbr11-14.pdf
Complexification of higher education
Learning needs are complex, ongoing
Simple singular narrative won’t suffice going
forward
The idea of the university (and learning) is
expanding and diversifying
Granularization of learning
Competency-based degrees
(Chronicle, 2014)
Prior learning assessment
(Insider Higher Ed, 2012)
http://chronicle.com/article/Competency-Based-Degrees-/144769/
http://www.insidehighered.com/news/2012/05/07/prior-learning-
assessment-catches-quietly
Granularization of assessment
Cracking the credit hour
(New America Foundation)
Badges
(Mozilla & others)
http://newamerica.net/publications/policy/cracking_the_credit_hour
http://openbadges.org/
Something is needed that expands the
idea of a “course” and moves control
of learning experience/data from the
institution to the learner
Exploration
Learning is the exploration of the unknown…
… not just mastery of what is already known.
Compelling Questions
Habitable Worlds:
Are We Alone?
Contagion:
Can We Survive?
Astronomy
Chemistry
Geology
Physics
Biology
The questions we care about don’t fit in silos
Transdisciplinary
Smart Courses
What will PLeG enable?
Career transitions
Full spectrum of learning (hobby, work, formal,
personal)
Integrated & immersive learning
Foundation for personalized/adaptive learning
Multipartite graphs
Process & strategy
Login
Lesson
View
Discussion
View
Discussion
Post
Quiz
Discussion
Reply
Discussion
Reply
Login
Lesson
View
Quiz
Discussion
View
Discussion
Post
Lesson
Text
Discussion
Text
Discussion
Text
Quiz items
Discussion
Text
Cognition & Affect/EngageProcess & strategy
Login
Lesson
View
Quiz
Discussion
View
Discussion
Post
Lesson
Text
Discussion
Text
Discussion
Text
Quiz items
Discussion
Reply
Discussion
Text
SocialProcess & strategy Cognition & Affect/Engage
High computational complexity,
but suitable representation
Coding of nodes
(necessary) to describe PLeG
Information, learning processes, affective
states, social functions, etc.
Use of process/strategy graphs
Understanding of self-regulated learning
Capturing traces of SRL
Macro-Level SRL
Process
Micro-Level SRL Process Description Example SRL Event
Planning
Task Analysis
To become familiar with the learning
context and the definition and
requirements of a (learning) task at hand
Clicking on different competences under
duties or projects related to the user
Goal Setting
To explicitly set, define or update learning
goals
Drag and dropping an available
competence to a new or an existing
learning goal
Making Personal Plans
To create plans and select strategies for
achieving a set learning goal
Choosing an available learning path as the
path for a competence
Engagement
Working on the Task
To consistently engage with a learning task
and using tactics and strategies
Request collaboration for a competence,
learning path or learning activity
Applying appropriate
Strategy Changes
To revise learning strategies, or apply
change in tactics
Adding a new activity to an existing learning
path
Evaluation &
Reflection
Evaluation
Evaluating one’s learning process and
comparing one’s work with the others
Rating a learning path, learning activity or
knowledge asset
Reflection
Reflecting on individual learning and
sharing learning experiences
Adding a comment for a competence,
learning path or learning activity
Siadaty, M., Gasevic, D., Hatala, M., Winne, P. H. (2015). Trace-based Micro-analytic Measurement of Self-
Regulated Learning Processes. Submitted to the Journal of Learning Analytics.
Siadaty, M., Gasevic, D., Hatala, M., Winne, P. H. (2015). Trace-based Micro-analytic Measurement of Self-
Regulated Learning Processes. Submitted to the Journal of Learning Analytics.
Siadaty, M., Gasevic, D., Hatala, M., Winne, P. H. (2015). Trace-based Micro-analytic Measurement of Self-
Regulated Learning Processes. Submitted to the Journal of Learning Analytics.
Use of process/strategy graphs
Measurement of metacognitive monitoring
Learning strategy
-transition graphs-
Student A
(course 2 – graded)
Student B
(course 4 – non-graded)
Orchestration graphs
Process modeling and process mining (discovery,
compliance checking, and improvement)
Dillenbourg, P. (2015). Orchestration graphs. Lausanne, Switzerland: EPFL Press / Routledge
Information structure of content
Information extraction techniques such as topic
modeling (LDA) or name entity extraction
Connectivism as a
learning theory
Networked learning
Educational
technology
- Connectivism,
- Social media,
- Emergence,
- …
- E-learning,
- Complex
adaptive system,
- edtech,
- …
- Social network,
- Networked
learning,
- Social group,
- …
Connectivism in practice
- Collaboration,
- Knowledge,
- Thought,
- …
Joksimović, S., Kovanović, V., Jovanović, J., Zouaq, A., Gašević, D., Hatala, M. (2015). What do cMOOC participants talk
about in Social Media? A Topic Analysis of Discourse in a cMOOC," In Proceedings of the 5th International Conference
on Learning Analytics & Knowledge (LAK 2015), Poughkeepsie, NY, USA (pp. 156-165).
Topic extraction
Readings and Discourse Similarity
Joksimović, S., Kovanović, V., Jovanović, J., Zouaq, A., Gašević, D., Hatala, M. (2015). What do cMOOC participants talk
about in Social Media? A Topic Analysis of Discourse in a cMOOC," In Proceedings of the 5th International Conference
on Learning Analytics & Knowledge (LAK 2015), Poughkeepsie, NY, USA (pp. 156-165).
Coding learning processes from
unstructured sources
Personal Learning Graph (PLeG)
Cognitive presence
Triggering event
Exploration
Integration
Resolution
Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical Thinking and Computer Conferencing: A Model and Tool to
Assess Cognitive Presence. American Journal of Distance Education, 15(1), 7-23.
Cognitive presence classifier
SVM classifier with the RBF kernel
Features: N-grams, Part-of-Speech N-grams, Back-Off N-grams, Dependency Triplets, Back-Off Dependency
Triplets, Named Entities, Thread Position Features, LSA Features, LIWC Features
Cohen’s κ = 0.42. Unigram baseline model: Cohen’s κ =0.33
Currently missing!
Integration of
LA/EDM & assessment
to guide learning progression
Promising development
Trace data based measures of
the crowd-sourced learning skill
E.g., Dreyfus model of skill acquisition
Milligan, S. (2015). Crowd-sourced learning in MOOCs: learning analytics meets measurement theory. In Proceedings
of the Fifth International Conference on Learning Analytics And Knowledge (pp. 151-155). ACM.
Progressions can build upon
• Models that represent prerequisite structure
and connections in knowledge
• Such as Partial Order Knowledge Spaces
(Desmarais & Pu, 2005)
Engagement in the PLeG
• Behavioral Engagement
• Affective Engagement
Engagement predicts learning
Engagement predicts long-term
participation
Engagement predicts long-term
participation
Engagement during middle school math predicts
– College attendance (San Pedro et al., 2013)
– College selectivity (San Pedro et al., in
preparation)
– College major (San Pedro et al., 2014, 2015)
Engagement predicts long-term
participation
Completing an EDM MOOC predicts joining the
EDM Society (Wang, Paquette, & Baker, 2015)
Community Factors Matter
Communities form during MOOCs like this one
(Brown et al., 2015)
Future work – study how these communities
persist into the future
(early evidence from CCK08 MOOC)
Use PLeG to
• Track what aspects of student engagement are
enduring
• As opposed to just pertaining to a specific
system or learning domain
Use PLeG to
• Determine when students are disengaged
• And track them to activities that can re-
engage them
Use PLeG to
• Find what does motivate a student
• And personalize less motivating content to
connect it to what motivates the student (cf.
Walkington & Bernacki, 2014; Walkington et
al., 2014)
Use PLeG to
• Figure out student long-term trajectories and
inform instructors and guidance counselors
Challenges
• Linking engagement models from different
learning systems to each other
– Models of different constructs
– Models with different reliabilities
– More and less aggressive models
• Figuring out how to decay engagement data
over time, and where it does and doesn’t
apply
Self-Regulated Learning
Similar challenges
We know…
• Scientific inquiry skills transfer across domains
(Sao Pedro et al., 2012)
– Essential if we are dealing with complex and multi-
disciplinary problems
• SRL skill that a student develops can be enduring
across a semester (Roll et al., 2011)
• These processes and strategies support the
development of cognition
– Can also support social skills, and affect and
engagement regulation skills
But…
• To what degree does SRL process skills in one learning
environment transfer to other environments?
• Are the same strategies and processes positive across
different learning environments?
– What behaviors are beneficial across learning
environments?
• Are the same strategies and processes effective for
different cultures and populations?
– Soriano et al. (2013) has found evidence that this is not the
case
Conclusion
Expansion of learning (for so-called knowledge age)
requires expansion techniques and methods for
learning
Learning controlled, owned
Personalized learning – by starting with learners
driving their learning
Resonance & activating latency
Labour market & related impact (rethinking “the
course”)
Need YOUR/EDM algorithmic and related expertise

More Related Content

PPT
Team-Based Learning: A Strategy for Student Engagement
PDF
Everything I have learnt about eLearning
PPTX
Learning design and learning analytics
PPTX
Project based learning
PDF
Flipped classroom
PPTX
Project based learning in e twinning
PPT
Pbl a menu of ideas
PPTX
Faculty Workshop: Boost Student Engagement and Retention
Team-Based Learning: A Strategy for Student Engagement
Everything I have learnt about eLearning
Learning design and learning analytics
Project based learning
Flipped classroom
Project based learning in e twinning
Pbl a menu of ideas
Faculty Workshop: Boost Student Engagement and Retention

What's hot (20)

PPTX
Inclusive learning design for Online Learners
PPTX
SLTCC 2016 (Keynote 1) Teachers pursuing excellence: Blending the physical, s...
PDF
A Blended Approach to Facilitating Professional Development
PPTX
Active Learning
PPTX
Getting Started with Blended Professional Learning - ISTE 2014
PPTX
Project-based and Problem-based learning
PPTX
Facilitating Learning Online - Festival of Learning
PPTX
Project Based Learning
PPTX
Blended Learning- A new strategy
PDF
Peer Evaluation as a Learning & Assessment Strategy: Enhancing Student Engage...
PDF
Reflections on transforming assessment and feedback: complexity and collabora...
PPTX
Korea 101: A course development adventure
PDF
FLEX: practice-based CPD for growth
PPTX
Learning design
PDF
Supporting High Impact Practices with portfolio-based learning Alison Poot
PPT
ICBL Evaluation
PPTX
Sauder Learning Labs
PPTX
Sensemaking LS and DL
PPTX
Team-based learning in the college classroom
PPTX
Teaching and learning futures
Inclusive learning design for Online Learners
SLTCC 2016 (Keynote 1) Teachers pursuing excellence: Blending the physical, s...
A Blended Approach to Facilitating Professional Development
Active Learning
Getting Started with Blended Professional Learning - ISTE 2014
Project-based and Problem-based learning
Facilitating Learning Online - Festival of Learning
Project Based Learning
Blended Learning- A new strategy
Peer Evaluation as a Learning & Assessment Strategy: Enhancing Student Engage...
Reflections on transforming assessment and feedback: complexity and collabora...
Korea 101: A course development adventure
FLEX: practice-based CPD for growth
Learning design
Supporting High Impact Practices with portfolio-based learning Alison Poot
ICBL Evaluation
Sauder Learning Labs
Sensemaking LS and DL
Team-based learning in the college classroom
Teaching and learning futures
Ad

Viewers also liked (20)

PDF
Virtual Communities of Practice in Academia: An Automated Discourse Analysis
PDF
The Evidence Hub: Harnessing the Collective Intelligence of Communities to Bu...
PPTX
Dcla13 discourse, computation and context – sociocultural dcla
PPT
CBME and Assessment
PDF
Digital educational resource hyperlinked index vs restaurant menu
PPT
The Value of Competency-based Medical Education Across the Continuum
PPTX
Introduction to Competency-based Education
 
PPTX
Lak 05
PDF
Personal and personalised learning and teaching (updated)
PDF
Applied learning analytics to class and program learning activities
PDF
XIP Dashboard: Visual Analytics from Automated Rhetorical Parsing of Scient...
PDF
Using data to guide (e)teaching and (e)learning
PDF
Personal and personalised learning and teaching
PDF
Deep learning vs superficial (surface) learning
PDF
Using data (analytics:analysis) to guide (e)teaching and (e)learning
PPTX
SoLAR Storm talk: epistemology, pedagogy, assessment
PDF
edmedia2014-learning-analytics-keynote
PDF
MOOCs and the Flipped Classroom; A Way, Not THE Way
PDF
Using data to inform (e)teaching and (e)learning workshop and symposium
PDF
Role of digital analytics to guide learning (updated)
Virtual Communities of Practice in Academia: An Automated Discourse Analysis
The Evidence Hub: Harnessing the Collective Intelligence of Communities to Bu...
Dcla13 discourse, computation and context – sociocultural dcla
CBME and Assessment
Digital educational resource hyperlinked index vs restaurant menu
The Value of Competency-based Medical Education Across the Continuum
Introduction to Competency-based Education
 
Lak 05
Personal and personalised learning and teaching (updated)
Applied learning analytics to class and program learning activities
XIP Dashboard: Visual Analytics from Automated Rhetorical Parsing of Scient...
Using data to guide (e)teaching and (e)learning
Personal and personalised learning and teaching
Deep learning vs superficial (surface) learning
Using data (analytics:analysis) to guide (e)teaching and (e)learning
SoLAR Storm talk: epistemology, pedagogy, assessment
edmedia2014-learning-analytics-keynote
MOOCs and the Flipped Classroom; A Way, Not THE Way
Using data to inform (e)teaching and (e)learning workshop and symposium
Role of digital analytics to guide learning (updated)
Ad

Similar to Personal Learning Graph (PLeG) (20)

PPTX
Online Course Design for Active Learning within the UDL Framework
PPTX
Learner engagement
PDF
Using Learning communities to implement Mobile Learning
PPTX
The Pedagogy of Virtual, Cross-culture, Probel Based Learning
PPTX
Theoretical and Empirical Foundations of Connected Learning at Virginia Commo...
PPT
C-SAP e-learning forum: Overview of Open Educational Resources project
PPT
Overview of C-SAP open educational resources project
PPT
Emergent Learning Model
PPTX
Mecar2010
PDF
Macfadyen usc tlt keynote 2015.pptx
PPT
Mapping Emergent Information Landscapes
PPT
Emergent Learning Pecha Kucha
PPT
Blended Learning, Day 2, Riyadh
DOC
Ejemplo artículonormasapa plantilla
PDF
Social Learning Analytics
PPTX
Digifest 2017 - Learning Analytics & Learning Design
PDF
SNS messages Recommendation for Learning Motivation (AIED 2015)
PPT
Learning Analytics -Towards a New Discipline-
PDF
Learning Analytics - A New Discipline and Linked Data
PPT
E-Portfolios and the Problem of Learning
Online Course Design for Active Learning within the UDL Framework
Learner engagement
Using Learning communities to implement Mobile Learning
The Pedagogy of Virtual, Cross-culture, Probel Based Learning
Theoretical and Empirical Foundations of Connected Learning at Virginia Commo...
C-SAP e-learning forum: Overview of Open Educational Resources project
Overview of C-SAP open educational resources project
Emergent Learning Model
Mecar2010
Macfadyen usc tlt keynote 2015.pptx
Mapping Emergent Information Landscapes
Emergent Learning Pecha Kucha
Blended Learning, Day 2, Riyadh
Ejemplo artículonormasapa plantilla
Social Learning Analytics
Digifest 2017 - Learning Analytics & Learning Design
SNS messages Recommendation for Learning Motivation (AIED 2015)
Learning Analytics -Towards a New Discipline-
Learning Analytics - A New Discipline and Linked Data
E-Portfolios and the Problem of Learning

More from Dragan Gasevic (20)

PDF
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
PDF
Can learning analytics offer meaningful assessment?
PDF
Towards Strengthening Links between Learning Analytics and Assessment
PDF
Let’s get there! Towards policy for adoption of learning analytics
PPTX
State and Directions of Learning Analytics Adoption (Second edition)
PPTX
Wearable technologies should promote adaptive learners
PPTX
Learning with me Mate: Analytics of Social Networks in Higher Education
PPTX
Technologies to support self-directed learning through social interaction
PPTX
Learning analytics: An opportunity for higher education?
PPTX
Learning analytics are more than a technology
PPTX
Learning analytics are more than measurement
PPTX
Learning analytics and MOOCs: What have we learned so far and where to go?
PPTX
Social network analysis and understanding of massive open online courses
PPTX
Social network analysis and social presence
PPTX
Social network analysis and learning design
PPTX
Social network analysis and creative potential
PPTX
Social network analysis and academic performance
PPTX
Sensemaking of social network analysis for the study of learning
PPTX
Network modularity and community identification
PPTX
Network measures used in social network analysis
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Can learning analytics offer meaningful assessment?
Towards Strengthening Links between Learning Analytics and Assessment
Let’s get there! Towards policy for adoption of learning analytics
State and Directions of Learning Analytics Adoption (Second edition)
Wearable technologies should promote adaptive learners
Learning with me Mate: Analytics of Social Networks in Higher Education
Technologies to support self-directed learning through social interaction
Learning analytics: An opportunity for higher education?
Learning analytics are more than a technology
Learning analytics are more than measurement
Learning analytics and MOOCs: What have we learned so far and where to go?
Social network analysis and understanding of massive open online courses
Social network analysis and social presence
Social network analysis and learning design
Social network analysis and creative potential
Social network analysis and academic performance
Sensemaking of social network analysis for the study of learning
Network modularity and community identification
Network measures used in social network analysis

Recently uploaded (20)

PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
TR - Agricultural Crops Production NC III.pdf
PPTX
Institutional Correction lecture only . . .
PDF
Pre independence Education in Inndia.pdf
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Pharma ospi slides which help in ospi learning
PDF
Complications of Minimal Access Surgery at WLH
PDF
RMMM.pdf make it easy to upload and study
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PPTX
Cell Types and Its function , kingdom of life
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Microbial diseases, their pathogenesis and prophylaxis
TR - Agricultural Crops Production NC III.pdf
Institutional Correction lecture only . . .
Pre independence Education in Inndia.pdf
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
VCE English Exam - Section C Student Revision Booklet
Pharma ospi slides which help in ospi learning
Complications of Minimal Access Surgery at WLH
RMMM.pdf make it easy to upload and study
Microbial disease of the cardiovascular and lymphatic systems
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
human mycosis Human fungal infections are called human mycosis..pptx
Supply Chain Operations Speaking Notes -ICLT Program
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Pharmacology of Heart Failure /Pharmacotherapy of CHF
Renaissance Architecture: A Journey from Faith to Humanism
102 student loan defaulters named and shamed – Is someone you know on the list?
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Cell Types and Its function , kingdom of life

Personal Learning Graph (PLeG)

  • 1. PERSONAL LEARNING GRAPHS (PLeG) George Siemens Dragan Gasevic Ryan Baker Presented to: International Educational Data Mining Conference Madrid June 27, 2015
  • 2. The so-called “holy grail” of education: personalized and adaptive learning
  • 3. Personalized learning models Keller Plan (Personalized System of Instruction) Static learner profile (old school) Objective based (adaptivecourseware) Intelligent tutors (CMU OLI, cognitive tutor, ALEKS) Personalized (outer-loop, i.e. Knewton) Smart Sparrow (teacher at center)
  • 4. Parallel developing partners Platform Publisher Knewton Pearson Smart Sparrow McGraw-Hill Desire2Learn adaptcourseware LoudCloud CMU OLI
  • 5. Introducing PLG Learner owned API-like interface to systems that need information Related to existing work: eportfolios Personal learning networks Existing toolsets (Learning Locker)
  • 6. Elements Cognitive Process & strategy (meta-cognitive) Affective/Engagement Social
  • 8. Jobs: disappearing & new Automation (Frey & Osborne, 2013) Knowledge work (US Bureau of Economic Analysis, McKinsey & Co, 2012) http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Em ployment.pdf http://www.bea.gov/industry/gdpbyind_data.htm http://www.mckinsey.com/insights/organization/preparing_for_a_new_era_ of_work
  • 12. Student profiles Diversifying (OECD) Less than 50% now full time (US Census Bureau) http://www.oecd.org/edu/skills-beyond-school/EDIF%202013-- N%C2%B015.pdf http://www.census.gov/prod/2013pubs/acsbr11-14.pdf
  • 13. Complexification of higher education Learning needs are complex, ongoing Simple singular narrative won’t suffice going forward The idea of the university (and learning) is expanding and diversifying
  • 14. Granularization of learning Competency-based degrees (Chronicle, 2014) Prior learning assessment (Insider Higher Ed, 2012) http://chronicle.com/article/Competency-Based-Degrees-/144769/ http://www.insidehighered.com/news/2012/05/07/prior-learning- assessment-catches-quietly
  • 15. Granularization of assessment Cracking the credit hour (New America Foundation) Badges (Mozilla & others) http://newamerica.net/publications/policy/cracking_the_credit_hour http://openbadges.org/
  • 16. Something is needed that expands the idea of a “course” and moves control of learning experience/data from the institution to the learner
  • 17. Exploration Learning is the exploration of the unknown… … not just mastery of what is already known.
  • 18. Compelling Questions Habitable Worlds: Are We Alone? Contagion: Can We Survive?
  • 19. Astronomy Chemistry Geology Physics Biology The questions we care about don’t fit in silos Transdisciplinary
  • 21. What will PLeG enable? Career transitions Full spectrum of learning (hobby, work, formal, personal) Integrated & immersive learning Foundation for personalized/adaptive learning
  • 26. High computational complexity, but suitable representation
  • 27. Coding of nodes (necessary) to describe PLeG Information, learning processes, affective states, social functions, etc.
  • 28. Use of process/strategy graphs Understanding of self-regulated learning
  • 29. Capturing traces of SRL Macro-Level SRL Process Micro-Level SRL Process Description Example SRL Event Planning Task Analysis To become familiar with the learning context and the definition and requirements of a (learning) task at hand Clicking on different competences under duties or projects related to the user Goal Setting To explicitly set, define or update learning goals Drag and dropping an available competence to a new or an existing learning goal Making Personal Plans To create plans and select strategies for achieving a set learning goal Choosing an available learning path as the path for a competence Engagement Working on the Task To consistently engage with a learning task and using tactics and strategies Request collaboration for a competence, learning path or learning activity Applying appropriate Strategy Changes To revise learning strategies, or apply change in tactics Adding a new activity to an existing learning path Evaluation & Reflection Evaluation Evaluating one’s learning process and comparing one’s work with the others Rating a learning path, learning activity or knowledge asset Reflection Reflecting on individual learning and sharing learning experiences Adding a comment for a competence, learning path or learning activity Siadaty, M., Gasevic, D., Hatala, M., Winne, P. H. (2015). Trace-based Micro-analytic Measurement of Self- Regulated Learning Processes. Submitted to the Journal of Learning Analytics.
  • 30. Siadaty, M., Gasevic, D., Hatala, M., Winne, P. H. (2015). Trace-based Micro-analytic Measurement of Self- Regulated Learning Processes. Submitted to the Journal of Learning Analytics.
  • 31. Siadaty, M., Gasevic, D., Hatala, M., Winne, P. H. (2015). Trace-based Micro-analytic Measurement of Self- Regulated Learning Processes. Submitted to the Journal of Learning Analytics.
  • 32. Use of process/strategy graphs Measurement of metacognitive monitoring
  • 33. Learning strategy -transition graphs- Student A (course 2 – graded) Student B (course 4 – non-graded)
  • 34. Orchestration graphs Process modeling and process mining (discovery, compliance checking, and improvement) Dillenbourg, P. (2015). Orchestration graphs. Lausanne, Switzerland: EPFL Press / Routledge
  • 35. Information structure of content Information extraction techniques such as topic modeling (LDA) or name entity extraction
  • 36. Connectivism as a learning theory Networked learning Educational technology - Connectivism, - Social media, - Emergence, - … - E-learning, - Complex adaptive system, - edtech, - … - Social network, - Networked learning, - Social group, - … Connectivism in practice - Collaboration, - Knowledge, - Thought, - … Joksimović, S., Kovanović, V., Jovanović, J., Zouaq, A., Gašević, D., Hatala, M. (2015). What do cMOOC participants talk about in Social Media? A Topic Analysis of Discourse in a cMOOC," In Proceedings of the 5th International Conference on Learning Analytics & Knowledge (LAK 2015), Poughkeepsie, NY, USA (pp. 156-165). Topic extraction
  • 37. Readings and Discourse Similarity Joksimović, S., Kovanović, V., Jovanović, J., Zouaq, A., Gašević, D., Hatala, M. (2015). What do cMOOC participants talk about in Social Media? A Topic Analysis of Discourse in a cMOOC," In Proceedings of the 5th International Conference on Learning Analytics & Knowledge (LAK 2015), Poughkeepsie, NY, USA (pp. 156-165).
  • 38. Coding learning processes from unstructured sources
  • 40. Cognitive presence Triggering event Exploration Integration Resolution Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical Thinking and Computer Conferencing: A Model and Tool to Assess Cognitive Presence. American Journal of Distance Education, 15(1), 7-23.
  • 41. Cognitive presence classifier SVM classifier with the RBF kernel Features: N-grams, Part-of-Speech N-grams, Back-Off N-grams, Dependency Triplets, Back-Off Dependency Triplets, Named Entities, Thread Position Features, LSA Features, LIWC Features Cohen’s κ = 0.42. Unigram baseline model: Cohen’s κ =0.33
  • 42. Currently missing! Integration of LA/EDM & assessment to guide learning progression
  • 43. Promising development Trace data based measures of the crowd-sourced learning skill E.g., Dreyfus model of skill acquisition Milligan, S. (2015). Crowd-sourced learning in MOOCs: learning analytics meets measurement theory. In Proceedings of the Fifth International Conference on Learning Analytics And Knowledge (pp. 151-155). ACM.
  • 44. Progressions can build upon • Models that represent prerequisite structure and connections in knowledge • Such as Partial Order Knowledge Spaces (Desmarais & Pu, 2005)
  • 45. Engagement in the PLeG • Behavioral Engagement • Affective Engagement
  • 48. Engagement predicts long-term participation Engagement during middle school math predicts – College attendance (San Pedro et al., 2013) – College selectivity (San Pedro et al., in preparation) – College major (San Pedro et al., 2014, 2015)
  • 49. Engagement predicts long-term participation Completing an EDM MOOC predicts joining the EDM Society (Wang, Paquette, & Baker, 2015)
  • 50. Community Factors Matter Communities form during MOOCs like this one (Brown et al., 2015) Future work – study how these communities persist into the future (early evidence from CCK08 MOOC)
  • 51. Use PLeG to • Track what aspects of student engagement are enduring • As opposed to just pertaining to a specific system or learning domain
  • 52. Use PLeG to • Determine when students are disengaged • And track them to activities that can re- engage them
  • 53. Use PLeG to • Find what does motivate a student • And personalize less motivating content to connect it to what motivates the student (cf. Walkington & Bernacki, 2014; Walkington et al., 2014)
  • 54. Use PLeG to • Figure out student long-term trajectories and inform instructors and guidance counselors
  • 55. Challenges • Linking engagement models from different learning systems to each other – Models of different constructs – Models with different reliabilities – More and less aggressive models • Figuring out how to decay engagement data over time, and where it does and doesn’t apply
  • 57. We know… • Scientific inquiry skills transfer across domains (Sao Pedro et al., 2012) – Essential if we are dealing with complex and multi- disciplinary problems • SRL skill that a student develops can be enduring across a semester (Roll et al., 2011) • These processes and strategies support the development of cognition – Can also support social skills, and affect and engagement regulation skills
  • 58. But… • To what degree does SRL process skills in one learning environment transfer to other environments? • Are the same strategies and processes positive across different learning environments? – What behaviors are beneficial across learning environments? • Are the same strategies and processes effective for different cultures and populations? – Soriano et al. (2013) has found evidence that this is not the case
  • 59. Conclusion Expansion of learning (for so-called knowledge age) requires expansion techniques and methods for learning Learning controlled, owned Personalized learning – by starting with learners driving their learning Resonance & activating latency Labour market & related impact (rethinking “the course”) Need YOUR/EDM algorithmic and related expertise

Editor's Notes

  • #10: https://www.mckinseyquarterly.com/Economic_Studies/Productivity_Performance/Preparing_for_a_new_era_of_knowledge_work_3034
  • #11: http://www.bls.gov/opub/ted/2014/ted_20140728.htm
  • #12: http://www.bls.gov/opub/ted/2014/ted_20140728.htm
  • #18: So what makes the type of courseware special? Well, we think that it teaches students that science is not just mastery of what is already known, but an exploration of the unknown. We actually believe that this is what learning itself is all about.
  • #19: The courseware is also centred around compelling questions that motivate students, such as, are we alone in the universe? There are challenging problems that contextualise the learning. They are authentic problems that real scientists are working on right now at the frontier of human knowledge.
  • #20: The courseware also gets students to appreciate the solutions to real problems in science do not fit into tidy disciplinary bins. The courseware has a transdisciplinary approach whilst mapping closely to introductory science courses, and the learning objectives faculty are used to teaching.
  • #21: And as a community, we are building what we call Smart Courses: streams of enquiry, centred around a Big Question (for example, Are We Alone?), which map to introductory science courses in physics, chemistry, and biology. We currently have the existing gen-ed science course Habitable Worlds that I mentioned, and will have the biology course (or Stream) completed this year. The first set of courses will be framed around this astrobiology theme and next year we will do it all again with a biomedical theme and the Big Question: can we survive the next epidemic?
  • #44: Novice, advanced beginner, competent, proficient, and expert