SlideShare a Scribd company logo
Engaging Learning Analytics
in MOOCs:
the good, the bad, and the ugly
Mohammad Khalil, Behnam Taraghi and Martin Ebner
Educational Technology
hello!
I am
Mohammad
Khalil
You can find me:
@TuMohdKhalil Mohdkhalil.wordpress.com mohammad.khalil@tugraz.at
PhD Candidate
Where is our research Department located...
our department
Educational Technology
TUGraz, Austria
OER
MOOCs
Learning AnalyticsPersonalized Learning
Big Data
Adaptive Learning
Educational Data Mining
Technology Enhanced Learning
Lifelong Learning
1. MOOCs
The new generation of Distance Learning
MOOCs ?
Image from: http://cdn2.hubspot.net/hub/685689/file-3231367982-jpg/blog-files/massiveopenonline_620x400.jpg?t=1462361738877
To Summarize:
You can attend courses
from prestigious universities
for free
2. Learning Analytics
It is a data analytics...but in educational systems
like...MOOCs
“Collecting traces that learners leave behind and using
those traces to improve learning.
-Erik Duval
Learning Analytics
Data Collection
Mouse Clicks
Quizzes
Activity &
Engagement
Forums
Assignments
Video LEctures
Logins
Learning Analytics
Analysis &
Interpretation
Lackner, E., Khalil, M., Ebner, M. “How to foster forum discussions within MOOCs: A case study”, IJARE (in review).
Khalil, M., Ebner, M. (2016). “What Massive Open Online Course (MOOC) Stakeholders Can Learn from Learning
Analytics?”. Learning, Design & Technology. Springer International Publishing.
How does it look like?
Source: BME Solutions Ltd
iMooX Learning Analytics (iLAP)
Is it only great
like this?
The Good
X 9
The Bad
X 6
The Ugly
X 4
Learning Analytics of MOOCs ...
The GOOD
▸Prediction (... students at risk, performance...)
▸Recommendation (... suggest course, article...)
▸Visualization (... dashboards, plots...)
▸Entertainment (... Gamification elements...)
9
The GOOD
▸Benchmarking (... evaluate courses, difficulties...)
▸Personalization (... customize courses, notes...)
▸Enhance Engagement (... interventions for
subpopulations...)
▸Communicate Information (... statistical
analysis to different stakeholders…)
▸Cost Saving (... allocate resources effectively...)
9
The Bad
▸Security
○ Students Database security configuration is overlooked.
○ Achieve confidentiality, integrity, and availability.
▸Privacy
○ MOOC datasets may hold sensitive information.
○ Considered as a threat and constraint.
▸Ownership
○ Who owns the collected data?
6
The Bad
▸Consent
○ Declaration on data collection
○ Processed data usage, sell to third parties or research?
▸Transparency
○ Transparent of research or data usage
▸Storage
○ Storing big data can be costly and complex
○ European Directive 95/46/EC says personal data needs to
be stored no longer than necessary.
6
The Ugly
▸False Positives
○ Decisions based on small subset of data.
○ Forums activity as an example!
▸Fallacy Analytics
○ Analytics could fail!
○ Wrong predictions, interventions, visualizations...
▸Bias
○ Bias towards certain hypothesis leads to biased LA
▸Distill meaningful data
○ Pay efforts for ineffective results
4
Conclusion
▸Learning Analytics imply
high potential in MOOCs.
▸Code of practice is required
to carry out the optimum
outcomes.
Thanks!
any
questions
?
@TuMohdKhalil Mohdkhalil.wordpress.com mohammad.khalil@tugraz.at
Educational Technology
Presentation available on: http://elearningblog.tugraz.at & http://mohdkhalil.wordpress.com

More Related Content

PPTX
What is Learning Analytics about? A Survey of Different Methods Used in 2013-...
PPTX
Learning Analytics in Massive Open Online Courses - PhD Defense
PPTX
Learning Analytics & MOOCs- Data Issues Perspective
PPTX
Why Undergraduates Enroll in MOOCs?
PPTX
Learning Analytics in MOOCs: Can Data Improve Students Retention and Learning?
PPTX
When Learning Analytics Meets MOOCs - a Review on iMooX Case Studies
PPTX
Does Gamification in MOOC discussion forums Work?
PPTX
Learning Analytics: Principles and Constraints
What is Learning Analytics about? A Survey of Different Methods Used in 2013-...
Learning Analytics in Massive Open Online Courses - PhD Defense
Learning Analytics & MOOCs- Data Issues Perspective
Why Undergraduates Enroll in MOOCs?
Learning Analytics in MOOCs: Can Data Improve Students Retention and Learning?
When Learning Analytics Meets MOOCs - a Review on iMooX Case Studies
Does Gamification in MOOC discussion forums Work?
Learning Analytics: Principles and Constraints

What's hot (20)

PPTX
On Using Learning Analytics to Track the Activity of Interactive MOOC Videos
PPTX
a STEM MOOC for School Children - What does Learning Analytics Tell us?
PPTX
De-identification in Learning Analytics
PPTX
What is Learning Analytics about?
PDF
MOOCs, Learning Analytics and OER 
- a perfect triangle for 
the future of ed...
PDF
Emerging Technologies - from m- to seamless learning
PPTX
EdTech: communicating and learning virtually - Example of a flipped lecture
PPTX
PDF
2015 03 19 (EDUCON2015) eMadrid UAM Towards MOOCs scenaries based on Collabor...
PPTX
2015 03 19 (EDUCON2015) eMadrid UPM Towards a Learning Analytics Approach for...
PDF
Week 11: Cloud Native- DSA 441 Cloud Computing
PPTX
IEEE EDUCON 2015 reputation mooc
PDF
Week 11: Programming for Data Analysis
PDF
Week 7: Object Storage Service Alibaba Cloud- DSA 441 Cloud Computing
PDF
OpenData in OpenEd (beyond OERs)
PDF
Week 10: Cloud Security- DSA 441 Cloud Computing
PDF
When Learning Analytics Meets MOOCs
PDF
How Learning Analytics can Support Teaching and Learning
PDF
Deos 2014 - Welcome
PPTX
Mootnz13 Moodle Analytics
On Using Learning Analytics to Track the Activity of Interactive MOOC Videos
a STEM MOOC for School Children - What does Learning Analytics Tell us?
De-identification in Learning Analytics
What is Learning Analytics about?
MOOCs, Learning Analytics and OER 
- a perfect triangle for 
the future of ed...
Emerging Technologies - from m- to seamless learning
EdTech: communicating and learning virtually - Example of a flipped lecture
2015 03 19 (EDUCON2015) eMadrid UAM Towards MOOCs scenaries based on Collabor...
2015 03 19 (EDUCON2015) eMadrid UPM Towards a Learning Analytics Approach for...
Week 11: Cloud Native- DSA 441 Cloud Computing
IEEE EDUCON 2015 reputation mooc
Week 11: Programming for Data Analysis
Week 7: Object Storage Service Alibaba Cloud- DSA 441 Cloud Computing
OpenData in OpenEd (beyond OERs)
Week 10: Cloud Security- DSA 441 Cloud Computing
When Learning Analytics Meets MOOCs
How Learning Analytics can Support Teaching and Learning
Deos 2014 - Welcome
Mootnz13 Moodle Analytics
Ad

Viewers also liked (10)

PDF
Designing MOOCs to Support Use of Different Types of Knowledge Resources in L...
PDF
REX du MOOC Cuisine Afpa
PPTX
Informal self-directed learning in FutureLearn MOOCs
PPTX
Learning analytics are about learning
PPTX
Governing by data: Considerations on the role of learning analytics in education
PDF
Que sera l'Université en 2035 ? Un Hack'apprendre réalisé par le LLL
PDF
Les Classes Inversées : Enseigner à l’envers, Apprendre à l’endroit ou l’inve...
PPTX
(Se) construire dans un Web en constante évolution
PDF
Livre blanc mobile-learning by IL&DI http://il-di.com
PPTX
Evaluation par les pairs dans les MOOC : résultats d'une enquête
Designing MOOCs to Support Use of Different Types of Knowledge Resources in L...
REX du MOOC Cuisine Afpa
Informal self-directed learning in FutureLearn MOOCs
Learning analytics are about learning
Governing by data: Considerations on the role of learning analytics in education
Que sera l'Université en 2035 ? Un Hack'apprendre réalisé par le LLL
Les Classes Inversées : Enseigner à l’envers, Apprendre à l’endroit ou l’inve...
(Se) construire dans un Web en constante évolution
Livre blanc mobile-learning by IL&DI http://il-di.com
Evaluation par les pairs dans les MOOC : résultats d'une enquête
Ad

Similar to Engaging Learning Analytics in MOOCs: the good, the bad, and the ugly (20)

PPTX
eLeanring course for education and researc.pptx
PDF
RDA - A preliminary study of online "Data Science" courses
PPTX
Why Institutions Adopt MOOCs: Breaking Down Traditional Barriers or Reproduci...
PPTX
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
PPT
Big Data, Analytics and the Future of Learning
PPTX
Analytics (as if learning mattered) - RIDE Symposium, University of London 10...
PDF
How to crack down big data?
PPTX
MOOCS and Learning Analytics
PPTX
Technology Enhanced Learning - MOOCs and Learning Analytics
PPTX
Towards Tangible Trusted Learning Analytics
PPTX
In Focus presentation: Analytics: as if learning mattered
PDF
MOOC Design: MOOCs for the world of business
PDF
ico-fallschool2012-learninganalyticswkshp
PPTX
Moodle, the de facto learning platform to facilitate research and experimenta...
PDF
Literature survey andrei_manta_0
PPTX
Universal design for learning (udl)
PDF
Open research open education stracke with results christian m stracke ignasi ...
DOC
Privacy and education to-day
 
DOC
English resume identité numeriquefice word
 
PDF
DSCI 552 machine learning for data science
eLeanring course for education and researc.pptx
RDA - A preliminary study of online "Data Science" courses
Why Institutions Adopt MOOCs: Breaking Down Traditional Barriers or Reproduci...
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
Big Data, Analytics and the Future of Learning
Analytics (as if learning mattered) - RIDE Symposium, University of London 10...
How to crack down big data?
MOOCS and Learning Analytics
Technology Enhanced Learning - MOOCs and Learning Analytics
Towards Tangible Trusted Learning Analytics
In Focus presentation: Analytics: as if learning mattered
MOOC Design: MOOCs for the world of business
ico-fallschool2012-learninganalyticswkshp
Moodle, the de facto learning platform to facilitate research and experimenta...
Literature survey andrei_manta_0
Universal design for learning (udl)
Open research open education stracke with results christian m stracke ignasi ...
Privacy and education to-day
 
English resume identité numeriquefice word
 
DSCI 552 machine learning for data science

More from Mohammad Khalil (9)

PPTX
Learning analytics in a time of pandemics
PPTX
Compbiomed presentation
PPTX
The use of Learning Analytics to explore sequences of self-regulated learning...
PPTX
Evaluating the Usability of a Study Support Mobile App in Higher Ed
PPTX
The unbearable lightness of consent: Mapping MOOC providers’ response to consent
PPTX
Gamification in MOOCs: a Review of the State of the Art
PPTX
EMOOCs2018 announcement
PDF
EMOOCs2016 MOOC Conference 2016
PPTX
iOS Human Interface Guidelines (HCI)
Learning analytics in a time of pandemics
Compbiomed presentation
The use of Learning Analytics to explore sequences of self-regulated learning...
Evaluating the Usability of a Study Support Mobile App in Higher Ed
The unbearable lightness of consent: Mapping MOOC providers’ response to consent
Gamification in MOOCs: a Review of the State of the Art
EMOOCs2018 announcement
EMOOCs2016 MOOC Conference 2016
iOS Human Interface Guidelines (HCI)

Recently uploaded (20)

PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
01-Introduction-to-Information-Management.pdf
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
Updated Idioms and Phrasal Verbs in English subject
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
LNK 2025 (2).pdf MWEHEHEHEHEHEHEHEHEHEHE
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PPTX
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
PPTX
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
RMMM.pdf make it easy to upload and study
PDF
Trump Administration's workforce development strategy
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PPTX
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
01-Introduction-to-Information-Management.pdf
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Updated Idioms and Phrasal Verbs in English subject
Chinmaya Tiranga quiz Grand Finale.pdf
LNK 2025 (2).pdf MWEHEHEHEHEHEHEHEHEHEHE
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Supply Chain Operations Speaking Notes -ICLT Program
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
What if we spent less time fighting change, and more time building what’s rig...
RMMM.pdf make it easy to upload and study
Trump Administration's workforce development strategy
History, Philosophy and sociology of education (1).pptx
Practical Manual AGRO-233 Principles and Practices of Natural Farming
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
Final Presentation General Medicine 03-08-2024.pptx
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf

Engaging Learning Analytics in MOOCs: the good, the bad, and the ugly

  • 1. Engaging Learning Analytics in MOOCs: the good, the bad, and the ugly Mohammad Khalil, Behnam Taraghi and Martin Ebner Educational Technology
  • 2. hello! I am Mohammad Khalil You can find me: @TuMohdKhalil Mohdkhalil.wordpress.com mohammad.khalil@tugraz.at PhD Candidate
  • 3. Where is our research Department located... our department Educational Technology TUGraz, Austria OER MOOCs Learning AnalyticsPersonalized Learning Big Data Adaptive Learning Educational Data Mining Technology Enhanced Learning Lifelong Learning
  • 4. 1. MOOCs The new generation of Distance Learning
  • 5. MOOCs ? Image from: http://cdn2.hubspot.net/hub/685689/file-3231367982-jpg/blog-files/massiveopenonline_620x400.jpg?t=1462361738877
  • 6. To Summarize: You can attend courses from prestigious universities for free
  • 7. 2. Learning Analytics It is a data analytics...but in educational systems like...MOOCs
  • 8. “Collecting traces that learners leave behind and using those traces to improve learning. -Erik Duval
  • 9. Learning Analytics Data Collection Mouse Clicks Quizzes Activity & Engagement Forums Assignments Video LEctures Logins
  • 10. Learning Analytics Analysis & Interpretation Lackner, E., Khalil, M., Ebner, M. “How to foster forum discussions within MOOCs: A case study”, IJARE (in review). Khalil, M., Ebner, M. (2016). “What Massive Open Online Course (MOOC) Stakeholders Can Learn from Learning Analytics?”. Learning, Design & Technology. Springer International Publishing.
  • 11. How does it look like? Source: BME Solutions Ltd iMooX Learning Analytics (iLAP)
  • 12. Is it only great like this?
  • 13. The Good X 9 The Bad X 6 The Ugly X 4 Learning Analytics of MOOCs ...
  • 14. The GOOD ▸Prediction (... students at risk, performance...) ▸Recommendation (... suggest course, article...) ▸Visualization (... dashboards, plots...) ▸Entertainment (... Gamification elements...) 9
  • 15. The GOOD ▸Benchmarking (... evaluate courses, difficulties...) ▸Personalization (... customize courses, notes...) ▸Enhance Engagement (... interventions for subpopulations...) ▸Communicate Information (... statistical analysis to different stakeholders…) ▸Cost Saving (... allocate resources effectively...) 9
  • 16. The Bad ▸Security ○ Students Database security configuration is overlooked. ○ Achieve confidentiality, integrity, and availability. ▸Privacy ○ MOOC datasets may hold sensitive information. ○ Considered as a threat and constraint. ▸Ownership ○ Who owns the collected data? 6
  • 17. The Bad ▸Consent ○ Declaration on data collection ○ Processed data usage, sell to third parties or research? ▸Transparency ○ Transparent of research or data usage ▸Storage ○ Storing big data can be costly and complex ○ European Directive 95/46/EC says personal data needs to be stored no longer than necessary. 6
  • 18. The Ugly ▸False Positives ○ Decisions based on small subset of data. ○ Forums activity as an example! ▸Fallacy Analytics ○ Analytics could fail! ○ Wrong predictions, interventions, visualizations... ▸Bias ○ Bias towards certain hypothesis leads to biased LA ▸Distill meaningful data ○ Pay efforts for ineffective results 4
  • 19. Conclusion ▸Learning Analytics imply high potential in MOOCs. ▸Code of practice is required to carry out the optimum outcomes.
  • 20. Thanks! any questions ? @TuMohdKhalil Mohdkhalil.wordpress.com mohammad.khalil@tugraz.at Educational Technology Presentation available on: http://elearningblog.tugraz.at & http://mohdkhalil.wordpress.com