Evaluating teaching and learning in MOOCs
- 1. Janine Kiers Product Manager DelftX MOOCs Based on conference submission with Danika Marquis and Leonie Meijerink Evaluating Teaching and Learning
- 3. What is a successful MOOC? • Different perspectives • Branding • Innovation • Research • Educational CC 0 Public domain Pixabay
- 5. Evaluating Teaching & Learning • Quality AssuranceIntention: • ToolsImplementation: • Share & interpret resultsExperience: • SuggestionsImprove:
- 6. Tools: how to evaluate Teaching and Learning in a MOOC? • Passing rate • Student satisfaction • Design CC 0 Public domain Pixabay
- 7. Implementation of evaluation Tool: Online Learning Experience
- 8. Online Learning Experience • Flexible (in time, space & content) • Diverse (activities, resources & assessment) • Inclusive (accessible, cultural & gender) • Supportive (guidance & feedback) • Interactive (learner – learner/teacher/content) • Active (learning by doing) • Contextual (real world situations & problems) • Innovative (new tools, strategies & insights)
- 9. Implementation of evaluation Tools to gather & process data Sources of data Used in Student surveys Course report Forum analysis Course report Stakeholder interviews Discussion Platform data Course report
- 10. • Collaborative Analysis - eLD & Course Team • Discussion of results • Implement in rerun Implementation of evaluation Teaching and Learning report CC BY 2.0 IvanWalsh.com
- 11. Evaluation: platform data • Data analysed (completers, respondents) • Participants’ feedback • in Likert scale • written feedback
- 13. Workload: expected and actual
- 14. Describe the course in one word
- 15. Evaluation: Student activity Weekly numbers of active students (blue line), students who watched a video (green line) and students who tried an assignment (orange line).
- 17. Evaluation: Student performance • Review questions e.g. < 50%
- 18. Experience Challenges in interpretation • No student-teacher personal contact • Survey results are biased - low response rates & bias for completers • Heterogeneity of learners • Eliminate content specific results
- 19. Learning points from experience • Standardization of implementation • Standardization of interpretation of OLE • Dedicate time for evaluation • by Course Team • by support team / eLD
- 20. Effect of course evaluation • Improve evaluated course • Create knowledge base (generalized) • Reflect on support process • Professional development