SlideShare a Scribd company logo
If MOOCs are the answer - did
we ask the right questions?
Implications for the design of large-
scale online-courses
Dr. Marco Kalz
marco.kalz@ou.nl
http://twitter.com/mkalz
2
Source: Quickmeme
3
• Massive Open Online Course
• Term coined by Dave Cormier and Bryan
Alexander to describe a course (CCK08) in 2008
with 25 local participants and approx. 2300
external participants
• Course was build on ideas of networked learning,
distributed resources and connectivism
• No central place for resources and learning
activities but rather a network of actors (Latour)
MOOC
4
• 160 000 subscribed participants
• Fixed curriculum
• Video lectures combined with quizzes
• Forum for exchange between learners
5Source: Cogdogblog
6
Source: The Chronical of Higher Education
7
cMOOC vs. xMOOC
• cMOOCs are the connectivist MOOCs from the
first generation
• xMOOCs follow the Stanford-style paradigm
8Source: mathplourde@Flickr
9
Research about MOOC
Liyanagunawardena, Adams, & Williams (2013)
conclude in meta-review that research focus has
been on:
Case-studies
Implications for higher education
Educational theory behind MOOCs
“The learner perspective is underrepresented in
current research about MOOCs”
10
• cMOOc/xMOOC dichotomy is not a helpful
distinction
• While cMOOCs rely on a high level of self-
organization, IT competences and require a
specific learning style, xMOOCs mimic an
outdated paradigm oriented at the classical top-
down lecture
• High dropout of MOOCs is a sign of bad
learning design or support infrastructure (10%
completion rate)
Questioning the learning design
of MOOCs
11
Diversity?
Source: Spiva Arts@Flickr
12
Diversity?
Source: Kop, Fournier, & Mak, 2011
Other diversity factors like cultural diversity,
preferences for learning activities, support need
etc.
13
Design for diversity
• OUNL/CELSTEC research program on
Learning Networks
• Large-scale networks of people who
share a common learning goal
• Flexibility of roles, open networks
• Research and development of
support services for effective
learning in learning networks
14
Design for diversity
Three exemplary support technologies:
• Placement support service (Kalz et al., 2007)
• Personal recommender service (Drachsler et al., 2008)
• Knowledge matchmaking service (Van Rosmalen et
al., 2006)
Entry position
based on
prior
knowledge
Recommendation
of suited learning
activities based on
entry position
Grouping
learners for
joint problem
solving
15
Design for diversity
• OpenU Masterclasses as a large-scale open online
event in a professional development context
• Embedding feedback loops into the design of large-
scale open online-courses
• Balancing between pre-structured activities and
adaptation for learner preferences
• Balancing between academic quality (state of the art)
and applied knowledge
• Using the professional experience of participants
• Enabling learner/learner, learner/expert &
learner/content interaction
16
Online Masterclasses
Rubens, Kalz, & Koper
(submitted)
17
25 Masterclass with 91 - 448 participants (in total
approx. 2400 participants)
71% of participants are not students at OUNL
Iterative evaluation and development of this new
educational format
Online Masterclasses
3 x higher completion rate than usually with MOOCs
Stable satisfaction patterns among participants
Live components are expensive, but also highly
valued
18
All interaction directions are important for a diverse
audience
Critical role of interaction patterns of expert
Online Masterclasses
19
Online Masterclasses
Rubens, Kalz, & Koper (submitted)
20
Conclusions & Recommendations
• Large-scale open learning interventions
call for diversity design
• Diversity can be addressed
technologically or via the learning design
itself
• If you enter the MOOC arena, go for
innovation & quality rather than pre-
designed courses and quantity
• Set standards for content experts
• Balance between openness and
21
http://www.emoocs2014.eu
Thanks!
Dr. Marco Kalz
Associate Professor Centre for
Learning Sciences and
Technologies (CELSTEC), Faculty of
Psychology and Educational
Science, Open University of the
Netherlands
http://www.marcokalz.de
http://www.celstec.org
marco.kalz@ou.nl

More Related Content

PPTX
Making Sense of MOOCs from a Liberal Arts Perspective
PPTX
Disrupting our education and research through MOOCs
PDF
The messy realities of MOOCs
PPTX
MOOC Tales and Trends
PPTX
Trends in open and online education
PPTX
Integrating moocs into university practice
PDF
The Design of Empowering and Inspirational Open Online Learning Experiences
PPTX
Wikiwijs, an unexpected journey: lessons learned
Making Sense of MOOCs from a Liberal Arts Perspective
Disrupting our education and research through MOOCs
The messy realities of MOOCs
MOOC Tales and Trends
Trends in open and online education
Integrating moocs into university practice
The Design of Empowering and Inspirational Open Online Learning Experiences
Wikiwijs, an unexpected journey: lessons learned

What's hot (20)

PPTX
Integrating moo cs into university practice
PPTX
Engaging students through social learning
PPTX
T-DOSE, Eindhoven 28-11-2015
PPTX
OER and MOOCs in the Netherlands: State of Affairs
PPTX
CAS/CADE presentation 2013
PDF
Open Online Courses: Responding to Design Challenges
PPTX
Everything you want to know about MOOCs #oeglobal
PPTX
Integrating deep learning skills into the curriculum
PPTX
Integrating MOOCs into university practice: education and research
PPT
OER, an Overview
PPTX
The Pedagogy of MOOCs
PPTX
Amy Woodgate at Cetis conference 2014
PPT
Open education trends and developments
PPT
Cultural Imperialism or Multicultural Mix: promoting OER reuse through collab...
PPT
Wikiwijs, a National Initiative on OER
PPTX
Increasing OER Adoptions with the Community College Consortium for OER
PPTX
Designing and Developing a MOOC: Lessons from Experience
PPTX
Wikiwijs: how about teachers?
PPTX
Scaling up a Bridge to Success
PPTX
Student OER Panels and Campus-wide Faculty OER Development
Integrating moo cs into university practice
Engaging students through social learning
T-DOSE, Eindhoven 28-11-2015
OER and MOOCs in the Netherlands: State of Affairs
CAS/CADE presentation 2013
Open Online Courses: Responding to Design Challenges
Everything you want to know about MOOCs #oeglobal
Integrating deep learning skills into the curriculum
Integrating MOOCs into university practice: education and research
OER, an Overview
The Pedagogy of MOOCs
Amy Woodgate at Cetis conference 2014
Open education trends and developments
Cultural Imperialism or Multicultural Mix: promoting OER reuse through collab...
Wikiwijs, a National Initiative on OER
Increasing OER Adoptions with the Community College Consortium for OER
Designing and Developing a MOOC: Lessons from Experience
Wikiwijs: how about teachers?
Scaling up a Bridge to Success
Student OER Panels and Campus-wide Faculty OER Development
Ad

Viewers also liked (19)

PDF
قانون كونى للنجاح
PDF
Ebook 9203ﺍﻟﺪﻭﺍﻓﻊ ﺍﻟﻤﺤﺮﻛﺔ ﻟﻠﺒﺸﺮ
PPS
Subprime Primer
PDF
الجزء السابع والعشرون
PDF
تفسير الجزء السادس والعشرون
PDF
تفسير الجزء السابع من القرآن / تفسير الميسر
PDF
قوانين النجاح العقلية
PDF
Waste minimisation guide_for_the_textile_industry_a_step_towards
PDF
تفسير الجزء الثاني والعشرون
PPT
Textile effluents dbt meeting 16.1.2006
PDF
Aula Projeto de livro-reportagem
PDF
تفسير الجزء العاشر من القرآن / تفسير الميسر
PPTX
Reloaded bio
PDF
Don't Think Like an Instructional Designer—Think Like a Game Designer
PPTX
Ultrasonic waves dyeing
PPTX
Treatment of textile industry effluent
PPTX
Denim Jeans
PDF
Aula roteiro de documentário
PPTX
Anaerobic methods of waste water treatment v.n.nag
قانون كونى للنجاح
Ebook 9203ﺍﻟﺪﻭﺍﻓﻊ ﺍﻟﻤﺤﺮﻛﺔ ﻟﻠﺒﺸﺮ
Subprime Primer
الجزء السابع والعشرون
تفسير الجزء السادس والعشرون
تفسير الجزء السابع من القرآن / تفسير الميسر
قوانين النجاح العقلية
Waste minimisation guide_for_the_textile_industry_a_step_towards
تفسير الجزء الثاني والعشرون
Textile effluents dbt meeting 16.1.2006
Aula Projeto de livro-reportagem
تفسير الجزء العاشر من القرآن / تفسير الميسر
Reloaded bio
Don't Think Like an Instructional Designer—Think Like a Game Designer
Ultrasonic waves dyeing
Treatment of textile industry effluent
Denim Jeans
Aula roteiro de documentário
Anaerobic methods of waste water treatment v.n.nag
Ad

Similar to If MOOCs are the answer, did we ask the right questions? Implications for the design of large-scale online courses (20)

PDF
140509 (wr) v1 presentation moocs beyond the hype
PPTX
MOOC (PRESENTATION)
PPTX
MASSIVE... beacause size matters! MOOCs and Open Learning in ODL
PDF
8. Designing MOOCs (6) Means and resources. Openness and opening - José Manue...
PDF
How to design and orchestrate a MOOC as a collaborative knowledge community
PPTX
Mooc activity @university of johannesburg
PDF
COOL – Collaborative Open Online Learning
PPTX
PPTX
The Rise of the MOOCs
PPTX
The Rise of MOOCs
PDF
2018-07-10 ICALT 2018 in Mumbai Gap between MOOC Designers and Learners on In...
DOCX
MOOCs as a Course in Graduate or Postgraduate Programmes
PPTX
Massive open online courses
PDF
CEMCA EdTech Notes: Massive Open Online Courses
PDF
Workshop - Open online courses
PPTX
Massive Open Online Course ( MOOC )
PPTX
MOOC presentation
140509 (wr) v1 presentation moocs beyond the hype
MOOC (PRESENTATION)
MASSIVE... beacause size matters! MOOCs and Open Learning in ODL
8. Designing MOOCs (6) Means and resources. Openness and opening - José Manue...
How to design and orchestrate a MOOC as a collaborative knowledge community
Mooc activity @university of johannesburg
COOL – Collaborative Open Online Learning
The Rise of the MOOCs
The Rise of MOOCs
2018-07-10 ICALT 2018 in Mumbai Gap between MOOC Designers and Learners on In...
MOOCs as a Course in Graduate or Postgraduate Programmes
Massive open online courses
CEMCA EdTech Notes: Massive Open Online Courses
Workshop - Open online courses
Massive Open Online Course ( MOOC )
MOOC presentation

More from Marco Kalz (20)

PPTX
Digitalpakt Schule 2019
PPTX
Unintended consequences of mainstreaming of technology-enhanced learning in a...
PPTX
SchnOERzeljagden, Landkarten und MOOCs: Wem nutzt Open Education?
PPTX
Digitalisierungswahnsinn oder Nebeneffekte des Mainstream?
PPT
Von offenen Lernressourcen zu offenen Lernprozessen
PPTX
Who let the drop out? An alternative perspective on completion in open education
PPTX
OER Repositorien: Erfahrungen aus internationaler Perspektive
PDF
De structuratie van open online onderwijs in Nederland (SOONER)
PPTX
Creating meaning and authenticity with mobile serious learning games
PPT
Europäische Perspektiven offener technologiegestützter Bildung
PPT
Mobile und spielebasierte Ansätze für Lerntransfer von kritischen Entscheidun...
PPTX
EMuRgency: New approaches for resuscitation support and training - 2nd year r...
PDF
Socio-technical innovation to save lives
PPT
Energy Conservation Behaviour Toolkit
PPTX
EMuRgency: New approaches for resuscitation support and training. Overview ab...
KEY
Tablet Computers and eBooks. Unlocking the potential for personal learning en...
PDF
Schule und Medien 2012. Potenziale und Aussichten.
PPT
Peer review - Why does it matter for your academic career?
KEY
Orchestration of TEL proposals for the European Framework Programme
KEY
Lifelong mobile learning: Increasing accessibility and flexibility with table...
Digitalpakt Schule 2019
Unintended consequences of mainstreaming of technology-enhanced learning in a...
SchnOERzeljagden, Landkarten und MOOCs: Wem nutzt Open Education?
Digitalisierungswahnsinn oder Nebeneffekte des Mainstream?
Von offenen Lernressourcen zu offenen Lernprozessen
Who let the drop out? An alternative perspective on completion in open education
OER Repositorien: Erfahrungen aus internationaler Perspektive
De structuratie van open online onderwijs in Nederland (SOONER)
Creating meaning and authenticity with mobile serious learning games
Europäische Perspektiven offener technologiegestützter Bildung
Mobile und spielebasierte Ansätze für Lerntransfer von kritischen Entscheidun...
EMuRgency: New approaches for resuscitation support and training - 2nd year r...
Socio-technical innovation to save lives
Energy Conservation Behaviour Toolkit
EMuRgency: New approaches for resuscitation support and training. Overview ab...
Tablet Computers and eBooks. Unlocking the potential for personal learning en...
Schule und Medien 2012. Potenziale und Aussichten.
Peer review - Why does it matter for your academic career?
Orchestration of TEL proposals for the European Framework Programme
Lifelong mobile learning: Increasing accessibility and flexibility with table...

Recently uploaded (20)

PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Lesson notes of climatology university.
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PPTX
GDM (1) (1).pptx small presentation for students
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Classroom Observation Tools for Teachers
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
master seminar digital applications in india
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
Computing-Curriculum for Schools in Ghana
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
Weekly quiz Compilation Jan -July 25.pdf
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
Module 4: Burden of Disease Tutorial Slides S2 2025
VCE English Exam - Section C Student Revision Booklet
Lesson notes of climatology university.
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
GDM (1) (1).pptx small presentation for students
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Classroom Observation Tools for Teachers
O7-L3 Supply Chain Operations - ICLT Program
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
master seminar digital applications in india
Abdominal Access Techniques with Prof. Dr. R K Mishra
202450812 BayCHI UCSC-SV 20250812 v17.pptx
STATICS OF THE RIGID BODIES Hibbelers.pdf
Computing-Curriculum for Schools in Ghana
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
Weekly quiz Compilation Jan -July 25.pdf
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...

If MOOCs are the answer, did we ask the right questions? Implications for the design of large-scale online courses

  • 1. If MOOCs are the answer - did we ask the right questions? Implications for the design of large- scale online-courses Dr. Marco Kalz marco.kalz@ou.nl http://twitter.com/mkalz
  • 3. 3 • Massive Open Online Course • Term coined by Dave Cormier and Bryan Alexander to describe a course (CCK08) in 2008 with 25 local participants and approx. 2300 external participants • Course was build on ideas of networked learning, distributed resources and connectivism • No central place for resources and learning activities but rather a network of actors (Latour) MOOC
  • 4. 4 • 160 000 subscribed participants • Fixed curriculum • Video lectures combined with quizzes • Forum for exchange between learners
  • 6. 6 Source: The Chronical of Higher Education
  • 7. 7 cMOOC vs. xMOOC • cMOOCs are the connectivist MOOCs from the first generation • xMOOCs follow the Stanford-style paradigm
  • 9. 9 Research about MOOC Liyanagunawardena, Adams, & Williams (2013) conclude in meta-review that research focus has been on: Case-studies Implications for higher education Educational theory behind MOOCs “The learner perspective is underrepresented in current research about MOOCs”
  • 10. 10 • cMOOc/xMOOC dichotomy is not a helpful distinction • While cMOOCs rely on a high level of self- organization, IT competences and require a specific learning style, xMOOCs mimic an outdated paradigm oriented at the classical top- down lecture • High dropout of MOOCs is a sign of bad learning design or support infrastructure (10% completion rate) Questioning the learning design of MOOCs
  • 12. 12 Diversity? Source: Kop, Fournier, & Mak, 2011 Other diversity factors like cultural diversity, preferences for learning activities, support need etc.
  • 13. 13 Design for diversity • OUNL/CELSTEC research program on Learning Networks • Large-scale networks of people who share a common learning goal • Flexibility of roles, open networks • Research and development of support services for effective learning in learning networks
  • 14. 14 Design for diversity Three exemplary support technologies: • Placement support service (Kalz et al., 2007) • Personal recommender service (Drachsler et al., 2008) • Knowledge matchmaking service (Van Rosmalen et al., 2006) Entry position based on prior knowledge Recommendation of suited learning activities based on entry position Grouping learners for joint problem solving
  • 15. 15 Design for diversity • OpenU Masterclasses as a large-scale open online event in a professional development context • Embedding feedback loops into the design of large- scale open online-courses • Balancing between pre-structured activities and adaptation for learner preferences • Balancing between academic quality (state of the art) and applied knowledge • Using the professional experience of participants • Enabling learner/learner, learner/expert & learner/content interaction
  • 17. 17 25 Masterclass with 91 - 448 participants (in total approx. 2400 participants) 71% of participants are not students at OUNL Iterative evaluation and development of this new educational format Online Masterclasses 3 x higher completion rate than usually with MOOCs Stable satisfaction patterns among participants Live components are expensive, but also highly valued
  • 18. 18 All interaction directions are important for a diverse audience Critical role of interaction patterns of expert Online Masterclasses
  • 20. 20 Conclusions & Recommendations • Large-scale open learning interventions call for diversity design • Diversity can be addressed technologically or via the learning design itself • If you enter the MOOC arena, go for innovation & quality rather than pre- designed courses and quantity • Set standards for content experts • Balance between openness and
  • 22. Thanks! Dr. Marco Kalz Associate Professor Centre for Learning Sciences and Technologies (CELSTEC), Faculty of Psychology and Educational Science, Open University of the Netherlands http://www.marcokalz.de http://www.celstec.org marco.kalz@ou.nl