SlideShare a Scribd company logo
Su-Tuan Lulee
September 1st, 2013
Assessing Critical Thinking in Massive
Open Online Courses(MOOCs):
The Relationship Between Content Analysis &
Social Network Analysis
• MOOC is an emerging form of education and has
been placed in wide context of open education
recently. However, the nature of emergent,
fragmented, diffuse, and diverse nature of
MOOCs make educators question about “To what
extent students of MOOCs have demonstrated
critical thinking skills?”
• How can content analysis and social network help
with answering the question? Do the results of
these two methods highly related to each other?
Problem
• Setting: Adult open online learning
Context
• To investigate whether or not the analysis
results from two research methods – content
analysis and social analysis highly related to
each other.
Purpose
• Critical thinking is important for knowledge
construction in education.
• The interaction in group discussions is the visual
evidence of critical thinking. More interaction
leads to higher levels of knowledge construction.
• Content analysis and social network analysis are
both effective tools for investigating student
critical thinking. Levels of critical thinking in
MOOCs should highly relate to the centrality
measures of social networks.
Assumption
• Research tools: content analysis (Atlas.ti),
social network analysis (NodeX/SNAPP), and
Spearman’s correlations.
• Samples:
– participants > 300 per MOOC
– main discussions took place in an LMS (Canvas)
• Procedure: collect discussion data → Excel →
Content analysis/SNA → Correlation analysis
Methodology
• To what extent students of MOOCs have
demonstrated critical thinking skills?
• How can content analysis and social network
help with answering the question?
• Do the results of these two methods highly
related to each other?
Research Questions
• MOOC have been adopted widely in higher
education however academic research on MOOCs
is limited currently.
• Due to the massive learners of MOOCs, the
educators will rely heavily on learning analysis
technique to support their decisions on next-step
instructional intervention, and the curriculum
design in the near future. It is necessary to
validate the various existing measurements.
Significance of the Study
• Generalizability:
– Focus on discussions on LMS only
– convenience sampling
– small sample size (only 2-3 MOOCs will be
analyzed)
Limitation

More Related Content

PPTX
ICKM 2015 - Analysing & Predicting Recurrent Interaction in MOOCs forums
PPTX
PhDchat: brief summary of my thesis and thoughts about my PhD journey
PPT
Wendi Chen
PPTX
Open Textbook Summit - BCcampus
PDF
#lak2013, Leuven, DC slides, #learninganalytics
PDF
Are They Learning? Building a longitudinal model of information literacy asse...
PPT
RecSysTEL2012 slides
PPTX
RUSA MERS forum midwinter 2015
ICKM 2015 - Analysing & Predicting Recurrent Interaction in MOOCs forums
PhDchat: brief summary of my thesis and thoughts about my PhD journey
Wendi Chen
Open Textbook Summit - BCcampus
#lak2013, Leuven, DC slides, #learninganalytics
Are They Learning? Building a longitudinal model of information literacy asse...
RecSysTEL2012 slides
RUSA MERS forum midwinter 2015

What's hot (19)

PPTX
Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
PPTX
Conole tel methodologies
PPTX
Is what's 'trending' what¹s worth purchasing?
PPT
Global Futures Intelligence System talk at WFSF 2013
PPTX
Are we there yet? Peter Hickey
PPTX
Using Social Network Analysis to Assess Organizational Development Initiatives
PPTX
NISO/BISG 7th Annual Changing Standards Landscape Forum: ALA Chicago User Pra...
PPTX
Learning Analytics: New thinking supporting educational research
PPTX
Library Instruction that Improves Self-Efficacy & Academic Achievement
PPT
Learning Analytics - An Overview of a Research Community
DOCX
Empirical Investigations that Supported the Development of OpenEssayist: A To...
PPT
What's the Point of New Media?
PPT
Comtella: Adaptive Rewards Mechanism to Incentivize Participation in Online C...
PPTX
Sherif presentation richard nurse new template
PPTX
Teaching Information Literacy: A Performance Based Cycle
PPT
Sandy Presentation Student Achievement
PPTX
Evaluate! Evaluation of school libraries
DOC
Resume hasan
PDF
Does it matter how much open? Impact in learning and degrees of openness
Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
Conole tel methodologies
Is what's 'trending' what¹s worth purchasing?
Global Futures Intelligence System talk at WFSF 2013
Are we there yet? Peter Hickey
Using Social Network Analysis to Assess Organizational Development Initiatives
NISO/BISG 7th Annual Changing Standards Landscape Forum: ALA Chicago User Pra...
Learning Analytics: New thinking supporting educational research
Library Instruction that Improves Self-Efficacy & Academic Achievement
Learning Analytics - An Overview of a Research Community
Empirical Investigations that Supported the Development of OpenEssayist: A To...
What's the Point of New Media?
Comtella: Adaptive Rewards Mechanism to Incentivize Participation in Online C...
Sherif presentation richard nurse new template
Teaching Information Literacy: A Performance Based Cycle
Sandy Presentation Student Achievement
Evaluate! Evaluation of school libraries
Resume hasan
Does it matter how much open? Impact in learning and degrees of openness
Ad

Similar to Assessing critical thinking in moo cs preliminary proposal 201309 (20)

PDF
Elizabeth Koh - WESST - Leveraging Learning Analytics to Formatively Assess T...
PPTX
Anatomy of a ph d terry final
PPTX
Icmet 21 bali 3 generations & covid
PDF
Rebecca eynon learning & interaction in moo cs
PPTX
A MOOL in a MOOC: Librarians in massive open online courses
PPTX
Exploring learners’ motivations on Assessment in a Massive Open Online Course...
PPTX
Integrating MOOCs into University Modules
PPTX
Integrating MOOCs into University Modules
PPTX
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
PPTX
MOOCs for professional development TCEA Feb 2015
PPTX
MOOCs for professional development TCEA Feb 2015
PPTX
Integrating moocs into modules ICEM17 Naples
PPTX
Moo cs for professional development tcea feb 2015
PPT
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
PDF
The User Side of Personalization: How Personalization Affects the Users
PPTX
Requirements for Learning Analytics
PPTX
A Social Learning Space Grid for MOOCs, EMOOCs2017
PPTX
Websci 2018
PDF
2014 04 03 (educon2014) emadrid uam towards a collaborative pedagogical model...
Elizabeth Koh - WESST - Leveraging Learning Analytics to Formatively Assess T...
Anatomy of a ph d terry final
Icmet 21 bali 3 generations & covid
Rebecca eynon learning & interaction in moo cs
A MOOL in a MOOC: Librarians in massive open online courses
Exploring learners’ motivations on Assessment in a Massive Open Online Course...
Integrating MOOCs into University Modules
Integrating MOOCs into University Modules
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
MOOCs for professional development TCEA Feb 2015
MOOCs for professional development TCEA Feb 2015
Integrating moocs into modules ICEM17 Naples
Moo cs for professional development tcea feb 2015
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
The User Side of Personalization: How Personalization Affects the Users
Requirements for Learning Analytics
A Social Learning Space Grid for MOOCs, EMOOCs2017
Websci 2018
2014 04 03 (educon2014) emadrid uam towards a collaborative pedagogical model...
Ad

More from Su-Tuan Lulee (19)

PPT
淺談網路多媒體在教學上的應用
DOC
淺談網路多媒體在教學上的應用
PDF
Reflection on EDDE 804
PDF
Open Learning and Costs of Education
PPTX
Open Learning: Lowering the Cost of Education
PDF
Transformational Leadership: Leadership for Education
PDF
Teaching for Understanding Framework in Practice
PDF
What History Teaches About the Impact of Educational Research on Practice? A ...
PDF
Meta-Analysis of Interaction in Distance Education
DOC
Did we become a community - A Literature Review
PPT
Basic principles of interaction for learning in web based environment
PPT
Complexity leadership in open learning
PPT
Teaching for Understanding in Practice
PPTX
Introduction to Transformative Learning
POTX
如何利用社會軟體進行遠距教學和學習
PPT
腳本軸線流程圖
PPT
Online Auditing Course Redesign Susan Lulee Slideshare
DOC
Assessing Teaching Presence In Instructional Cmc Susan Lulee
PPT
Assessing Teaching Presence In Instructional Cmc
淺談網路多媒體在教學上的應用
淺談網路多媒體在教學上的應用
Reflection on EDDE 804
Open Learning and Costs of Education
Open Learning: Lowering the Cost of Education
Transformational Leadership: Leadership for Education
Teaching for Understanding Framework in Practice
What History Teaches About the Impact of Educational Research on Practice? A ...
Meta-Analysis of Interaction in Distance Education
Did we become a community - A Literature Review
Basic principles of interaction for learning in web based environment
Complexity leadership in open learning
Teaching for Understanding in Practice
Introduction to Transformative Learning
如何利用社會軟體進行遠距教學和學習
腳本軸線流程圖
Online Auditing Course Redesign Susan Lulee Slideshare
Assessing Teaching Presence In Instructional Cmc Susan Lulee
Assessing Teaching Presence In Instructional Cmc

Recently uploaded (20)

PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
SOIL: Factor, Horizon, Process, Classification, Degradation, Conservation
PDF
RMMM.pdf make it easy to upload and study
PDF
Indian roads congress 037 - 2012 Flexible pavement
PDF
IGGE1 Understanding the Self1234567891011
PDF
Empowerment Technology for Senior High School Guide
PPTX
Orientation - ARALprogram of Deped to the Parents.pptx
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
Trump Administration's workforce development strategy
PDF
Supply Chain Operations Speaking Notes -ICLT Program
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
Introduction to Building Materials
PDF
Computing-Curriculum for Schools in Ghana
PDF
advance database management system book.pdf
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
Final Presentation General Medicine 03-08-2024.pptx
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
LDMMIA Reiki Yoga Finals Review Spring Summer
SOIL: Factor, Horizon, Process, Classification, Degradation, Conservation
RMMM.pdf make it easy to upload and study
Indian roads congress 037 - 2012 Flexible pavement
IGGE1 Understanding the Self1234567891011
Empowerment Technology for Senior High School Guide
Orientation - ARALprogram of Deped to the Parents.pptx
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
A powerpoint presentation on the Revised K-10 Science Shaping Paper
Trump Administration's workforce development strategy
Supply Chain Operations Speaking Notes -ICLT Program
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Introduction to Building Materials
Computing-Curriculum for Schools in Ghana
advance database management system book.pdf

Assessing critical thinking in moo cs preliminary proposal 201309

  • 1. Su-Tuan Lulee September 1st, 2013 Assessing Critical Thinking in Massive Open Online Courses(MOOCs): The Relationship Between Content Analysis & Social Network Analysis
  • 2. • MOOC is an emerging form of education and has been placed in wide context of open education recently. However, the nature of emergent, fragmented, diffuse, and diverse nature of MOOCs make educators question about “To what extent students of MOOCs have demonstrated critical thinking skills?” • How can content analysis and social network help with answering the question? Do the results of these two methods highly related to each other? Problem
  • 3. • Setting: Adult open online learning Context
  • 4. • To investigate whether or not the analysis results from two research methods – content analysis and social analysis highly related to each other. Purpose
  • 5. • Critical thinking is important for knowledge construction in education. • The interaction in group discussions is the visual evidence of critical thinking. More interaction leads to higher levels of knowledge construction. • Content analysis and social network analysis are both effective tools for investigating student critical thinking. Levels of critical thinking in MOOCs should highly relate to the centrality measures of social networks. Assumption
  • 6. • Research tools: content analysis (Atlas.ti), social network analysis (NodeX/SNAPP), and Spearman’s correlations. • Samples: – participants > 300 per MOOC – main discussions took place in an LMS (Canvas) • Procedure: collect discussion data → Excel → Content analysis/SNA → Correlation analysis Methodology
  • 7. • To what extent students of MOOCs have demonstrated critical thinking skills? • How can content analysis and social network help with answering the question? • Do the results of these two methods highly related to each other? Research Questions
  • 8. • MOOC have been adopted widely in higher education however academic research on MOOCs is limited currently. • Due to the massive learners of MOOCs, the educators will rely heavily on learning analysis technique to support their decisions on next-step instructional intervention, and the curriculum design in the near future. It is necessary to validate the various existing measurements. Significance of the Study
  • 9. • Generalizability: – Focus on discussions on LMS only – convenience sampling – small sample size (only 2-3 MOOCs will be analyzed) Limitation