SlideShare a Scribd company logo
Learning analytics:
answering the FAQs
Rebecca Ferguson
The Open University
SCONUL: June 2014
Take a minute to write down
or tweet the three questions
that would head your list of
FAQs about learning analytics
#sconulfaqs
Who are you?
• The Open University: largest in Europe
• Making use of data for more than 40 years
• Informal learning: iTunes, YouTube…
• MOOCs on FutureLearn and OpenLearn
• Learning analytics research / events
• LACE project
What are analytics?
High-level figures
Brief overview for internal and external reports
Academic analytics
Figures on retention and success, for the institution to
assess performance
Educational data mining
Searching for patterns in the data
Learning analytics
Use of [big] data to provide actionable intelligence for
learners and teachers
Is there a precise definition?
The measurement, collection, analysis and
reporting of data about learners and their
contexts, for purposes of understanding and
optimizing learning and the environments in
which it occurs.
Why do learners use analytics?
• Monitor their own activities and interactions
• Monitor the learning process
• Compare their activity with that of others
• Increase awareness, reflect and self reflect
• Improve discussion participation
• Improve learning behaviour
• Improve performance
• Become better learners
• Learn!
Why might I use analytics?
• Monitor the learning process
• Explore student data
• Identify problems
• Discover patterns
• Find early indicators for success
• Find early indicators for poor marks or drop-out
• Assess usefulness of learning materials
• Increase awareness, reflect and self reflect
• Increase understanding of learning environments
• Intervene, advise and assist
• Improve teaching, resources and the environment
Can you give me an example?
• Aligned with
clear aims
• Huge and
sustained effort
• Agreed proxies
for learning
• Clear and
standardised
visualisation
• Driving
behaviour at
every level
Individual assessment within cohort
Is that an ideal example?
Can we achieve this?
• Aligned with clear aims
• Huge and sustained effort
• Agreed proxies for learning
• Clear and standardised visualisation
• Driving behaviour at every level
Can we avoid this?
• Instructivist approach
• Stressed, unhappy learners
• Analytics with little value for learners or teachers
• Omission of key areas, such as collaboration
Don’t start with the data –
start with the pedagogy
How do people learn?
How can I use data to facilitate that process?
Social learning analytics:
How do people learn socially & in social settings?
How can I use data to facilitate that process?
How could we achieve that?
What questions should I ask?
• Which elements are learners struggling with?
• Which sections engage them the most?
• What prompts them to ask questions?
• How are they navigating resources?
• What misconceptions have they shown?
• Are there any accessibility issues?
How can analytics be used to
achieve desired learning outcomes?
• Demographic data
• Calendar information about assignments
• VLE activity data (including forums).
• Lists of required reading
• Library resources usage data
• Library helpdesk enquiries
• Library website usage and analytics data
• Assessment results
• User survey results
• Student retention and attainment data
What data could I use?
Does HE use learning analytics?
Purdue
University
SNAPP:
British Columbia
Are all analytics like that?
Disparate data
VLE (Moodle) data
Survey data
Help desk data
Library data
Assessment data
Registration data 250,000 students
around the world
Faculty expertise
Learning design
Learning outcomes
Assessment strategy
Module connections
Resource understanding
Data
Wranglers
Do you have an OU example?
Resource page? Sub page? URL?
Significance of dates?
What does a Wrangler do?
Reach agreement on conventions
80% agreed or strongly agreed that….
Is that
80% of registered students?
80% of those who completed the survey?
80% of those who completed both survey and course?
Or is it
80% of survey respondents who completed the
course and did not select ‘not applicable’
What else do Wranglers do?
Relate analytics to learning design
How many forums?
What were their roles?
How were they timetabled?
Anything else?
Support, not surveillance
Reporting at module level, not individual level
Survey responses kept apart from activity data
Making data accessible, not overwhelming
Negotiating meaning, not dictating interpretation
Are there any ethical issues?
Shared knowledge building
Is it all about wrangling?
Shared knowledge building
Does your library use analytics?
What about informal learning?
Social
Network
Status
Domain
Expert
Reputation
Massive
thousands may sign up
Open
no payment is required
Online
resources on the Internet
Courses
time-bounded cohorts
Any links with MOOCs?
(What are MOOCs?)
Introduction to
Forensic Science
University of Strathclyde
You have been actively engaged in
the discussions, which is excellent,
thank you, but with more than
23,000 participants it means that our
responses and comments risk
getting lost.
Analytics could help to filter discussions
How could MOOCs use analytics?
Introduction to
Forensic Science
University of Strathclyde
This will be primary school material
for some of you and exactly the
opposite for others. It is just not
possible to tailor the material to
each of you […]
How could MOOCs use analytics?
Analytics could help to group learners
Analytics could help to focus attention
How could MOOCs use analytics?
Helping to identify useful analytics
What do learners need to know in order to
network, collaborate, browse or reflect?
What do educators need to know to support them?
Helping to identify gaps in the data
Which data do we need to collect?
Helping to identify gaps in our toolkit
Which design elements can we look at easily?
Which ones still pose problems?
Any links with learning design?
Helping to frame and focus analytics questions
What did they learn?… in relation to learning outcomes
Were they social?... when they were collaborating
Did they share links?... when encouraged to browse
Did they return to steps?... when encouraged to reflect
Helping to identify appropriate forms of analysis
The same content, but with a focus on
Number of visits if content
Length, quality, number of comments if conversational
Dwell time and repeat visits if reflection
Any links with learning design?
How are analytics used in libraries?
Mission
To impact student measures of satisfaction
To demonstrate value-added to users
To inform and justify policy
Teaching and learning
To target and assess interventions
To position library teaching effort
To track user journeys
Recommendations
To promote use of content beyond reading list
To link discovery, lists and recommendations
To surface unused content jisclamp.mimas.ac.uk
How are analytics used in libraries?
Collection management
To deliver better / best value for money
To promote evidence-led decision-making
To identify how faculties use the library
Data
To merge data from multiple systems
To incorporate web analytics
To provide compelling visualisations
Service
To correlate feedback, enquiries and collection strength
To understand access patterns
To target skills development jisclamp.mimas.ac.uk
How are you using analytics?
Collection management
Mission
Data
Teaching and learning
Recommendations
Service
jisclamp.mimas.ac.uk
bit.ly/1130R0Y
bit.ly/VUGBfJ
Where can I find out more?
jisclamp.mimas.ac.uk
bit.ly/1qulB06
Learning analytics FAQs

More Related Content

PPTX
Learning analytics, learning design and MOOCs
PPTX
Scaling up learning analytics solutions: Is privacy a show-stopper?
PPTX
LAK15 panel - European Perspectives
PPTX
Learning design and learning analytics
PPT
Teaching in MOOCs: Unbundling the roles of the educator
PPTX
The ethics of MOOC research: why we should involve learners
PPTX
Visions of future learning
PPTX
Scaling up learning analytics
Learning analytics, learning design and MOOCs
Scaling up learning analytics solutions: Is privacy a show-stopper?
LAK15 panel - European Perspectives
Learning design and learning analytics
Teaching in MOOCs: Unbundling the roles of the educator
The ethics of MOOC research: why we should involve learners
Visions of future learning
Scaling up learning analytics

What's hot (20)

PPT
Planning for learning analytics
PPT
LASI workshop social learning analytics
PPT
Rethinking education
PPTX
Learning analytics: the state of the art and the future
PPTX
Learning design and learning analytics
PPTX
Moocs: what the research tells us
PPTX
Intro to learning analytics universities scotland_dec2014_smn
PPTX
On the horizon for learning analytics
PPTX
The future of learning analytics
PPTX
Innovating pedagogy
PPTX
R ferguson lak15
PDF
Learning Analytics
PPTX
Introduction to Learning Analytics - Framework and Implementation Concerns
PPTX
The future of learning analytics: LASI16 Bilbao
PPTX
Equipping the researcher - patterns in the UK and US
PPTX
Supporting Higher Education to Integrate Learning Analytics_EUNIS20171107
PPT
SOLAR - learning analytics, the state of the art
PPTX
Transforming the student experience at Manchester Met
PPTX
Learning Analytics: What is it? Why do it? And how?
PPTX
Bett 2016 - Implementing learning analytics in your school
Planning for learning analytics
LASI workshop social learning analytics
Rethinking education
Learning analytics: the state of the art and the future
Learning design and learning analytics
Moocs: what the research tells us
Intro to learning analytics universities scotland_dec2014_smn
On the horizon for learning analytics
The future of learning analytics
Innovating pedagogy
R ferguson lak15
Learning Analytics
Introduction to Learning Analytics - Framework and Implementation Concerns
The future of learning analytics: LASI16 Bilbao
Equipping the researcher - patterns in the UK and US
Supporting Higher Education to Integrate Learning Analytics_EUNIS20171107
SOLAR - learning analytics, the state of the art
Transforming the student experience at Manchester Met
Learning Analytics: What is it? Why do it? And how?
Bett 2016 - Implementing learning analytics in your school
Ad

Viewers also liked (6)

PPTX
Learning Analytics – Ethical questions and dilemmas
PDF
LACE Flyer 2016
PPTX
Selection of the research problem
PPT
1 - Ratios & Proportions
PPTX
State and Directions of Learning Analytics Adoption (Second edition)
PPTX
Hofstede's cultural dimensions
Learning Analytics – Ethical questions and dilemmas
LACE Flyer 2016
Selection of the research problem
1 - Ratios & Proportions
State and Directions of Learning Analytics Adoption (Second edition)
Hofstede's cultural dimensions
Ad

Similar to Learning analytics FAQs (20)

PPTX
Learning Analytics
PPTX
Learning analytics in a standardisation context
PPTX
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
PPTX
Learning and Educational Analytics
PPTX
Analysing analytics, what is learning analytics?
PPTX
Requirements for Learning Analytics
PDF
Macfadyen usc tlt keynote 2015.pptx
PDF
Learning Analytics
PPTX
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
PPTX
Learning Analytics: New thinking supporting educational research
PDF
ascilite-webinar-oct2012
PPTX
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
PDF
Learning Analytics: Today, Tomorrow, and When We Get Flying Cars #psuweb Conf...
PPTX
Preparing for the future
PPTX
Krakow presentation speak_appsmngm_final
PDF
eli2012-learning-analytics
PPTX
How to Use Learning Analytics in Moodle
PPTX
Using Assessment data
PPTX
2017 12-15-iv jornadas innovación psicología
PDF
Our Learning Analytics are Our Pedagogy
Learning Analytics
Learning analytics in a standardisation context
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
Learning and Educational Analytics
Analysing analytics, what is learning analytics?
Requirements for Learning Analytics
Macfadyen usc tlt keynote 2015.pptx
Learning Analytics
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
Learning Analytics: New thinking supporting educational research
ascilite-webinar-oct2012
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
Learning Analytics: Today, Tomorrow, and When We Get Flying Cars #psuweb Conf...
Preparing for the future
Krakow presentation speak_appsmngm_final
eli2012-learning-analytics
How to Use Learning Analytics in Moodle
Using Assessment data
2017 12-15-iv jornadas innovación psicología
Our Learning Analytics are Our Pedagogy

More from Rebecca Ferguson (20)

PPTX
What's the value of a doctoral consortium
PPTX
Looking to the Future – LASI Europe 2024
PPTX
Podcasts as pedagogy: integrating podcasts in teaching and learning
PPTX
OpenCreate OpenTEL SIG presentation.pptx
PPTX
Responsive sustainable education futures.pptx
PPTX
Learning fun-damentals.pptx
PPTX
Learning analytics - what can we achieve together.pptx
PPTX
2023 Introduction to learning analytics.pptx
PPTX
Innnovations in online teaching and learning: CHatGPT and other artificial as...
PPTX
Edu 4.0: Getting Ready for Industry 4.0.pptx
PPTX
Pedagogies for Today 2022 ICCE Malaysia.pptx
PPTX
2022 AICRIE Rebecca Ferguson.pptx
PPTX
Microcredentials benefits and challenges.pptx
PPTX
Innovating Pedagogy: ICOIE 2022
PPTX
Introduction to learning analytics (T1).pptx
PPTX
Qualitative perspectives on open science
PPTX
Microcredentials at The Open University
PPTX
Teaching and learning futures
PPTX
Accessible learning, accessible analytics
PPTX
'I went to a marvellous party': a manifesto for online meetings
What's the value of a doctoral consortium
Looking to the Future – LASI Europe 2024
Podcasts as pedagogy: integrating podcasts in teaching and learning
OpenCreate OpenTEL SIG presentation.pptx
Responsive sustainable education futures.pptx
Learning fun-damentals.pptx
Learning analytics - what can we achieve together.pptx
2023 Introduction to learning analytics.pptx
Innnovations in online teaching and learning: CHatGPT and other artificial as...
Edu 4.0: Getting Ready for Industry 4.0.pptx
Pedagogies for Today 2022 ICCE Malaysia.pptx
2022 AICRIE Rebecca Ferguson.pptx
Microcredentials benefits and challenges.pptx
Innovating Pedagogy: ICOIE 2022
Introduction to learning analytics (T1).pptx
Qualitative perspectives on open science
Microcredentials at The Open University
Teaching and learning futures
Accessible learning, accessible analytics
'I went to a marvellous party': a manifesto for online meetings

Recently uploaded (20)

PDF
01-Introduction-to-Information-Management.pdf
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Classroom Observation Tools for Teachers
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
Computing-Curriculum for Schools in Ghana
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PPTX
Orientation - ARALprogram of Deped to the Parents.pptx
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
PDF
RMMM.pdf make it easy to upload and study
PDF
Anesthesia in Laparoscopic Surgery in India
01-Introduction-to-Information-Management.pdf
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
LDMMIA Reiki Yoga Finals Review Spring Summer
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Classroom Observation Tools for Teachers
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Computing-Curriculum for Schools in Ghana
Microbial disease of the cardiovascular and lymphatic systems
What if we spent less time fighting change, and more time building what’s rig...
Module 4: Burden of Disease Tutorial Slides S2 2025
Orientation - ARALprogram of Deped to the Parents.pptx
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Practical Manual AGRO-233 Principles and Practices of Natural Farming
Chinmaya Tiranga quiz Grand Finale.pdf
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
RMMM.pdf make it easy to upload and study
Anesthesia in Laparoscopic Surgery in India

Learning analytics FAQs

  • 1. Learning analytics: answering the FAQs Rebecca Ferguson The Open University SCONUL: June 2014
  • 2. Take a minute to write down or tweet the three questions that would head your list of FAQs about learning analytics #sconulfaqs
  • 3. Who are you? • The Open University: largest in Europe • Making use of data for more than 40 years • Informal learning: iTunes, YouTube… • MOOCs on FutureLearn and OpenLearn • Learning analytics research / events • LACE project
  • 4. What are analytics? High-level figures Brief overview for internal and external reports Academic analytics Figures on retention and success, for the institution to assess performance Educational data mining Searching for patterns in the data Learning analytics Use of [big] data to provide actionable intelligence for learners and teachers
  • 5. Is there a precise definition? The measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs.
  • 6. Why do learners use analytics? • Monitor their own activities and interactions • Monitor the learning process • Compare their activity with that of others • Increase awareness, reflect and self reflect • Improve discussion participation • Improve learning behaviour • Improve performance • Become better learners • Learn!
  • 7. Why might I use analytics? • Monitor the learning process • Explore student data • Identify problems • Discover patterns • Find early indicators for success • Find early indicators for poor marks or drop-out • Assess usefulness of learning materials • Increase awareness, reflect and self reflect • Increase understanding of learning environments • Intervene, advise and assist • Improve teaching, resources and the environment
  • 8. Can you give me an example? • Aligned with clear aims • Huge and sustained effort • Agreed proxies for learning • Clear and standardised visualisation • Driving behaviour at every level Individual assessment within cohort
  • 9. Is that an ideal example? Can we achieve this? • Aligned with clear aims • Huge and sustained effort • Agreed proxies for learning • Clear and standardised visualisation • Driving behaviour at every level Can we avoid this? • Instructivist approach • Stressed, unhappy learners • Analytics with little value for learners or teachers • Omission of key areas, such as collaboration
  • 10. Don’t start with the data – start with the pedagogy How do people learn? How can I use data to facilitate that process? Social learning analytics: How do people learn socially & in social settings? How can I use data to facilitate that process? How could we achieve that?
  • 11. What questions should I ask? • Which elements are learners struggling with? • Which sections engage them the most? • What prompts them to ask questions? • How are they navigating resources? • What misconceptions have they shown? • Are there any accessibility issues? How can analytics be used to achieve desired learning outcomes?
  • 12. • Demographic data • Calendar information about assignments • VLE activity data (including forums). • Lists of required reading • Library resources usage data • Library helpdesk enquiries • Library website usage and analytics data • Assessment results • User survey results • Student retention and attainment data What data could I use?
  • 13. Does HE use learning analytics? Purdue University
  • 14. SNAPP: British Columbia Are all analytics like that?
  • 15. Disparate data VLE (Moodle) data Survey data Help desk data Library data Assessment data Registration data 250,000 students around the world Faculty expertise Learning design Learning outcomes Assessment strategy Module connections Resource understanding Data Wranglers Do you have an OU example?
  • 16. Resource page? Sub page? URL? Significance of dates? What does a Wrangler do?
  • 17. Reach agreement on conventions 80% agreed or strongly agreed that…. Is that 80% of registered students? 80% of those who completed the survey? 80% of those who completed both survey and course? Or is it 80% of survey respondents who completed the course and did not select ‘not applicable’ What else do Wranglers do?
  • 18. Relate analytics to learning design How many forums? What were their roles? How were they timetabled? Anything else?
  • 19. Support, not surveillance Reporting at module level, not individual level Survey responses kept apart from activity data Making data accessible, not overwhelming Negotiating meaning, not dictating interpretation Are there any ethical issues?
  • 20. Shared knowledge building Is it all about wrangling?
  • 21. Shared knowledge building Does your library use analytics?
  • 22. What about informal learning?
  • 24. Massive thousands may sign up Open no payment is required Online resources on the Internet Courses time-bounded cohorts Any links with MOOCs? (What are MOOCs?)
  • 25. Introduction to Forensic Science University of Strathclyde You have been actively engaged in the discussions, which is excellent, thank you, but with more than 23,000 participants it means that our responses and comments risk getting lost. Analytics could help to filter discussions How could MOOCs use analytics?
  • 26. Introduction to Forensic Science University of Strathclyde This will be primary school material for some of you and exactly the opposite for others. It is just not possible to tailor the material to each of you […] How could MOOCs use analytics? Analytics could help to group learners
  • 27. Analytics could help to focus attention How could MOOCs use analytics?
  • 28. Helping to identify useful analytics What do learners need to know in order to network, collaborate, browse or reflect? What do educators need to know to support them? Helping to identify gaps in the data Which data do we need to collect? Helping to identify gaps in our toolkit Which design elements can we look at easily? Which ones still pose problems? Any links with learning design?
  • 29. Helping to frame and focus analytics questions What did they learn?… in relation to learning outcomes Were they social?... when they were collaborating Did they share links?... when encouraged to browse Did they return to steps?... when encouraged to reflect Helping to identify appropriate forms of analysis The same content, but with a focus on Number of visits if content Length, quality, number of comments if conversational Dwell time and repeat visits if reflection Any links with learning design?
  • 30. How are analytics used in libraries? Mission To impact student measures of satisfaction To demonstrate value-added to users To inform and justify policy Teaching and learning To target and assess interventions To position library teaching effort To track user journeys Recommendations To promote use of content beyond reading list To link discovery, lists and recommendations To surface unused content jisclamp.mimas.ac.uk
  • 31. How are analytics used in libraries? Collection management To deliver better / best value for money To promote evidence-led decision-making To identify how faculties use the library Data To merge data from multiple systems To incorporate web analytics To provide compelling visualisations Service To correlate feedback, enquiries and collection strength To understand access patterns To target skills development jisclamp.mimas.ac.uk
  • 32. How are you using analytics? Collection management Mission Data Teaching and learning Recommendations Service jisclamp.mimas.ac.uk
  • 33. bit.ly/1130R0Y bit.ly/VUGBfJ Where can I find out more? jisclamp.mimas.ac.uk bit.ly/1qulB06