SlideShare a Scribd company logo
Learning analytics
are more than measurement
Dragan Gašević
@dgasevic
April 15, 2015
Policies for Educational Data Mining and
Learning Analytics Briefing
Brussels, Belgium
Growing demand for
education!
Feedback loops between
students and instructors
are missing!
Learning
environment
Educators
Learners
Student
Information
Systems
Blogs
Videos/slides
Mobile
Search
Educators
Learners
Networks
Student
Information
Systems
Learning
environment
Blogs
Mobile
Search
Networks
Educators
Learners
Student
Information
Systems
Learning
environment
Videos/slides
Learning Analytics – What?
Measurement, collection,
analysis, and reporting of data about
learners and their contexts
Learning Analytics – Why?
Understanding and optimising
learning and the environments
in which learning occurs
CASE STUDIES
Student retention
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
Year 1 Year 2 Year 3 Year 4
Course Signals
No Course Signals
Arnold, K. E., & Pistilli, M. D. (2012, April). Course Signals at Purdue: Using learning analytics to increase student
success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267-270).
Better educational attainment:
– reducing school drop-out rates below 10%
– at least 40% of 30-34–year-olds with third
level education (or equivalent)
http://ec.europa.eu/europe2020/europe-2020-in-a-nutshell/priorities/smart-growth/index_en.htm
Tanes, Z., Arnold, K. E., King, A. S., & Remnet, M. A. (2011). Using Signals for appropriate feedback: Perceptions and
practices. Computers & Education, 57(4), 2414-2422.
Can teaching be improved?
Wright, M. C., McKay, T., Hershock, C., Miller, K., & Tritz, J. (2014). Better Than Expected: Using Learning Analytics to
Promote Student Success in Gateway Science. Change: The Magazine of Higher Learning, 46(1), 28-34.
Wright, M. C., McKay, T., Hershock, C., Miller, K., & Tritz, J. (2014). Better Than Expected: Using Learning Analytics to
Promote Student Success in Gateway Science. Change: The Magazine of Higher Learning, 46(1), 28-34.
Youth on the move:
– equipping young people better for
the job market
– improving all levels of education and training
(academic excellence, equal opportunities)
http://ec.europa.eu/europe2020/europe-2020-in-a-nutshell/priorities/smart-growth/index_en.htm
Learning analytics is more
than measurement
CHALLENGES
Very few institution-wide
examples of adoption
Sophistication model
Siemens, G., Dawson, S., & Lynch, G. (2014). Improving the Quality and Productivity of the Higher Education Sector -
Policy and Strategy for Systems-Level Deployment of Learning Analytics. Canberra, Australia: Office of Learning and
Teaching, Australian Government. Retrieved from http://solaresearch.org/Policy_Strategy_Analytics.pdf
Sophistication model
Siemens, G., Dawson, S., & Lynch, G. (2014). Improving the Quality and Productivity of the Higher Education Sector -
Policy and Strategy for Systems-Level Deployment of Learning Analytics. Canberra, Australia: Office of Learning and
Teaching, Australian Government. Retrieved from http://solaresearch.org/Policy_Strategy_Analytics.pdf
~70% institutions in phase 1
305 institutions, 58% at stage 1, 20% at stage 2
Yanosky, R. (2009). Institutional data management in higher education. ECAR, EDUCAUSE Center for Applied
Research.
Goldstein, P. J., & Katz, R. N. (2005). Academic analytics: The uses of management information and technology in
higher education (Vol. 8). Educause.
Interest in analytics is high, but
many institutions had yet to make progress
beyond basic reporting
Bichsel, J. (2012). Analytics in higher education: Benefits, barriers, progress, and recommendations. EDUCAUSE
Center for Applied Research.
What’s necessary to
move forward?
DIRECTIONS
Data – Model – Transform
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Data – Model – Transform
Creative data sourcing
Necessary IT support
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Data – Model – Transform
Question-driven, not data-driven
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
Learning analytics are more than measurement
Once size fits all does not work
in learning analytics
Data – Model – Transform
Participatory design of analytics tools
Analytics tools for non-statistics experts
Develop capabilities to exploit (big) data
Barton, D., & Court, D. (Oct 2012). Making Advanced Analytics Work for You. Harvard Business Review, 79-83,
https://hbr.org/2012/10/making-advanced-analytics-work-for-you/ar/1
What’s our reality?
Current state
Benchmarking learning analytics status, policy and
practices for Australian universities
Senior management perspective
Senior management perspective
Solution-driven approach
Bought an analytics product.
Analytics box ticked!
Lack of data-informed
decision making culture
Manyika, J., et al. (2011). Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey
Global Institute, http://goo.gl/Lue3qs
Researchers not focused on
scalability
FINAL REMARKS
Embracing complexity of
educational systems
Macfadyen, L. P., Dawson, S., Pardo, A., & Gasevic, D. (2014). Embracing big data in complex educational systems:
The learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9(2), 17-28.
Rapid Outcome Mapping Approach
(ROMA)
Multidisciplinary teams in
institutions critical
Learning from
the successful examples
An institutional learning analytics vision
Tynan, B. & Buckingham Shum, S. (2013). Designing Systemic Learning Analytics at the Open University. SoLAR
Open Symposium – Strategy & Policy for Systemic Learning Analytics.
http://people.kmi.open.ac.uk/sbs/2013/10/designing-systemic-analytics-at-the-open-university
http://evidence.laceproject.eu/
Complement national plans in
relation to big data and
identify specific requirements of
the education section
Cross-institutional/national
data sharing and collaboration
Esp. relevant for student mobility
Ethical and privacy consideration
http://www.open.ac.uk/students/charter/essential-documents/ethical-use-student-data-learning-analytics-policy
Sclater, N. (2014). Code of practice for learning analytics: A literature review of the ethical and legal issues.
http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf
Development of
analytics culture
Manyika, J. et al. (2011). Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey
Global Institute, http://goo.gl/Lue3qs
Learning analytics are more than measurement
Thank you!

More Related Content

PPTX
Learning analytics and MOOCs: What have we learned so far and where to go?
PPTX
Learning analytics are about learning
PPTX
Social network analysis and learning design
PPTX
Learning analytics are more than a technology
PPTX
Learning with me Mate: Analytics of Social Networks in Higher Education
PPTX
Wearable technologies should promote adaptive learners
PPTX
Technologies to support self-directed learning through social interaction
PPTX
LACE Spring Briefing - Learning analytics are more than measurement
Learning analytics and MOOCs: What have we learned so far and where to go?
Learning analytics are about learning
Social network analysis and learning design
Learning analytics are more than a technology
Learning with me Mate: Analytics of Social Networks in Higher Education
Wearable technologies should promote adaptive learners
Technologies to support self-directed learning through social interaction
LACE Spring Briefing - Learning analytics are more than measurement

What's hot (20)

PDF
Towards Strengthening Links between Learning Analytics and Assessment
PPTX
Learning analytics: An opportunity for higher education?
PDF
Can learning analytics offer meaningful assessment?
PDF
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
PDF
Let’s get there! Towards policy for adoption of learning analytics
PDF
Learning Analytics in Medical Education
PDF
edmedia2014-learning-analytics-keynote
PPTX
State and Directions of Learning Analytics Adoption (Second edition)
PPTX
Developing a multiple-document-processing performance assessment for epistem...
PDF
Where is Theory in Learning Analytics
PDF
Learning Analytics Dashboards
PDF
Introduction to Learning Analytics
PDF
Co-developing bespoke, enterprise-scale analytics systems with teaching staff
PPTX
VII Jornadas eMadrid "Education in exponential times". "Supporting higher edu...
PPT
Social learning analytics: LAK 2012
PDF
Exploring the relation between Self-regulation Online Activities, and Academi...
PPTX
OLT conference Learning analytics
PDF
Introduction to Learning Analytics for High School Teachers and Managers
PDF
Data2U: Scalable Real time Student Feedback in Active Learning Environments
PPTX
Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". ¿Cómo llegamos al...
Towards Strengthening Links between Learning Analytics and Assessment
Learning analytics: An opportunity for higher education?
Can learning analytics offer meaningful assessment?
Nurturing the Connections: The Role of Quantitative Ethnography in Learning A...
Let’s get there! Towards policy for adoption of learning analytics
Learning Analytics in Medical Education
edmedia2014-learning-analytics-keynote
State and Directions of Learning Analytics Adoption (Second edition)
Developing a multiple-document-processing performance assessment for epistem...
Where is Theory in Learning Analytics
Learning Analytics Dashboards
Introduction to Learning Analytics
Co-developing bespoke, enterprise-scale analytics systems with teaching staff
VII Jornadas eMadrid "Education in exponential times". "Supporting higher edu...
Social learning analytics: LAK 2012
Exploring the relation between Self-regulation Online Activities, and Academi...
OLT conference Learning analytics
Introduction to Learning Analytics for High School Teachers and Managers
Data2U: Scalable Real time Student Feedback in Active Learning Environments
Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". ¿Cómo llegamos al...
Ad

Viewers also liked (13)

PPTX
Social network analysis and understanding of massive open online courses
PPT
Semantic Technologies in Learning Environments
PPTX
Evidence-based Semantic Web Just a Dream or the Way to Go?
PPTX
SoLAR Activities
PPT
Semantic Technologies in Learning Analytics
PPTX
Introduction into Social Network Analysis
PPTX
Variability and Configurability of Business Processes Why, What, When, and How?
PPT
Modeling Flexible Business Processes with Business Rule Patterns
PPT
Learning Analytics - A New Discipline and Bits of Semantics
PPT
Learning Analytics -Towards a New Discipline-
PDF
Learning Analytics - A New Discipline and Linked Data
PPTX
Tools and Methods to Enhance Information Seeking, Sensemaking and Learning
PPTX
Personal Learning Graph (PLeG)
Social network analysis and understanding of massive open online courses
Semantic Technologies in Learning Environments
Evidence-based Semantic Web Just a Dream or the Way to Go?
SoLAR Activities
Semantic Technologies in Learning Analytics
Introduction into Social Network Analysis
Variability and Configurability of Business Processes Why, What, When, and How?
Modeling Flexible Business Processes with Business Rule Patterns
Learning Analytics - A New Discipline and Bits of Semantics
Learning Analytics -Towards a New Discipline-
Learning Analytics - A New Discipline and Linked Data
Tools and Methods to Enhance Information Seeking, Sensemaking and Learning
Personal Learning Graph (PLeG)
Ad

Similar to Learning analytics are more than measurement (20)

PDF
2015 d. gašević an opportunity for higher education
PPTX
Scaling up learning analytics
PPTX
UCISA Learning Anaytics Pre-Conference Workshop
PPTX
SHEILA workshop at EC-TEL 2018
PPTX
Learning analytics: developing an action plan ... developing a vision
PPTX
Higher Education Teachers' Experiences of Learning Analytics in Relation to S...
PPTX
SHEILA Results – Conference 5 June 2018
PPTX
SAAIR 2014 keynote Sharon Slade
PPTX
ISSOTL Presentation
PPTX
Krakow presentation speak_appsmngm_final
PPTX
Use of data & analytics in the field
PPTX
Australian university teacher’s engagement with learning analytics: Still ea...
PDF
[Extended] Bottom-up growth of learning analytics at two Australian universit...
PPTX
Learning analytics research informed institutional practice
PDF
Learning Analytics
PPTX
Lak2018: Scaling Nationally: Seven Lesson Learned
PDF
Will Learning Analytics Transform Higher Education?
PPTX
Ajman University
PPTX
FACT2 Learning Analytics Task Group Phase 2 report - CIT2014
PPTX
Using learning analytics to improve student transition into and support throu...
2015 d. gašević an opportunity for higher education
Scaling up learning analytics
UCISA Learning Anaytics Pre-Conference Workshop
SHEILA workshop at EC-TEL 2018
Learning analytics: developing an action plan ... developing a vision
Higher Education Teachers' Experiences of Learning Analytics in Relation to S...
SHEILA Results – Conference 5 June 2018
SAAIR 2014 keynote Sharon Slade
ISSOTL Presentation
Krakow presentation speak_appsmngm_final
Use of data & analytics in the field
Australian university teacher’s engagement with learning analytics: Still ea...
[Extended] Bottom-up growth of learning analytics at two Australian universit...
Learning analytics research informed institutional practice
Learning Analytics
Lak2018: Scaling Nationally: Seven Lesson Learned
Will Learning Analytics Transform Higher Education?
Ajman University
FACT2 Learning Analytics Task Group Phase 2 report - CIT2014
Using learning analytics to improve student transition into and support throu...

More from Dragan Gasevic (7)

PPTX
Social network analysis and social presence
PPTX
Social network analysis and creative potential
PPTX
Social network analysis and academic performance
PPTX
Sensemaking of social network analysis for the study of learning
PPTX
Network modularity and community identification
PPTX
Network measures used in social network analysis
PPTX
Network structure and data sources
Social network analysis and social presence
Social network analysis and creative potential
Social network analysis and academic performance
Sensemaking of social network analysis for the study of learning
Network modularity and community identification
Network measures used in social network analysis
Network structure and data sources

Recently uploaded (20)

PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
Complications of Minimal Access Surgery at WLH
PDF
Pre independence Education in Inndia.pdf
PDF
Business Ethics Teaching Materials for college
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Cell Structure & Organelles in detailed.
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PDF
Basic Mud Logging Guide for educational purpose
PDF
Classroom Observation Tools for Teachers
PPTX
Institutional Correction lecture only . . .
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PPTX
PPH.pptx obstetrics and gynecology in nursing
PPTX
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Mark Klimek Lecture Notes_240423 revision books _173037.pdf
O7-L3 Supply Chain Operations - ICLT Program
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Complications of Minimal Access Surgery at WLH
Pre independence Education in Inndia.pdf
Business Ethics Teaching Materials for college
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Final Presentation General Medicine 03-08-2024.pptx
Supply Chain Operations Speaking Notes -ICLT Program
VCE English Exam - Section C Student Revision Booklet
Cell Structure & Organelles in detailed.
2.FourierTransform-ShortQuestionswithAnswers.pdf
O5-L3 Freight Transport Ops (International) V1.pdf
Basic Mud Logging Guide for educational purpose
Classroom Observation Tools for Teachers
Institutional Correction lecture only . . .
Renaissance Architecture: A Journey from Faith to Humanism
PPH.pptx obstetrics and gynecology in nursing
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
Microbial diseases, their pathogenesis and prophylaxis
Mark Klimek Lecture Notes_240423 revision books _173037.pdf

Learning analytics are more than measurement