What if we could observe all events in a learning environment?
3 likes1,755 views
The document discusses the potential of observing all events in a learning environment to enhance analytics and improve educational outcomes. It highlights the importance of measurement for improvement, emphasizes the need for better evaluations, and outlines the steps needed for effective learning analytics. Various references and examples are provided to illustrate how data can be utilized in educational settings.
What if we could observe all events in a learning environment?
- 1. Auntie p flickr.com What if we could observe all events in a learning environment? MUI-TIC, Valladolid, April 2012 Abelardo Pardo www.slideshare.net/abelardo_pardo @abelardopardo
- 2. libraryman flickr.com Journey to 10 years from now Abelardo Pardo What if we could observe all events in a learning environment? 2
- 3. ribarnica flickr.com Analytics today Abelardo Pardo What if we could observe all events in a learning environment? 4
- 4. http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/ Abelardo Pardo What if we could observe all events in a learning environment? 5
- 5. Is she pregnant? Abelardo Pardo What if we could observe all events in a learning environment? 6
- 6. http://hdguru.com/is-your-new-hdtv-watching-you/7643 April 2012 Abelardo Pardo What if we could observe all events in a learning environment? 7
- 7. The Wall Street Journal, Feb. 22nd 2012 Analytics everywhere! Abelardo Pardo What if we could observe all events in a learning environment? 8
- 8. laverrue flickr.com Abelardo Pardo What if we could observe all events in a learning environment? 9
- 9. 10 http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html What if we could observe all events in a learning environment? No (unwanted) surprises! Abelardo Pardo
- 10. Reigh LeBlanc flickr.com Medical records Abelardo Pardo What if we could observe all events in a learning environment? 11
- 11. (Campbell, De Blois, Oblinger 2007) C. Elle flickr.com Refine Collect Act The five steps Report of analytics Predict Abelardo Pardo What if we could observe all events in a learning environment? 12
- 12. ribarnica flickr.com Analytics today Potential in learning Abelardo Pardo What if we could observe all events in a learning environment? 13
- 13. Shaylor flickr.com Did they lea rn? Abelardo Pardo What if we could observe all events in a learning environment? 14
- 14. Joshua Rappeneker flickr.com Abelardo Pardo What if we could observe all events in a learning environment? 15
- 15. Biking Nikon SFO flickr.com If you can not measure it, you can not improve it. Abelardo Pardo What if we could observe all events in a learning environment? 16
- 16. bencrowe flickr.com “We need better evaluation to acknowledge and esteem excellence when it occurs, as it does.” John Hattie. Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. Abelardo Pardo What if we could observe all events in a learning environment? 17
- 17. bodhithaj flickr.com Learning analytics improve the feedback loop Abelardo Pardo What if we could observe all events in a learning environment? 18
- 18. (Jones, 2011) bodhithaj flickr.com Administration Students Teachers Researchers Abelardo Pardo What if we could observe all events in a learning environment? 19
- 19. Marketingfacts flickr.com Where is learning analytics? Abelardo Pardo What if we could observe all events in a learning environment? 20
- 20. PranceyDog flickr.com LA as vertical market Specialized objectives Specialized audiences Specialized topic Abelardo Pardo What if we could observe all events in a learning environment? 21
- 21. Abelardo Pardo What if we could observe all events in a learning environment? 22
- 22. ribarnica flickr.com Analytics today Potential in learning Challenges Abelardo Pardo What if we could observe all events in a learning environment? 23
- 23. ljubar flickr.com More detailed observations Keep the tutor in the loop Abelardo Pardo What if we could observe all events in a learning environment? 24
- 24. Pepe Ortuño flickr.com A clearly identified environment within your computer Abelardo Pardo What if we could observe all events in a learning environment? 25
- 25. Sean Dreilinger flickr.com Automatic discovery of complementary learning resources Abelardo Pardo What if we could observe all events in a learning environment? 26
- 26. IAN RANSLEY DESIGN + ILLUSTRATION flickr.com Measure engagement in out-of-class activities Abelardo Pardo What if we could observe all events in a learning environment? 27
- 27. Just in time teaching Abelardo Pardo What if we could observe all events in a learning environment? 28
- 28. emmma peel flickr.com Abelardo Pardo What if we could observe all events in a learning environment? 29
- 29. jfravel flickr.com Team dynamics Abelardo Pardo What if we could observe all events in a learning environment? 30
- 30. Quick intuitive feedback Abelardo Pardo What if we could observe all events in a learning environment? 31
- 31. Abelardo Pardo What if we could observe all events in a learning environment? 32
- 32. Stakeholders observe, predict and act Abelardo Pardo What if we could observe all events in a learning environment? 33
- 33. Joe Shalobtnik flickr.com How are you? Abelardo Pardo What if we could observe all events in a learning environment? 34
- 34. Mood changes Abelardo Pardo What if we could observe all events in a learning environment? 35
- 35. ::calaveracafé:: flickr.com Abelardo Pardo What if we could observe all events in a learning environment? 36
- 36. purplejavatroll flickr.com Abelardo Pardo What if we could observe all events in a learning environment? 37
- 37. Dru! flickr.com Interventions! Data set Scenario manipulation Abelardo Pardo What if we could observe all events in a learning environment? 38
- 38. net_efekt flickr.com • 15 weeks. Sessions X, F 12-13:30 • 100 students • 7 score tests per student • Course notes with 30 “nodes” published gradually • 5 events: forum_view, forum_post, visit_node, use_tool_1, use_tool_2 Make it your own course! Abelardo Pardo What if we could observe all events in a learning environment? 39
- 39. jovike flickr.com Events (events.csv.gz): around 81,000 x 4 matrix datetime,event_type,user,payload 2011-09-05 15:26:01,use_tool_1,7a869b4d9,block_1 ... Scores (scores.csv.gz): 100 x 7 matrix user,score_1,score_2,score_3,score_4,...,score_7 7a869b4d9, 6.4, 9.0, 7.9, 7.6, 5.1, 5.5, 6.7 ... Abelardo Pardo What if we could observe all events in a learning environment? 40
- 40. Let’s explore! Abelardo Pardo What if we could observe all events in a learning environment? 41
- 41. cesarastudillo flickr.com Analyze, propose, discuss Abelardo Pardo What if we could observe all events in a learning environment? 42
- 42. What did you observe? theunquietlibrarian flickr.com 1 2 Which data is missing? 3 What would you do? 4 What would the system do? Which challenge for LA do you envision? Abelardo Pardo What if we could observe all events in a learning environment? 43
- 43. paral_lax flickr.com script.R 1 Load data into “data frames” 2 Show data summaries 3 Change type of column in data frame 4 View sample histogram 5 Add a column with the mean scores 6 Plot scores for one student 7 Separate events into types 8 Merge event counts with scores Select command + CRTL-Return (Execute) Abelardo Pardo What if we could observe all events in a learning environment? 44
- 44. Calsidyrose flickr.com R cheat sheet • Data frame: heterogeneous matrix, “events.csv” • Data frame column: events.csv$event_type • Arrays: c(’one’, ’two’, ’three’), c(1, 2, 3), c(2:8) • Sequences: 1:5, seq(1, 6) • Graphics: barplot(), boxplot(), hist(), plot() • Functions: length(), rownames(), colnames(), mean() • cor() (correlation), var() (variance) • mean(), median(), min(), max(), sum() Abelardo Pardo What if we could observe all events in a learning environment? 45
- 45. Calsidyrose flickr.com R tests • cor.test(v1, v2) • wilcox.test(v1, v2) • shapiro.test(v1) R help • help(any function name) • Various cheatsheets included in workspace (cheatsheet_*.pdf) Abelardo Pardo What if we could observe all events in a learning environment? 46
- 46. References The personal analytics of my life Stephen Wolfram http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/ How waiters read your table Sara Nassauer The Wall Street Journal, Feb. 22nd 2012 The illusion of privacy (and what we actually care about) Seth Godin http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html Academic Analytics Campbell J., DeBlois P., Oblinger D. EDUCAUSE White paper, 2007 Visible learning: A synthesis of over 800 meta-analyses related to achievement Hattie, J. A. C. Routledge, New York 2009 Learning analytics: Starvation and telling us what we already know? David Jones http://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/ Abelardo Pardo What if we could observe all events in a learning environment? 47