SlideShare a Scribd company logo
Learner Dashboards to
Inform Instructional
Approaches
Peter Shea
Director, Office of Professional Development
Middlesex Community College (Massachusetts)
Bedford, MA
Objectives
• Describe what learner dashboards are & how they may impact educational
practice
• Identify ways in which colleges and universities can successfully engage
faculty and staff to consider the value of analytics related to their roles
• Discuss how to achieve institutional “buy-in”
• Explore the ways simulations and edugames can be used to gather critical
student performance data to inform instructional approaches and to
accurately measure learning outcomes
Learner Dashboards to Inform Instructional Approaches
Learner Dashboards to Inform Instructional Approaches
Sampling of Questions Posted
1. “What are they?”
2. “What tools are out there that would easily integrate with an LMS such
as Canvas? What research has been done on the effectiveness of such
tools?”
3. “What questions does a learner dashboard address? What does it not
answer so well?”
4. “I'm most interested in how to get started. How do you pull the data
together, where, and from what systems? What tools do you use to
create the dashboard? Etc.”
5. “How they could be used in an art context (we're a school of art and
design)?”
Definition "[Learner] Dashboards typically capture
and visualize traces of learning activities,
in order to promote awareness, reflection,
and sense-making, and to enable learners
to define goals and track progress toward
these goals." (Verbert, et al 2013).
Let’s Start with the Basics…….
Sample Course Shell (Blackboard LMS)
Basic Dashboards (Blackboard LMS)
Basic Dashboards (Blackboard LMS)
Basic Dashboards (Canvas LMS)
Advanced Dashboards (Blackboard Analytics)
What is the Need for Learner Dashboards?
“Although estimates vary, teachers likely make as many as 800-1,000
decisions a day (Good & Brophy, 2008).”
Dr. Kristen DiCerbo
Principal Research Scientist at Pearson
Dashboards for Everyone?
Why are Some Useful Practices Quickly
Adopted and Others Slowly?
Gawande, A. (2013, July 19). Sharing Slow Ideas. Retrieved January 21, 2016, from
http://www.newyorker.com/magazine/2013/07/29/slow-ideas
Discussion Activity (15 minutes)
Please respond to at least two of the following questions:
- Can you estimate how many of your faculty use LMS technology on a
regular basis?
- Do any of your faculty or staff make use of Student Performance Data
Tools?
- What issues do you perceive your institution would encounter if it
tried to promote the use of learning dashboards among faculty?
Potential Obstacles
•The “Two C’s”
•Cost
•Culture
What are Some Means of Obtaining Institutional Buy-In?
• Emphasize that there are already tools available in the existing LMS that can promote analytics
thinking among faculty
• Indicate that available data in dashboards can assist in the decision-making process for instructor
• Identify dashboard tools for student use that promotes a sense of agency among students (ex:
helps them plan their curriculum, allows them to identify their overall academic strengths/areas
in need of improvement)
• Promote discussion between advising and faculty on the subject of how these new tools impact
their work
• Align this technology with larger institutional goals (more accurate measurement of student
learning outcomes)
The Next Stage? Learning Dashboards for
Simulations and Edugames
Learner Dashboard: Agent Surefire (Cybersecurity Training)
Sample Edugame Learning Dashboard (Toolwire)
Sample Edugame Learning Dashboard (Toolwire)
What Learner Performance Information Can from
Be Obtained from a Simulation or Edugame?
• Provide instant feedback on the user’s performance during the training (as
opposed to failing a test after the fact)
• Determine weak areas in the user’s skill set, directly impacting his/her job
performance. From a higher education point of view, it means we can tell how
well a student can perform the task, pinpointing to knowledge deficits and/or
necessary corrective actions.
• Identify “Expert Blind Spots” where a majority of the students perform poorly
due to an unclear delivery of the training content. In other words, as developers
of training products we can identify problems with the course itself.
[Source: Bora Aytun, MAVI Interactive]
Recommended Article on Learner Dashboards
Verbert, Govaerts, et al. (2014) “Learning dashboards: an overview
and future research opportunities.” Personal and Ubiquitous
Computing. Volume 18, Issue 6, pp 1499-1514.
Questions?
Special Thanks
• Dr. Jim Mabry, President, Middlesex Community College
(Massachusetts)
• Nancy Curll, Manager of E-Learning, Middlesex Community College
• Bora Aytun, CEO, MAVI Interactive
• Anthony Jovanis, Customer Success Advocate, Blackboard Inc.

More Related Content

PPTX
Forward thinking feedback at UEA
PPT
e-Learning and e-assessment examples
PPTX
Open Education 2011: A case study in OER within the LMS
PPT
M. Brown-edtech 541 Instructional software presentation
PPTX
Open Education 2011: Openness and Learning Analytics
PPTX
LRT Talks 20120907 MMU Business + Law L+T day
PPT
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
PDF
e-assessment
Forward thinking feedback at UEA
e-Learning and e-assessment examples
Open Education 2011: A case study in OER within the LMS
M. Brown-edtech 541 Instructional software presentation
Open Education 2011: Openness and Learning Analytics
LRT Talks 20120907 MMU Business + Law L+T day
RIDE 2010 presentation - Using interactive computer-based assessment to suppo...
e-assessment

What's hot (20)

PPT
E Assessment Presentation Ver2 June 2008
PPTX
Integrating Problem Solving And Educational Software
PPT
Assessment
PDF
Experiential Ed ITEC
PPTX
Introduction to Learning Analytics in Blackboard
PPT
香港六合彩
PPT
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
PPTX
Assessment Trough Technology in Education
PPT
Chapter02 Presentation
PPTX
Instructional software presentation
PDF
Harnessing Web 2.0 Technologies for Department Chairs Academic Chairpersons C...
PPT
Oco usability
PPTX
Machine Learning Applications in E-learning - Bias, Risks, and Mitigations
PPTX
Instructional software presentation ronen cohen
PPTX
Instructional software
PPTX
Software Evaluation Assignment
PPTX
Challenges and Opportunities for Promoting Success among the Successful using...
PDF
When Response Rate Matters
PDF
Materials Generators Hand-outs
PPT
Curriculum and instruction explored
E Assessment Presentation Ver2 June 2008
Integrating Problem Solving And Educational Software
Assessment
Experiential Ed ITEC
Introduction to Learning Analytics in Blackboard
香港六合彩
Technology Integration for Meaning Classroom Use: Chapter 7 - Assessment and ...
Assessment Trough Technology in Education
Chapter02 Presentation
Instructional software presentation
Harnessing Web 2.0 Technologies for Department Chairs Academic Chairpersons C...
Oco usability
Machine Learning Applications in E-learning - Bias, Risks, and Mitigations
Instructional software presentation ronen cohen
Instructional software
Software Evaluation Assignment
Challenges and Opportunities for Promoting Success among the Successful using...
When Response Rate Matters
Materials Generators Hand-outs
Curriculum and instruction explored
Ad

Similar to Learner Dashboards to Inform Instructional Approaches (20)

PPTX
Educational Data Mining/Learning Analytics issue brief overview
PPTX
Keele Digital Festival - Microsoft Teams for Learning and Teaching - Keynote
PPTX
Online teaching and learning resource guide
PPTX
Assessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
PPTX
Learning and Educational Analytics
PPTX
Using learning analytics to improve student transition into and support throu...
PPTX
Collaborative learning presentation
PPSX
Innovation presentation
PDF
Instructional Design in Higher Education. A report on the role, workflow, and...
PPTX
Unleashing Analytics in the Classroom
PDF
Big Data and Student Retention
PDF
Where Cognitive Science, Interaction Design and Data Dwells: The Competencies...
PPTX
21th-Century-Teaching-and-Learning.pptx,
PPTX
21th-Century-Teaching-and-Learning.pptx,
PPTX
Unit 6 presentation
PDF
Point of View on Integrated Learning Ver 1
PPTX
How to Use Learning Analytics in Moodle
PDF
A7 UsryR
PPT
Assessment For Learning
PPTX
Learning Analytics
Educational Data Mining/Learning Analytics issue brief overview
Keele Digital Festival - Microsoft Teams for Learning and Teaching - Keynote
Online teaching and learning resource guide
Assessment Analytics - EUNIS 2015 E-Learning Task Force Workshop
Learning and Educational Analytics
Using learning analytics to improve student transition into and support throu...
Collaborative learning presentation
Innovation presentation
Instructional Design in Higher Education. A report on the role, workflow, and...
Unleashing Analytics in the Classroom
Big Data and Student Retention
Where Cognitive Science, Interaction Design and Data Dwells: The Competencies...
21th-Century-Teaching-and-Learning.pptx,
21th-Century-Teaching-and-Learning.pptx,
Unit 6 presentation
Point of View on Integrated Learning Ver 1
How to Use Learning Analytics in Moodle
A7 UsryR
Assessment For Learning
Learning Analytics
Ad

More from Middlesex Community College (Massachusetts) (6)

PPTX
OER and Free Interactive Learning Tools
PDF
Changing the Culture: Using Professional Development to Promote Inclusion and...
PDF
Serious Games/Simulations: Potential Impact on Assessment and Instructional D...
PDF
iOER: Interactive Open Educational Resources
PDF
Getting Your Game -I Mean Sim--into Higher Education
PDF
Diy Tools: What We Are Using in Higher Education
OER and Free Interactive Learning Tools
Changing the Culture: Using Professional Development to Promote Inclusion and...
Serious Games/Simulations: Potential Impact on Assessment and Instructional D...
iOER: Interactive Open Educational Resources
Getting Your Game -I Mean Sim--into Higher Education
Diy Tools: What We Are Using in Higher Education

Recently uploaded (20)

PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPTX
Cell Types and Its function , kingdom of life
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
RMMM.pdf make it easy to upload and study
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
TR - Agricultural Crops Production NC III.pdf
PDF
Basic Mud Logging Guide for educational purpose
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
Pharma ospi slides which help in ospi learning
PPTX
GDM (1) (1).pptx small presentation for students
PDF
Sports Quiz easy sports quiz sports quiz
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
01-Introduction-to-Information-Management.pdf
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PPTX
Microbial diseases, their pathogenesis and prophylaxis
O7-L3 Supply Chain Operations - ICLT Program
2.FourierTransform-ShortQuestionswithAnswers.pdf
Cell Types and Its function , kingdom of life
Module 4: Burden of Disease Tutorial Slides S2 2025
Final Presentation General Medicine 03-08-2024.pptx
RMMM.pdf make it easy to upload and study
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
TR - Agricultural Crops Production NC III.pdf
Basic Mud Logging Guide for educational purpose
STATICS OF THE RIGID BODIES Hibbelers.pdf
Pharma ospi slides which help in ospi learning
GDM (1) (1).pptx small presentation for students
Sports Quiz easy sports quiz sports quiz
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Anesthesia in Laparoscopic Surgery in India
01-Introduction-to-Information-Management.pdf
Renaissance Architecture: A Journey from Faith to Humanism
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
human mycosis Human fungal infections are called human mycosis..pptx
Microbial diseases, their pathogenesis and prophylaxis

Learner Dashboards to Inform Instructional Approaches

  • 1. Learner Dashboards to Inform Instructional Approaches Peter Shea Director, Office of Professional Development Middlesex Community College (Massachusetts) Bedford, MA
  • 2. Objectives • Describe what learner dashboards are & how they may impact educational practice • Identify ways in which colleges and universities can successfully engage faculty and staff to consider the value of analytics related to their roles • Discuss how to achieve institutional “buy-in” • Explore the ways simulations and edugames can be used to gather critical student performance data to inform instructional approaches and to accurately measure learning outcomes
  • 5. Sampling of Questions Posted 1. “What are they?” 2. “What tools are out there that would easily integrate with an LMS such as Canvas? What research has been done on the effectiveness of such tools?” 3. “What questions does a learner dashboard address? What does it not answer so well?” 4. “I'm most interested in how to get started. How do you pull the data together, where, and from what systems? What tools do you use to create the dashboard? Etc.” 5. “How they could be used in an art context (we're a school of art and design)?”
  • 6. Definition "[Learner] Dashboards typically capture and visualize traces of learning activities, in order to promote awareness, reflection, and sense-making, and to enable learners to define goals and track progress toward these goals." (Verbert, et al 2013).
  • 7. Let’s Start with the Basics…….
  • 8. Sample Course Shell (Blackboard LMS)
  • 13. What is the Need for Learner Dashboards? “Although estimates vary, teachers likely make as many as 800-1,000 decisions a day (Good & Brophy, 2008).” Dr. Kristen DiCerbo Principal Research Scientist at Pearson
  • 15. Why are Some Useful Practices Quickly Adopted and Others Slowly? Gawande, A. (2013, July 19). Sharing Slow Ideas. Retrieved January 21, 2016, from http://www.newyorker.com/magazine/2013/07/29/slow-ideas
  • 16. Discussion Activity (15 minutes) Please respond to at least two of the following questions: - Can you estimate how many of your faculty use LMS technology on a regular basis? - Do any of your faculty or staff make use of Student Performance Data Tools? - What issues do you perceive your institution would encounter if it tried to promote the use of learning dashboards among faculty?
  • 17. Potential Obstacles •The “Two C’s” •Cost •Culture
  • 18. What are Some Means of Obtaining Institutional Buy-In? • Emphasize that there are already tools available in the existing LMS that can promote analytics thinking among faculty • Indicate that available data in dashboards can assist in the decision-making process for instructor • Identify dashboard tools for student use that promotes a sense of agency among students (ex: helps them plan their curriculum, allows them to identify their overall academic strengths/areas in need of improvement) • Promote discussion between advising and faculty on the subject of how these new tools impact their work • Align this technology with larger institutional goals (more accurate measurement of student learning outcomes)
  • 19. The Next Stage? Learning Dashboards for Simulations and Edugames
  • 20. Learner Dashboard: Agent Surefire (Cybersecurity Training)
  • 21. Sample Edugame Learning Dashboard (Toolwire)
  • 22. Sample Edugame Learning Dashboard (Toolwire)
  • 23. What Learner Performance Information Can from Be Obtained from a Simulation or Edugame? • Provide instant feedback on the user’s performance during the training (as opposed to failing a test after the fact) • Determine weak areas in the user’s skill set, directly impacting his/her job performance. From a higher education point of view, it means we can tell how well a student can perform the task, pinpointing to knowledge deficits and/or necessary corrective actions. • Identify “Expert Blind Spots” where a majority of the students perform poorly due to an unclear delivery of the training content. In other words, as developers of training products we can identify problems with the course itself. [Source: Bora Aytun, MAVI Interactive]
  • 24. Recommended Article on Learner Dashboards Verbert, Govaerts, et al. (2014) “Learning dashboards: an overview and future research opportunities.” Personal and Ubiquitous Computing. Volume 18, Issue 6, pp 1499-1514.
  • 26. Special Thanks • Dr. Jim Mabry, President, Middlesex Community College (Massachusetts) • Nancy Curll, Manager of E-Learning, Middlesex Community College • Bora Aytun, CEO, MAVI Interactive • Anthony Jovanis, Customer Success Advocate, Blackboard Inc.