SlideShare a Scribd company logo
Emerging Learning and Development Models: Part One
In this next series of 10 blog posts we are going to summarize the use of emergent learning concepts that have
been triggered by the field of gamification. Gamification, as the strict use of game mechanics in non-game
environments has given birth to entire new fields of training.
In this series we will take you on a voyage with us as we explore emergent interactions between play and learning
in adults. What is the role of play? What is play? What is eudaimonic content? How can learning be optimized for
distributed systems? How does the user experience affect training? What cost efficiencies exist which limit or
enhance roll out? In brief, we have spent most of this year talking about gamification and its time to take the next
step. The list below includes the blog topics over the next 10 weeks.
We strongly recommend you first read all of our previous blogs to gain a background in ideas we will discuss.
Those of you who have been following us can refer to previous discussions on topics such as intrinstic motivation,
the neuroscience of learning and the design of training games. These posts are for advanced readers who are
looking forward to the future of gamification development as a field. These reflect our priorities at ARC for Game
and Train, and our systems all feature these improvements.
1. Microlearning with Intrinsic Reward Matrices
2. Coupled Completion and Fantasy Learning
3. Simulation-Game Systems
4. Behavioural Currency Systems
5. User Controlled Learning Interfaces
6. Social Network-Based Collaborative Problem Solving
7. Distributed Gameworld Knowledge Structures
8. Extrinsic Reward Behavioural Management and Cognitive Behavioural Representation
9. Intrinsic Reward Identification and Mastery-Based Progression
10. Gated Mobile Training Linked to Game Mechanic Systems
We will begin with the first topic today.
Microlearning with Intrinsic Reward Matrices
Microlearning has been the rage for a couple of years now and consists of presenting a short training video for a
minute and then testing on it. It is used for on-demand learning and is made possible through mobile training. It
can be released on the web or in person, but its true potential lies in its delivery system to meet “on demand”
training needs.
Earlier in our history, we relied on needs assessments in order to refine curriculum and this took a long time.
Frequently that data from focus groups or written evaluation forms was then passed onto a faculty member, who
then might use the data to improve teaching or not. There was significant lag between intake of data and execution
of changes in training content or procedure. Microlearning permitted us to introduce new content through mobile
push notifications but we had no way to figure out what content to push!
Fortunately, advances in two technologies were made in the past year: a) development of analytics derived from
mobile training and b) systems for designing “just-in-time” training. When we paired these developments, we
suddenly had responsive microlearning for the first time. We don’t guess at what people need to learn as they
train, to determine “gaps”; we use real-time data.
The development of real-time data collection came from our work in simulation-gamification of medical care which
we developed with a major teaching hospital. We were able to see, moment to moment, what students were
learning, when they were learning and where the gaps in their ability to use knowledge were. This last feature,
assessing what is called Kirkpatrick 3 level outcomes, showed us how learners used knowledge, not what
knowledge they had. This, in turn, came from my design of a complex game system for health care assessment
in medicine which, after tweaking by clinicians, turned into a mobile decision making system with analytics.
However, we still had a gap in our execution of “burst” learning. We knew what they had to learn but we did not
know how to create new content to fill those deficiencies. This is where the work at the University of Toronto and
The Michener Institute of Health Sciences both entered. They had developed a system for obtaining “just-in-time”
data in medical technology training which we could import into our system for rolling out on-demand content.
Having the analytics is one thing, but knowing how to do something to change them is another. This filled in the
missing gap. Briefly, teams of faculty members reviewed medical technologists performance in simulations, then
collated these data across user populations to determine trends in performance gaps.
The faculty teams reviewed the data quickly and then prioritized changes in training during the simulation epoch.
Simulations were used regularly over a fixed period of time to permit rehearsal of skills and assessment of skill
utilization. In the progression below, T-time of testing through simulation:
Competencies———————>T1———————>T2———————>T3
After assessing T1 performance, a change in training content was then designed rapidly, then inserted prior to T2.
Then data was analyzed post-T2 and a new cycle of responsive content design started. This was implemented at
T3, and outcomes of total training matched against competencies were produced. Their data showed that using
this just-in-time model, training could be modified on the run, on the basis of simulation outcome data. This work
is now entering further distribution and testing over the next year and I am excited to be a part of the ongoing
research.
So far, then, we have combined real time analytics with just-in-time performance measures and content adjustment
to deliver microlearning content. Microlearning using video is still expensive; the production values were very high
for it to be effective, so we focused on simulations using wire-frame branching algorithms. Now we were able to
produce new simulations instead of video content, something which only takes a few days to complete, or even
hours, depending on the gap.
Intrinsic reward matrices are algorithms we designed to award learners by attaching an earning system to the
simulations, so that as they completed simulations successfully they received in-game currency. As they became
faster at solving simulations, they could take on more difficult content which awarded higher in-game rewards. So
we fostered intrinsic motivation by offering a leaderboard so that they could compare their mastery of simulations
with other learners. This compelled players to take on more case studies and permitted us to refine the content as
we went, to improve the outcomes.
The use of the term “matrices” denotes a type of report card if you will, but a more complete picture, showing their
progress over time, number of simulations completed, number of good choices made, ratio of earnings in-game
to efficiency in case solving, confidence in case decisions and other data points. So this matrix compiles data on
the individual learner showing their progress through measuring the game reward system.
We are using the game matrix not just to see “who is best”, but to see how the group, as a whole, is progressing,
and to encourage them to complete more cases. Given that things like diagnosis are so inherently interesting
anyhow, fostering intrinsic drive was relatively easy.
By attaching microlearning/just-in-time methodologies using a game system, we were able to design a responsive
learning system built on activity, rather than passive exercises such as reading. This system is like designing a
microscope to capture every learning activity in the system and break it down into categories to determine how to
produce burst content.
So the first of our systems, Microlearning with Intrinsic Reward Matrices (MIRM) is now something we hope you
can see the value of. This started as a gamified approach to clinical care and expanded beyond a game into a
combined analytic/intervention system for training.
In our next post we examine the next major system we are interested in and designing for: Coupled Completion
and Fantasy Learning. Very large studies of over 250,000 gamers have shown that completion and fantasy
elements are highly motivating for players over the age of 36. These elements are of great interest for female
players as well. Young male players prefer combat systems and destruction! So the majority of our players, if we
have a diverse work force, will thrive on adding elements of completion and fantasy into their training.
This does not necessarily have to be a game…it can be digital storytelling or other narrative expositions, or even
open game worlds such as Second Life adapted for education. It may simply involved social network-based
learning or other methodologies.
Until next week, keep on looking up!

More Related Content

PDF
Level Up Your Talent Development with Gamification [eBook]
PDF
Gamification Design for Training and Talent Development
PPTX
Top 10 Rated Gamification Talk Radio Episodes from 2017
PDF
Game the System A Proven Method to Level Up Your Training with Gamification 4...
PDF
Sentential Gamification LV1 Certification Sample Project Submissions
PDF
Four Types of Gamification for Learning (http://bit.ly/4TypesGami)
PDF
Gamification - Monica Cornetti Training Magazine Conference 2018
PPTX
Level Up Your Talent Development with Gamification [eBook]
Gamification Design for Training and Talent Development
Top 10 Rated Gamification Talk Radio Episodes from 2017
Game the System A Proven Method to Level Up Your Training with Gamification 4...
Sentential Gamification LV1 Certification Sample Project Submissions
Four Types of Gamification for Learning (http://bit.ly/4TypesGami)
Gamification - Monica Cornetti Training Magazine Conference 2018

What's hot (19)

PDF
Using Poll Everywhere to Create an Interactive Story-based Presentation
PPTX
Gamification in Education
PDF
Introduction to Gamification for Education
PPTX
Gamification In Education
PPTX
Gamification / Social Gamification of Education
PDF
Gamification of Learning
PPT
How to get started in gamification in education
PDF
Can Game-Based Learning Improve Learning Impact?
PPT
Carole Bagley - Elements of Effective Instructional Learning Game Design
PDF
Community Online Academy Overview
PPTX
Game based learning gamer's expectation of e learning - Manu Melwin Joy
PDF
Level Up! Games & Gamification for Teaching and Learning
PDF
Andrew Hughes - Gamification vs. Game-Based Learning
PPTX
Culture of Feedback
PDF
Gamification and Immersive Learning
PPTX
Gamification and the Moodle gradebook
PDF
Games, Simulations and Gamification in Learning Design and Delivery
PDF
L&d Summit VI An Coppens - Gamification in HR
PPTX
The Role of Games and Simulations in Learning
Using Poll Everywhere to Create an Interactive Story-based Presentation
Gamification in Education
Introduction to Gamification for Education
Gamification In Education
Gamification / Social Gamification of Education
Gamification of Learning
How to get started in gamification in education
Can Game-Based Learning Improve Learning Impact?
Carole Bagley - Elements of Effective Instructional Learning Game Design
Community Online Academy Overview
Game based learning gamer's expectation of e learning - Manu Melwin Joy
Level Up! Games & Gamification for Teaching and Learning
Andrew Hughes - Gamification vs. Game-Based Learning
Culture of Feedback
Gamification and Immersive Learning
Gamification and the Moodle gradebook
Games, Simulations and Gamification in Learning Design and Delivery
L&d Summit VI An Coppens - Gamification in HR
The Role of Games and Simulations in Learning
Ad

Viewers also liked (20)

PDF
10 Things You Didn’t Know About Mobile Email from Litmus & HubSpot
PDF
HubSpot Diversity Data 2016
PDF
Tall boys and short girls: Pursuit of the American Dream
PPTX
Hessen am is activity 5
PDF
Using the Library: A Cornucopia of Marketing Info by Nathan Rosen in Law Mark...
PDF
Linked Data for Early Mormonism
PPTX
Reversing Google Protobuf protocol
PDF
Creative innovation
PDF
Manual Operativo de Redes Sociales para Destinos Turísticos
PDF
How to register in Imagine Cup Oman 2017?
PDF
Taller de revisión sistemática de literatura
DOC
Steve Rhodes Resume/Bio/Career Interests 2017
PDF
10 Tips for failing at microservices
PPTX
Efectos Metabólicos de la Insulina y el Glucagon
PDF
SLIDES | 12 time-saving tips for research support
PPTX
Gamification 101 session 2
PDF
A Guide to 802.11 WiFi Security by US-CERT
PDF
VIETNAM - TRANSPORTATION AND LOGISTICS – WHAT YOU MUST KNOW:
PDF
Las tres partes
PPTX
intel worldwide
10 Things You Didn’t Know About Mobile Email from Litmus & HubSpot
HubSpot Diversity Data 2016
Tall boys and short girls: Pursuit of the American Dream
Hessen am is activity 5
Using the Library: A Cornucopia of Marketing Info by Nathan Rosen in Law Mark...
Linked Data for Early Mormonism
Reversing Google Protobuf protocol
Creative innovation
Manual Operativo de Redes Sociales para Destinos Turísticos
How to register in Imagine Cup Oman 2017?
Taller de revisión sistemática de literatura
Steve Rhodes Resume/Bio/Career Interests 2017
10 Tips for failing at microservices
Efectos Metabólicos de la Insulina y el Glucagon
SLIDES | 12 time-saving tips for research support
Gamification 101 session 2
A Guide to 802.11 WiFi Security by US-CERT
VIETNAM - TRANSPORTATION AND LOGISTICS – WHAT YOU MUST KNOW:
Las tres partes
intel worldwide
Ad

Similar to Emerging Learning and Development Models: Part One (20)

PDF
Building Learning Games using Rapid Interactivity
PPTX
Serious Games Challenges and Potentials
PDF
Th202 slides
PPTX
Cets 2015 glenn path to mastery serious games
PPTX
August 18, 2015 Presentation
PPTX
Presentation11 091715
PDF
SIEGE Conference - corporate learning games
PDF
eLearning and the Future through Fact or Fishy
PDF
The “Immernet”: Immersive Learning through Games, Gamification and Virtual Wo...
PDF
Game-Based Teaching & Learning for Nursing & Healthcare (NLN/Boise 2014)
PPTX
Abertay4
PPT
Lessons from Harvard: Using Gamification to Juice Your Sales Training by Dr....
PDF
Does Game-Based Learning Work? Results from Three Recent Studies
PPS
Au Psy492 M7 A2 Jones J
PPTX
Game Learning Webinar by Greenbooks & Gamelearn
PPTX
Educational game development in healthcare
PDF
Game-based Learning Webinar by GreenBooks & Gamelearn
PDF
Not WHEN Games but WHICH Learning Games
PPTX
20+ ways to Add Game-like Elements to Your Learning Designs
PPT
Motivation slides from Workshop
Building Learning Games using Rapid Interactivity
Serious Games Challenges and Potentials
Th202 slides
Cets 2015 glenn path to mastery serious games
August 18, 2015 Presentation
Presentation11 091715
SIEGE Conference - corporate learning games
eLearning and the Future through Fact or Fishy
The “Immernet”: Immersive Learning through Games, Gamification and Virtual Wo...
Game-Based Teaching & Learning for Nursing & Healthcare (NLN/Boise 2014)
Abertay4
Lessons from Harvard: Using Gamification to Juice Your Sales Training by Dr....
Does Game-Based Learning Work? Results from Three Recent Studies
Au Psy492 M7 A2 Jones J
Game Learning Webinar by Greenbooks & Gamelearn
Educational game development in healthcare
Game-based Learning Webinar by GreenBooks & Gamelearn
Not WHEN Games but WHICH Learning Games
20+ ways to Add Game-like Elements to Your Learning Designs
Motivation slides from Workshop

Recently uploaded (20)

PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
01-Introduction-to-Information-Management.pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
Insiders guide to clinical Medicine.pdf
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PPTX
PPH.pptx obstetrics and gynecology in nursing
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PDF
Sports Quiz easy sports quiz sports quiz
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PPTX
master seminar digital applications in india
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
01-Introduction-to-Information-Management.pdf
VCE English Exam - Section C Student Revision Booklet
Insiders guide to clinical Medicine.pdf
102 student loan defaulters named and shamed – Is someone you know on the list?
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Renaissance Architecture: A Journey from Faith to Humanism
O5-L3 Freight Transport Ops (International) V1.pdf
PPH.pptx obstetrics and gynecology in nursing
2.FourierTransform-ShortQuestionswithAnswers.pdf
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
Sports Quiz easy sports quiz sports quiz
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Abdominal Access Techniques with Prof. Dr. R K Mishra
master seminar digital applications in india
human mycosis Human fungal infections are called human mycosis..pptx

Emerging Learning and Development Models: Part One

  • 2. In this next series of 10 blog posts we are going to summarize the use of emergent learning concepts that have been triggered by the field of gamification. Gamification, as the strict use of game mechanics in non-game environments has given birth to entire new fields of training. In this series we will take you on a voyage with us as we explore emergent interactions between play and learning in adults. What is the role of play? What is play? What is eudaimonic content? How can learning be optimized for distributed systems? How does the user experience affect training? What cost efficiencies exist which limit or enhance roll out? In brief, we have spent most of this year talking about gamification and its time to take the next step. The list below includes the blog topics over the next 10 weeks.
  • 3. We strongly recommend you first read all of our previous blogs to gain a background in ideas we will discuss. Those of you who have been following us can refer to previous discussions on topics such as intrinstic motivation, the neuroscience of learning and the design of training games. These posts are for advanced readers who are looking forward to the future of gamification development as a field. These reflect our priorities at ARC for Game and Train, and our systems all feature these improvements. 1. Microlearning with Intrinsic Reward Matrices 2. Coupled Completion and Fantasy Learning 3. Simulation-Game Systems 4. Behavioural Currency Systems 5. User Controlled Learning Interfaces 6. Social Network-Based Collaborative Problem Solving 7. Distributed Gameworld Knowledge Structures 8. Extrinsic Reward Behavioural Management and Cognitive Behavioural Representation 9. Intrinsic Reward Identification and Mastery-Based Progression 10. Gated Mobile Training Linked to Game Mechanic Systems We will begin with the first topic today.
  • 4. Microlearning with Intrinsic Reward Matrices Microlearning has been the rage for a couple of years now and consists of presenting a short training video for a minute and then testing on it. It is used for on-demand learning and is made possible through mobile training. It can be released on the web or in person, but its true potential lies in its delivery system to meet “on demand” training needs. Earlier in our history, we relied on needs assessments in order to refine curriculum and this took a long time. Frequently that data from focus groups or written evaluation forms was then passed onto a faculty member, who then might use the data to improve teaching or not. There was significant lag between intake of data and execution of changes in training content or procedure. Microlearning permitted us to introduce new content through mobile push notifications but we had no way to figure out what content to push!
  • 5. Fortunately, advances in two technologies were made in the past year: a) development of analytics derived from mobile training and b) systems for designing “just-in-time” training. When we paired these developments, we suddenly had responsive microlearning for the first time. We don’t guess at what people need to learn as they train, to determine “gaps”; we use real-time data. The development of real-time data collection came from our work in simulation-gamification of medical care which we developed with a major teaching hospital. We were able to see, moment to moment, what students were learning, when they were learning and where the gaps in their ability to use knowledge were. This last feature, assessing what is called Kirkpatrick 3 level outcomes, showed us how learners used knowledge, not what knowledge they had. This, in turn, came from my design of a complex game system for health care assessment in medicine which, after tweaking by clinicians, turned into a mobile decision making system with analytics. However, we still had a gap in our execution of “burst” learning. We knew what they had to learn but we did not know how to create new content to fill those deficiencies. This is where the work at the University of Toronto and The Michener Institute of Health Sciences both entered. They had developed a system for obtaining “just-in-time” data in medical technology training which we could import into our system for rolling out on-demand content. Having the analytics is one thing, but knowing how to do something to change them is another. This filled in the missing gap. Briefly, teams of faculty members reviewed medical technologists performance in simulations, then collated these data across user populations to determine trends in performance gaps.
  • 6. The faculty teams reviewed the data quickly and then prioritized changes in training during the simulation epoch. Simulations were used regularly over a fixed period of time to permit rehearsal of skills and assessment of skill utilization. In the progression below, T-time of testing through simulation: Competencies———————>T1———————>T2———————>T3 After assessing T1 performance, a change in training content was then designed rapidly, then inserted prior to T2. Then data was analyzed post-T2 and a new cycle of responsive content design started. This was implemented at T3, and outcomes of total training matched against competencies were produced. Their data showed that using this just-in-time model, training could be modified on the run, on the basis of simulation outcome data. This work is now entering further distribution and testing over the next year and I am excited to be a part of the ongoing research.
  • 7. So far, then, we have combined real time analytics with just-in-time performance measures and content adjustment to deliver microlearning content. Microlearning using video is still expensive; the production values were very high for it to be effective, so we focused on simulations using wire-frame branching algorithms. Now we were able to produce new simulations instead of video content, something which only takes a few days to complete, or even hours, depending on the gap.
  • 8. Intrinsic reward matrices are algorithms we designed to award learners by attaching an earning system to the simulations, so that as they completed simulations successfully they received in-game currency. As they became faster at solving simulations, they could take on more difficult content which awarded higher in-game rewards. So we fostered intrinsic motivation by offering a leaderboard so that they could compare their mastery of simulations with other learners. This compelled players to take on more case studies and permitted us to refine the content as we went, to improve the outcomes. The use of the term “matrices” denotes a type of report card if you will, but a more complete picture, showing their progress over time, number of simulations completed, number of good choices made, ratio of earnings in-game to efficiency in case solving, confidence in case decisions and other data points. So this matrix compiles data on the individual learner showing their progress through measuring the game reward system.
  • 9. We are using the game matrix not just to see “who is best”, but to see how the group, as a whole, is progressing, and to encourage them to complete more cases. Given that things like diagnosis are so inherently interesting anyhow, fostering intrinsic drive was relatively easy. By attaching microlearning/just-in-time methodologies using a game system, we were able to design a responsive learning system built on activity, rather than passive exercises such as reading. This system is like designing a microscope to capture every learning activity in the system and break it down into categories to determine how to produce burst content.
  • 10. So the first of our systems, Microlearning with Intrinsic Reward Matrices (MIRM) is now something we hope you can see the value of. This started as a gamified approach to clinical care and expanded beyond a game into a combined analytic/intervention system for training.
  • 11. In our next post we examine the next major system we are interested in and designing for: Coupled Completion and Fantasy Learning. Very large studies of over 250,000 gamers have shown that completion and fantasy elements are highly motivating for players over the age of 36. These elements are of great interest for female players as well. Young male players prefer combat systems and destruction! So the majority of our players, if we have a diverse work force, will thrive on adding elements of completion and fantasy into their training. This does not necessarily have to be a game…it can be digital storytelling or other narrative expositions, or even open game worlds such as Second Life adapted for education. It may simply involved social network-based learning or other methodologies. Until next week, keep on looking up!