SlideShare a Scribd company logo
M O T I VAT I O N A L A C T I V E
L E A R N I N G ( M A L )
J O H A N N A P I R K E R , M A R I A R I F F N A L L E R - S C H I E F E R , C H R I S T I A N G Ü T L
J P I R K E R @ M I T. E D U
G R A Z U N I V E R S I T Y O F T E C H N O L O G Y
“ I H E A R A N D I F O R G E T.
I S E E A N D I R E M E M B E R .
I D O A N D I U N D E R S TA N D . ”
“Despite great lecturers, attendance at MIT's
freshman physics course dropped to 40% by the
end of the term, with a 10% failure rate.”
H T T P : / / W E B . M I T. E D U / E D T E C H / C A S E S T U D I E S / T E A L . H T M L
http://gallery.carnegiefoundation.org/collections/keep/jbelcher/
T E C H N O L O G Y- E N A B L E D A C T I V E L E A R N I N G
• Collaborative learning (groups from 3-9)
• Desktop experiments linked to laptops
• Media-rich visualisations & simulations
• Personal response systems to stimulate interaction
between instructor and students
“The failure rate, a major trigger for the project,
has decreased substantially while the learning
gains as measured by standard assessment
instruments have almost doubled.”
B E L C H E R , D O R I - H T T P : / / W E B . M I T. E D U / E D T E C H / C A S E S T U D I E S / P D F / T E A L 1 . P D F
Instead of frustrating and stressing students with
failure rates at exams, we want to reward them for
putting extra effort to account for mistakes and not
punish them for failing one single exam.
T H E C O U R S E
• Information Search & Retrieval
• 1/3 Math, 1/3 Programming, 1/3 Theory
• Master Students
• Small classes (limited to 28 students)
O B J E C T I V E S
• Design a course combining (1) theoretical background
& concepts, (2) algorithmic understanding, and (3)
analytical understanding of mathematical models
• Engaging students by interactivities & motivational
activities
• Increase the students’ activities and motivation for
hands-on exercises
C O M B I N E I N T E R A C T I V E
E N G A G E M E N T W I T H G A M I F I C AT I O N
• Collaborative Learning: Small subgroups (2 - 4)
• Constant interactions between instructor & students with concept
questions, small quizzes, and discussion questions
• Immediate feedback on their task performance
• Motivational feedback: Badges for special activities and leaderboard
information
• Errors are allowed: Revision of assignments & quizzes
• Adaptive class design: Learning progress during and after class allows
in-time adaption the individual learning speed of the class.
M O T I VAT I O N A L A C T I V E L E A R N I N G
G R O U P L O C AT I O N
Lecture Block C L A S S
Recap Quiz 1 C L A S S
Concept Questions 1 C L A S S
Concept Quiz 1 C L A S S
Discussion Question 2 C L A S S
Research Question 2 C L A S S
Programming Assignments 2 - 4 C L A S S
Calculation Assignments 2 - 4 C L A S S
Reflection Quiz 1 H O M E
Reflection Forum / Report 4 H O M E
0" 20" 40" 60" 80" 100" 120" 140" 160" 180"
Minutes"
Timline"of"lecture"3"
Lecture" 3.1."Recap"Quiz" 3.2"Concept"Ques?on"
3.3."Short"Calcula?on:"Bayes"Theorem" "3.4."Short"Calcula?on:"Ranking"1" 3.5."Short"Calcula?on:"Ranking"2"
3.6."Discussion:"Steps"of"Ranking" 3.7."Concept"Ques?on"Quiz" "3.11."Discussion:"Quality"of"Retrieval"Models"
3.12."Concept"Ques?on" 3.13."Calcula?on"Retrieval"Performance(Part1/2)" 3.14."Concept"Ques?on"Quiz:"Precision"/"Recall"
3.15."Calcula?on"Retrieval"Performance"(Part"2/2)"
ACM ITICSE 2014 - Talk on Motivational Active Learning
ACM ITICSE 2014 - Talk on Motivational Active Learning
ACM ITICSE 2014 - Talk on Motivational Active Learning
T H E S T U D Y - G O A L S
• Evaluate the students’ understanding of the course
content
• Analyze the students’ engagement and motivation
• Analyze the students’ attitude towards the new model
and the used e-learning environment
T H E S T U D Y - M AT E R I A L S & M E T H O D S
• Qualitative & Quantitative Methods & Field
Observation
• Learning progress: Pre & Post-Quizzes
• Active Participation: Field observation
• Reflection of content types, motivation types (AMS),
rating of gamification aspects)
E X P E R I E N C I N G C O O P E R AT I V E L E A R N I N G
“The group assignments during classes were the best
concept. It was good to use the concept just learned to
remember it better, but also eventual misunderstandings
could be discussed”
Arith.
Mean
Std Dev
I Prefer Activities In Teams. 3.38 1.32
I Prefer Activities In Groups Of 2 Over Activities In Groups Of 4 4.1 1.3
I Would Have Liked More Activities In A Team Of Four Than In
A Team Of Two
2.33 1.62
I Would Have Liked More Single Activities In This Course 2.57 1.29
The Topics Were Easier To Understand In Groups Of 2 3.9 1.48
The Topics Were Easier To Understand In Groups Of 4 2.95 1.28
The Topics Were Easier To Understand Alone 2.29 1.19
I Prefer To Be Graded / Get Points Individually 3.05 1.32
I Prefer To Get Feedback Individually 3.24 1.18
I Learned More In Group Assignments Than In Individual
Assignments
3.38 1.12
E X P E R I E N C I N G M O T I VAT I O N
“[I liked] the chance to improve already graded work. It
was also a motivating thing to immediately see received
points”; “[I liked] 2nd
chances“; “[I like that it is] hard to
fail this course and hard to get lost and procrastinate”
Arith.
Mean
Std Dev
I Liked Getting Points Rather Than Grades For
Exercises.
3.95 1.12
I Was Motivated To Do The Bonus Assignments 3.57 1.25
I Liked Earning Badges 2.52 1.21
Earning Badges Was Not Important To Me 4.38 1.24
I Used The Grading Book To View My Points 4.67 0.58
I Used The Grading Book To View My Ranking 3.67 1.35
I Was Interested In The Ranking Information 3.33 1.43
Seeing My Own Ranking Motivated Me To Conduct
Further Assignments
2.81 1.6
E X P E R I E N C I N G I N T E R A C T I V I T Y
“I liked the interactivity of the course. It was not like in
other assignment-based courses, where exercises must
be done at home and then presented. There was time
for researching or calculations, and then the results were
discussed.”; “I liked the interactive learning. The
structure of the course, some parts lecture, immediately
followed by exercises, was nice.”
D E S I G N E D F O R A D A P TA B I L I T Y
“It was hard to follow all the stuff showed in the lecture,
but the lecturer obviously read the feedback after each
block and slowed down a little bit at the end which was
much better”
A S S E S S I N G T H E L E A R N I N G P R O G R E S S
28 Students
25/28 Best Grade
1 Dropout
2 Second best grade
S O M E TA K E A WAY S
• Collaborative > Competition
• Attract different learning styles. Competition as
“extra” for the target student group, also badges only
work for some students
• Use groups of 3
• Design for adaptability
F U T U R E W O R K
• Lots of data left to evaluate
• Updated course
• Smaller groups
• Better designed badges
• More automatic assessment
T H A N K Y O U F O R Y O U R
AT T E N T I O N .
J O H A N N A P I R K E R , J P I R K E R @ M I T. E D U , W W W. J P I R K E R . C O M , @ J O E Y P R I N K

More Related Content

PDF
Exploratory and Collaborative Learning - Experience in Immersive Environments
PDF
Learning in Collaborative and Motivational Environments
PDF
Post Game Jam: What's Next?
PDF
Group Forming Processes - Experiences and Best Practice from Different Game Jams
PPTX
MLTV 2016 apps and web tools presentation
PPTX
aag_2016_2026_rr
PDF
Good Living Design Jam
PDF
Positioning the Avatar
Exploratory and Collaborative Learning - Experience in Immersive Environments
Learning in Collaborative and Motivational Environments
Post Game Jam: What's Next?
Group Forming Processes - Experiences and Best Practice from Different Game Jams
MLTV 2016 apps and web tools presentation
aag_2016_2026_rr
Good Living Design Jam
Positioning the Avatar

What's hot (18)

PDF
Let's put the right questions
PDF
Intro to Mobile UX
PDF
Design for your audience
PDF
Lean PRODUCT - UX e Design Thinking
PPTX
Professional story telling int mahoney
PDF
Usabilty workshop, Cluj Napoca
PDF
UX in E-commerce & Conversion
PDF
Paradigm shifts #4
PPTX
Innovation presentation leaders cvesd
PDF
In the workplace
PPTX
Why did I see that ad? - Revolve Conf 2015 Presentation
PDF
Domínio: Dividir e conquistar
PDF
Adding and finding meaning in case-by-case network graphs of interviews
PPTX
People Centred Design & Working Agile
PDF
California Science Center (USC CSCI 588)
PDF
Six Things You Need to Know About the Modern Call Center
PDF
Human Factors meets Augmented and Virtual Reality Talk
PPTX
Presentación Juan Martitegui - eCommerce Day Buenos Aires 2015
Let's put the right questions
Intro to Mobile UX
Design for your audience
Lean PRODUCT - UX e Design Thinking
Professional story telling int mahoney
Usabilty workshop, Cluj Napoca
UX in E-commerce & Conversion
Paradigm shifts #4
Innovation presentation leaders cvesd
In the workplace
Why did I see that ad? - Revolve Conf 2015 Presentation
Domínio: Dividir e conquistar
Adding and finding meaning in case-by-case network graphs of interviews
People Centred Design & Working Agile
California Science Center (USC CSCI 588)
Six Things You Need to Know About the Modern Call Center
Human Factors meets Augmented and Virtual Reality Talk
Presentación Juan Martitegui - eCommerce Day Buenos Aires 2015
Ad

Viewers also liked (8)

PDF
Design and Evaluation of a Learner-Centric Immersive Learning Environment for...
PDF
Games User Research & User Testing 101
PDF
Virtual Environments for 3D Visualisations
PDF
Learning in Virtual Worlds
PDF
Know your player - Optimizing the player experience
PDF
How Playstyles Evolve: Progression Analysis and Profiling in Just Cause 2
PDF
September Game Jam 2014 Graz
PDF
Virtual Teal World
Design and Evaluation of a Learner-Centric Immersive Learning Environment for...
Games User Research & User Testing 101
Virtual Environments for 3D Visualisations
Learning in Virtual Worlds
Know your player - Optimizing the player experience
How Playstyles Evolve: Progression Analysis and Profiling in Just Cause 2
September Game Jam 2014 Graz
Virtual Teal World
Ad

Similar to ACM ITICSE 2014 - Talk on Motivational Active Learning (20)

PDF
Motivational Active Learning - Reimagine Education 2015
PPTX
The why and what of testa
PPTX
TESTA, SIAST Universities of Regina & Saskathewan Webinar (November 2013)
PDF
Do i really want to know
PPTX
Changing the assessment narrative
PPTX
A broken assessment paradigm?
PPTX
Why a programme view? Why TESTA?
PPT
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
PPTX
TESTA, Sports Away Day Sheffield Hallam (June 2014)
PDF
An evidence based model
PPTX
Dispelling myths; challenging traditions: TESTA evidence
PPTX
TESTA to FASTECH (November 2011)
PPTX
Testa interactive masterclass
PPTX
Squeezing assessment and stretching learning
PPTX
For Faculty By Faculty - Just-in-Time Teaching - Part 2 - Oct 1 2014 - Jeff L...
PPTX
TESTA Interactive Masterclass
PPTX
Engaging in meaningful change in assessment
PPTX
1 why do testa
PPTX
TESTA to FASTECH Presentation
PPTX
Myths to Truths: Acting on evidence about student learning from assessment
Motivational Active Learning - Reimagine Education 2015
The why and what of testa
TESTA, SIAST Universities of Regina & Saskathewan Webinar (November 2013)
Do i really want to know
Changing the assessment narrative
A broken assessment paradigm?
Why a programme view? Why TESTA?
Keynote Sally Jordan - Computer-based assessment friend or foe? - OWD14
TESTA, Sports Away Day Sheffield Hallam (June 2014)
An evidence based model
Dispelling myths; challenging traditions: TESTA evidence
TESTA to FASTECH (November 2011)
Testa interactive masterclass
Squeezing assessment and stretching learning
For Faculty By Faculty - Just-in-Time Teaching - Part 2 - Oct 1 2014 - Jeff L...
TESTA Interactive Masterclass
Engaging in meaningful change in assessment
1 why do testa
TESTA to FASTECH Presentation
Myths to Truths: Acting on evidence about student learning from assessment

Recently uploaded (20)

PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PPTX
master seminar digital applications in india
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
Sports Quiz easy sports quiz sports quiz
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Lesson notes of climatology university.
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PDF
TR - Agricultural Crops Production NC III.pdf
PPTX
Cell Structure & Organelles in detailed.
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
GDM (1) (1).pptx small presentation for students
Final Presentation General Medicine 03-08-2024.pptx
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
master seminar digital applications in india
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
O7-L3 Supply Chain Operations - ICLT Program
Abdominal Access Techniques with Prof. Dr. R K Mishra
Sports Quiz easy sports quiz sports quiz
VCE English Exam - Section C Student Revision Booklet
Lesson notes of climatology university.
STATICS OF THE RIGID BODIES Hibbelers.pdf
Module 4: Burden of Disease Tutorial Slides S2 2025
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
TR - Agricultural Crops Production NC III.pdf
Cell Structure & Organelles in detailed.
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Renaissance Architecture: A Journey from Faith to Humanism
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
GDM (1) (1).pptx small presentation for students

ACM ITICSE 2014 - Talk on Motivational Active Learning

  • 1. M O T I VAT I O N A L A C T I V E L E A R N I N G ( M A L ) J O H A N N A P I R K E R , M A R I A R I F F N A L L E R - S C H I E F E R , C H R I S T I A N G Ü T L J P I R K E R @ M I T. E D U G R A Z U N I V E R S I T Y O F T E C H N O L O G Y
  • 2. “ I H E A R A N D I F O R G E T. I S E E A N D I R E M E M B E R . I D O A N D I U N D E R S TA N D . ”
  • 3. “Despite great lecturers, attendance at MIT's freshman physics course dropped to 40% by the end of the term, with a 10% failure rate.” H T T P : / / W E B . M I T. E D U / E D T E C H / C A S E S T U D I E S / T E A L . H T M L
  • 5. T E C H N O L O G Y- E N A B L E D A C T I V E L E A R N I N G • Collaborative learning (groups from 3-9) • Desktop experiments linked to laptops • Media-rich visualisations & simulations • Personal response systems to stimulate interaction between instructor and students
  • 6. “The failure rate, a major trigger for the project, has decreased substantially while the learning gains as measured by standard assessment instruments have almost doubled.” B E L C H E R , D O R I - H T T P : / / W E B . M I T. E D U / E D T E C H / C A S E S T U D I E S / P D F / T E A L 1 . P D F
  • 7. Instead of frustrating and stressing students with failure rates at exams, we want to reward them for putting extra effort to account for mistakes and not punish them for failing one single exam.
  • 8. T H E C O U R S E • Information Search & Retrieval • 1/3 Math, 1/3 Programming, 1/3 Theory • Master Students • Small classes (limited to 28 students)
  • 9. O B J E C T I V E S • Design a course combining (1) theoretical background & concepts, (2) algorithmic understanding, and (3) analytical understanding of mathematical models • Engaging students by interactivities & motivational activities • Increase the students’ activities and motivation for hands-on exercises
  • 10. C O M B I N E I N T E R A C T I V E E N G A G E M E N T W I T H G A M I F I C AT I O N • Collaborative Learning: Small subgroups (2 - 4) • Constant interactions between instructor & students with concept questions, small quizzes, and discussion questions • Immediate feedback on their task performance • Motivational feedback: Badges for special activities and leaderboard information • Errors are allowed: Revision of assignments & quizzes • Adaptive class design: Learning progress during and after class allows in-time adaption the individual learning speed of the class.
  • 11. M O T I VAT I O N A L A C T I V E L E A R N I N G G R O U P L O C AT I O N Lecture Block C L A S S Recap Quiz 1 C L A S S Concept Questions 1 C L A S S Concept Quiz 1 C L A S S Discussion Question 2 C L A S S Research Question 2 C L A S S Programming Assignments 2 - 4 C L A S S Calculation Assignments 2 - 4 C L A S S Reflection Quiz 1 H O M E Reflection Forum / Report 4 H O M E
  • 12. 0" 20" 40" 60" 80" 100" 120" 140" 160" 180" Minutes" Timline"of"lecture"3" Lecture" 3.1."Recap"Quiz" 3.2"Concept"Ques?on" 3.3."Short"Calcula?on:"Bayes"Theorem" "3.4."Short"Calcula?on:"Ranking"1" 3.5."Short"Calcula?on:"Ranking"2" 3.6."Discussion:"Steps"of"Ranking" 3.7."Concept"Ques?on"Quiz" "3.11."Discussion:"Quality"of"Retrieval"Models" 3.12."Concept"Ques?on" 3.13."Calcula?on"Retrieval"Performance(Part1/2)" 3.14."Concept"Ques?on"Quiz:"Precision"/"Recall" 3.15."Calcula?on"Retrieval"Performance"(Part"2/2)"
  • 16. T H E S T U D Y - G O A L S • Evaluate the students’ understanding of the course content • Analyze the students’ engagement and motivation • Analyze the students’ attitude towards the new model and the used e-learning environment
  • 17. T H E S T U D Y - M AT E R I A L S & M E T H O D S • Qualitative & Quantitative Methods & Field Observation • Learning progress: Pre & Post-Quizzes • Active Participation: Field observation • Reflection of content types, motivation types (AMS), rating of gamification aspects)
  • 18. E X P E R I E N C I N G C O O P E R AT I V E L E A R N I N G “The group assignments during classes were the best concept. It was good to use the concept just learned to remember it better, but also eventual misunderstandings could be discussed”
  • 19. Arith. Mean Std Dev I Prefer Activities In Teams. 3.38 1.32 I Prefer Activities In Groups Of 2 Over Activities In Groups Of 4 4.1 1.3 I Would Have Liked More Activities In A Team Of Four Than In A Team Of Two 2.33 1.62 I Would Have Liked More Single Activities In This Course 2.57 1.29 The Topics Were Easier To Understand In Groups Of 2 3.9 1.48 The Topics Were Easier To Understand In Groups Of 4 2.95 1.28 The Topics Were Easier To Understand Alone 2.29 1.19 I Prefer To Be Graded / Get Points Individually 3.05 1.32 I Prefer To Get Feedback Individually 3.24 1.18 I Learned More In Group Assignments Than In Individual Assignments 3.38 1.12
  • 20. E X P E R I E N C I N G M O T I VAT I O N “[I liked] the chance to improve already graded work. It was also a motivating thing to immediately see received points”; “[I liked] 2nd chances“; “[I like that it is] hard to fail this course and hard to get lost and procrastinate”
  • 21. Arith. Mean Std Dev I Liked Getting Points Rather Than Grades For Exercises. 3.95 1.12 I Was Motivated To Do The Bonus Assignments 3.57 1.25 I Liked Earning Badges 2.52 1.21 Earning Badges Was Not Important To Me 4.38 1.24 I Used The Grading Book To View My Points 4.67 0.58 I Used The Grading Book To View My Ranking 3.67 1.35 I Was Interested In The Ranking Information 3.33 1.43 Seeing My Own Ranking Motivated Me To Conduct Further Assignments 2.81 1.6
  • 22. E X P E R I E N C I N G I N T E R A C T I V I T Y “I liked the interactivity of the course. It was not like in other assignment-based courses, where exercises must be done at home and then presented. There was time for researching or calculations, and then the results were discussed.”; “I liked the interactive learning. The structure of the course, some parts lecture, immediately followed by exercises, was nice.”
  • 23. D E S I G N E D F O R A D A P TA B I L I T Y “It was hard to follow all the stuff showed in the lecture, but the lecturer obviously read the feedback after each block and slowed down a little bit at the end which was much better”
  • 24. A S S E S S I N G T H E L E A R N I N G P R O G R E S S 28 Students 25/28 Best Grade 1 Dropout 2 Second best grade
  • 25. S O M E TA K E A WAY S • Collaborative > Competition • Attract different learning styles. Competition as “extra” for the target student group, also badges only work for some students • Use groups of 3 • Design for adaptability
  • 26. F U T U R E W O R K • Lots of data left to evaluate • Updated course • Smaller groups • Better designed badges • More automatic assessment
  • 27. T H A N K Y O U F O R Y O U R AT T E N T I O N . J O H A N N A P I R K E R , J P I R K E R @ M I T. E D U , W W W. J P I R K E R . C O M , @ J O E Y P R I N K