SlideShare a Scribd company logo
USER EXPERIENCE DESIGN AND USABILITY TESTING FOR
MOBILE TECHNOLOGY SUPPORT IN OUTDOOR EDUCATION
Dr. Renée Schulz
Osaka University// University of Agder
Introduction
2
Source: https://www.idc.com/getdoc.jsp?containerId=prUS47534521
Introduction - wearables in teaching?
3
Context of Teaching Skiing and Snowboarding
4
5
6
7
Teacher
8
Wearables in Sports Education
• Activity/ inactivity [6]
• Personal tracking and quantified self [5, 7]
• Tracking climbing routes [8]
• Analyse and enhance runnig techniques [9]
• Motivation in hockey [10]
• Generally low usage even though rising availability [3, 4]
• Missing affordances (?) - specific design [4]
9
Methodology
10
HCD Process
Literature Review
Questionnaires
Interviews
Field Research
Focus Group/Group Interviews
Dynamic Learning Task Design
11
Dynamic Learning Task Design
12
Dynamic Learning Task Design
13
• From both insights (learning tasks and game tasks)
• The structure for tasks in the DynQ core concept was outlined as:
• Trigger(s)/Dependencies
• Sensor Logging
• Feedback
• The structure supports the needed processes for task creation,
distribution, and feedback
14
User Experience Design and Usability Testing for Mobile Technology Support in Outdoor Education
UX and User Testing Results
System Testing and Evaluation
• Most problems and limitations lie in the areas of communication between devices and
• cloud storage when students are in a zone without cellular connection/Wi-Fi for a long
time.
• Saving battery/ weather/ temperature is not good for batteries and touch screens
• Calculation of results, CPU/RAM power, cloud connection
• Size of GUI/ gloves
• Intervals of logging
• Touch gestures
16
UX and User Testing Results
UX of Task and Sensor Data
• Recorded data must be very specific/specified
• Important for logging/feedback as well as task triggers
• “Full freedom” of choice, is too confusing
• Useful examples could be:
• Average speed during a task, maximum speed during a task, highest acceleration (for some tasks) over a
certain amount of time, number of accelerations, and time spent doing a task/ completion time.
17
UX and User Testing Results
User Interaction Flow
• Interactions need to be short/fast (cold, snow, weather, clothes)
• Main functions in plain sight
• Only own courses shown (both for teachers and students)
• Interaction affordances clear
• Sensor usage must take users smartphones battery life into account
• Personalized tracking/ settings changeable
18
UX and User Testing Results
Multimedia Content Requirements
• Multimedia content additions, e.g., pictures and videos for training
• Reason: observing and understanding techniques
• Recording options to send multimedia content back to the teacher and for self-evaluation
19
UX and User Testing Results
Learning Task Location
• Start/end points of tasks are important – selection must be easy
• Both locations shown together, plus a path??
• Clear creation options for triggers, visible and hidden tasks and what feedback should be collected etc
• Clear instructions for creation/teachers and students
20
UX and User Testing Results
Students‘ Perspective on Learning Task Design
• the positive impact of feeling the progression of learning new skills based on the guidance and tasks given by
the teacher
• positive experiences were learning a new technique, understanding, and mastering techniques based on the
teacher’s explanations and guidance
• challenge of fast progression, connected to be motivated and pushed further by the teacher
• individual feedback was appreciated by most students
• Beginner students experienced long waiting times, because they had to go one-by-one to get feedback from the
teacher
• mismatch between task progression and the progression of individual students in a group can be critical
21
“I should have realized my own limitations. He [the teacher] wanted
us to ollie [a snowboard technique for jumping]. That was the worst (scary).”
• New technologies/sensors emerge and become more feasible
• More options for task trigger and feedback
• Personalized tasks and training
• Broadcasting information
Discussion and Conclusion
22
• Generalizable?
• Sports specific aspects,
• but also, interesting new learning
task takes
References and further links
This research was part of my PhD research project, and the full dissertation can be found here: http://hdl.handle.net/11250/2499694
[1] R. Schulz, G. M. N. Isabwe, & A. Prinz, “Development of a Task-driven Mobile Teaching Tool for Enhancing Teachers' Motivation,” Proceedings of the 8th International Conference
on Computer Supported Education (CSEDU 2016), vol. 1, pp. 251-258, April 2016.
[2] R. Schulz, G. M. Isabwe, & F. Reichert, „Investigating teachers’ motivation to use ICT tools in higher education,” 2015 Internet Technologies and Applications (ITA), pp. 62-67, IEEE,
September 2015.
[3] A. C. Borthwick, C. L. Anderson, E. S. Finsness, & T. S. Foulger, “Special article personal wearable technologies in education: Value or villain?,” Journal of Digital Learning in Teacher
Education, vol. 31, no. 3, pp. 85-92, 2015.
[4] M. Bower, & D. Sturman, “What are the educational affordances of wearable technologies?,” Computers & Education, vol. 88, pp. 343-353, 2015.
[5] S. E. Stahl, H. S. An, D. M. Dinkel, J. M. Noble, & J. M. Lee, “How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate
enough?,” BMJ open sport & exercise medicine, vol. 2, no. 1, 2016.
[6] M. Swan, “Sensor mania! the internet of things, wearable computing, objective metrics, and the quantified self 2.0,” Journal of Sensor and Actuator networks, vol. 1, no. 3, pp.
217-253, 2012.
[7] G. Bieber, M. Haescher, & M. Vahl, “Sensor requirements for activity recognition on smart watches,” Proceedings of the 6th International Conference on PErvasive Technologies
Related to Assistive Environments, pp. 1-6, May 2013.
[8] A. Kalyanaraman, J. Ranjan, & K. Whitehouse, “Automatic rock climbing route inference using wearables,” Adjunct Proceedings of the 2015 ACM International Joint Conference on
Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 41-44, September 2015.
[9] S. Nylander, M. Jacobsson, & J. Tholander, “Runright: real-time visual and audio feedback on running,” CHI'14 Extended Abstracts on Human Factors in Computing Systems, pp.
583-586, 2014.
[10] M. Alhonsuo, J. Hapuli, L.Virtanen, A. Colley, and J. Häkkilä. “Concepting wearables for ice-hockey youth,” Proceedings of the 17th International Conference on Human-Computer
Interaction with Mobile Devices and Services Adjunct, pp. 944–946, 2015.
[11] S. De Freitas, & M. Levene, “Evaluating the development of wearable devices, personal data assistants and the use of other mobile devices in further and higher education
institutions,” JISC Technology and Standards Watch Report, (TSW030), pp. 1-21, 2003.
[12] T. Coffman, & M. B. Klinger, “Google glass: using wearable technologies to enhance teaching and learning,” Society for information technology & teacher education international
conference, pp. 1777-1780, Association for the Advancement of Computing in Education (AACE), March 2015.
[13] T. Wu, C. Dameff, & J. Tully, “Integrating Google Glass into simulation-based training: experiences and future directions,” Journal of Biomedical Graphics and Computing, vol. 4,
no. 2, pp. 49-54, 2014.
[14] ISO DIS. 2009. 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems. International Standardization Organization
(ISO). Switzerland (2009).
[15]F. Wang, & M. J. Hannafin, “Design-based research and technology-enhanced learning environments,” Educational technology research and development, vol. 53, no. 4, pp. 5-23,
2005.
[16] R. Schulz, A. Prinz, & G. M. N. Isabwe, “The Use of Game World Tasks Concepts in Higher Education,” Serious Games. JCSG 2016. Lecture Notes in Computer Science, vol. 9894,
pp. 67-72, Springer, Cham, September 2016.
23

More Related Content

PPTX
Mseit advisory mtgoctober2013
PDF
One to-one i pad™ usage and applications in k-12 classrooms
PPTX
Moodle Best Practices from EdTechMasters Students National University
DOC
EDU 710 Literature Review #2
PPTX
Technology and the teacher
PPTX
The paradigm shift of ict in learning and teaching with respect to mathematic...
PDF
Digitising the black board how indian schools should intergrate information t...
PPTX
Using educational technology in the elementary classroom
Mseit advisory mtgoctober2013
One to-one i pad™ usage and applications in k-12 classrooms
Moodle Best Practices from EdTechMasters Students National University
EDU 710 Literature Review #2
Technology and the teacher
The paradigm shift of ict in learning and teaching with respect to mathematic...
Digitising the black board how indian schools should intergrate information t...
Using educational technology in the elementary classroom

What's hot (19)

PDF
The paradigm shift of ict in learning and teaching with respect to mathematic...
PPT
Building on MoRSE: Enhancing Learning in the field
PDF
INCITE - INtegrated Components for Interactive TEaching
PDF
Online assignment
PPT
The iPad in Medicine
DOCX
Educational philosophy
PDF
8. Design elements
DOCX
Chapter 1 final draft
PPTX
Learning space design_nelsond_may21_2015
PPT
Emerging technologies pp
PPT
Week 6 effectsoftechnology-roshana
PDF
Optimising mobile experiences - Online Educa Berlin 7th December 2018
PPTX
PORTFOLIO in EDUCATIONAL TECHNOLOGY II
PDF
The role of teacher and technology in perspective of classroom teaching
PDF
11.the role of teacher and technology in perspective of classroom teaching
PPT
Revised @ 1921 using technology in special education cl(1)
PDF
Teachers readiness on ict
PPTX
Portfolio in Educational Technology II
The paradigm shift of ict in learning and teaching with respect to mathematic...
Building on MoRSE: Enhancing Learning in the field
INCITE - INtegrated Components for Interactive TEaching
Online assignment
The iPad in Medicine
Educational philosophy
8. Design elements
Chapter 1 final draft
Learning space design_nelsond_may21_2015
Emerging technologies pp
Week 6 effectsoftechnology-roshana
Optimising mobile experiences - Online Educa Berlin 7th December 2018
PORTFOLIO in EDUCATIONAL TECHNOLOGY II
The role of teacher and technology in perspective of classroom teaching
11.the role of teacher and technology in perspective of classroom teaching
Revised @ 1921 using technology in special education cl(1)
Teachers readiness on ict
Portfolio in Educational Technology II
Ad

Similar to User Experience Design and Usability Testing for Mobile Technology Support in Outdoor Education (20)

PDF
Walentin Widgren Thesis
PPTX
Wearable Life: a Wrist-Worn Application to Assist Students in Special Education
PPTX
Wearable Life: a Wrist-Worn Application to Assist Students in Special Education
PDF
Wearable Technology in E Learning and Health Care
PDF
wUX applying UX principles to wearable tech and smart textiles
PDF
Wearable Technologies: Possibilities in Bringing Innovative Learning Experien...
PPTX
Neurobotix LTD Proposal
PPTX
Wearable Technology on Learning
PPTX
The future of hands on learning technologies-no pictures
PPTX
Final project communication tech
PPTX
current-and-future-trends-of-media-information-240818200331-b9730310.pptx
PDF
Signal orchestration-system-artel-ectel2012
PPTX
Wearable technologies should promote adaptive learners
PDF
Poster presentations.com a0-template-v5
PPT
Tomorrow's classroom
PPTX
Looking out on the Horizon
PPTX
Doha College Mobile Learning Conference 2014: Learning from Research
PDF
The Glass Class at AWE 2015
PDF
201101 affective learning
PDF
2014 10 23 (fie2014) emadrid uam exploring on e learning enhancement by mean ...
Walentin Widgren Thesis
Wearable Life: a Wrist-Worn Application to Assist Students in Special Education
Wearable Life: a Wrist-Worn Application to Assist Students in Special Education
Wearable Technology in E Learning and Health Care
wUX applying UX principles to wearable tech and smart textiles
Wearable Technologies: Possibilities in Bringing Innovative Learning Experien...
Neurobotix LTD Proposal
Wearable Technology on Learning
The future of hands on learning technologies-no pictures
Final project communication tech
current-and-future-trends-of-media-information-240818200331-b9730310.pptx
Signal orchestration-system-artel-ectel2012
Wearable technologies should promote adaptive learners
Poster presentations.com a0-template-v5
Tomorrow's classroom
Looking out on the Horizon
Doha College Mobile Learning Conference 2014: Learning from Research
The Glass Class at AWE 2015
201101 affective learning
2014 10 23 (fie2014) emadrid uam exploring on e learning enhancement by mean ...
Ad

More from Renée Schulz (16)

PDF
UX in the Transitioning Field of Autonomous Shipping
PDF
HCI and AI for Maritime Systems: JRCS @ Sea Japan 2022
PDF
Evaluating the User Experience of Virtual Learning Environments Using Biometr...
PDF
SHI2019 Immersion and Perspective Taking in Healthcare Technology: Supporting...
PDF
Scenario-based Serious Game to Teach about Healthcare
PDF
[Poster] Towards a Game-Design Framework for Evidence-based Clinical Procedur...
PDF
Mind the Steps: Electronical Clinical Procedure Library in Health Education a...
PDF
Euraxess ERD2018 Presentation on a JSPS Usability & eHealth Project
PDF
How to: Certificates in Canvas LMS
PDF
Listening to Teachers’ Needs: Human-centred Design for Mobile Technologies in...
PDF
The Use of Computer Games in Education
PDF
Mobile Teaching Tool for Outdoor Sports Education (D-Tel 2016)
PDF
PhD Progress Update May 2016
PDF
Differences and Tricks learned from NovoEd to Canvas.net
PDF
High-Level Context Information for Tasks in Teaching
PDF
The Use of Game World Task Concepts in Higher Education
UX in the Transitioning Field of Autonomous Shipping
HCI and AI for Maritime Systems: JRCS @ Sea Japan 2022
Evaluating the User Experience of Virtual Learning Environments Using Biometr...
SHI2019 Immersion and Perspective Taking in Healthcare Technology: Supporting...
Scenario-based Serious Game to Teach about Healthcare
[Poster] Towards a Game-Design Framework for Evidence-based Clinical Procedur...
Mind the Steps: Electronical Clinical Procedure Library in Health Education a...
Euraxess ERD2018 Presentation on a JSPS Usability & eHealth Project
How to: Certificates in Canvas LMS
Listening to Teachers’ Needs: Human-centred Design for Mobile Technologies in...
The Use of Computer Games in Education
Mobile Teaching Tool for Outdoor Sports Education (D-Tel 2016)
PhD Progress Update May 2016
Differences and Tricks learned from NovoEd to Canvas.net
High-Level Context Information for Tasks in Teaching
The Use of Game World Task Concepts in Higher Education

Recently uploaded (20)

PDF
Hazard Identification & Risk Assessment .pdf
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
IGGE1 Understanding the Self1234567891011
PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PDF
RMMM.pdf make it easy to upload and study
PPTX
Digestion and Absorption of Carbohydrates, Proteina and Fats
PDF
advance database management system book.pdf
PDF
Complications of Minimal Access Surgery at WLH
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
Indian roads congress 037 - 2012 Flexible pavement
PDF
SOIL: Factor, Horizon, Process, Classification, Degradation, Conservation
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
Weekly quiz Compilation Jan -July 25.pdf
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
PDF
LNK 2025 (2).pdf MWEHEHEHEHEHEHEHEHEHEHE
PDF
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
PPTX
Unit 4 Skeletal System.ppt.pptxopresentatiom
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Hazard Identification & Risk Assessment .pdf
Chinmaya Tiranga quiz Grand Finale.pdf
IGGE1 Understanding the Self1234567891011
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
RMMM.pdf make it easy to upload and study
Digestion and Absorption of Carbohydrates, Proteina and Fats
advance database management system book.pdf
Complications of Minimal Access Surgery at WLH
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Indian roads congress 037 - 2012 Flexible pavement
SOIL: Factor, Horizon, Process, Classification, Degradation, Conservation
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
Weekly quiz Compilation Jan -July 25.pdf
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
LNK 2025 (2).pdf MWEHEHEHEHEHEHEHEHEHEHE
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
Unit 4 Skeletal System.ppt.pptxopresentatiom
Final Presentation General Medicine 03-08-2024.pptx
LDMMIA Reiki Yoga Finals Review Spring Summer
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape

User Experience Design and Usability Testing for Mobile Technology Support in Outdoor Education

  • 1. USER EXPERIENCE DESIGN AND USABILITY TESTING FOR MOBILE TECHNOLOGY SUPPORT IN OUTDOOR EDUCATION Dr. Renée Schulz Osaka University// University of Agder
  • 3. Introduction - wearables in teaching? 3
  • 4. Context of Teaching Skiing and Snowboarding 4
  • 5. 5
  • 6. 6
  • 8. 8
  • 9. Wearables in Sports Education • Activity/ inactivity [6] • Personal tracking and quantified self [5, 7] • Tracking climbing routes [8] • Analyse and enhance runnig techniques [9] • Motivation in hockey [10] • Generally low usage even though rising availability [3, 4] • Missing affordances (?) - specific design [4] 9
  • 13. Dynamic Learning Task Design 13 • From both insights (learning tasks and game tasks) • The structure for tasks in the DynQ core concept was outlined as: • Trigger(s)/Dependencies • Sensor Logging • Feedback • The structure supports the needed processes for task creation, distribution, and feedback
  • 14. 14
  • 16. UX and User Testing Results System Testing and Evaluation • Most problems and limitations lie in the areas of communication between devices and • cloud storage when students are in a zone without cellular connection/Wi-Fi for a long time. • Saving battery/ weather/ temperature is not good for batteries and touch screens • Calculation of results, CPU/RAM power, cloud connection • Size of GUI/ gloves • Intervals of logging • Touch gestures 16
  • 17. UX and User Testing Results UX of Task and Sensor Data • Recorded data must be very specific/specified • Important for logging/feedback as well as task triggers • “Full freedom” of choice, is too confusing • Useful examples could be: • Average speed during a task, maximum speed during a task, highest acceleration (for some tasks) over a certain amount of time, number of accelerations, and time spent doing a task/ completion time. 17
  • 18. UX and User Testing Results User Interaction Flow • Interactions need to be short/fast (cold, snow, weather, clothes) • Main functions in plain sight • Only own courses shown (both for teachers and students) • Interaction affordances clear • Sensor usage must take users smartphones battery life into account • Personalized tracking/ settings changeable 18
  • 19. UX and User Testing Results Multimedia Content Requirements • Multimedia content additions, e.g., pictures and videos for training • Reason: observing and understanding techniques • Recording options to send multimedia content back to the teacher and for self-evaluation 19
  • 20. UX and User Testing Results Learning Task Location • Start/end points of tasks are important – selection must be easy • Both locations shown together, plus a path?? • Clear creation options for triggers, visible and hidden tasks and what feedback should be collected etc • Clear instructions for creation/teachers and students 20
  • 21. UX and User Testing Results Students‘ Perspective on Learning Task Design • the positive impact of feeling the progression of learning new skills based on the guidance and tasks given by the teacher • positive experiences were learning a new technique, understanding, and mastering techniques based on the teacher’s explanations and guidance • challenge of fast progression, connected to be motivated and pushed further by the teacher • individual feedback was appreciated by most students • Beginner students experienced long waiting times, because they had to go one-by-one to get feedback from the teacher • mismatch between task progression and the progression of individual students in a group can be critical 21 “I should have realized my own limitations. He [the teacher] wanted us to ollie [a snowboard technique for jumping]. That was the worst (scary).”
  • 22. • New technologies/sensors emerge and become more feasible • More options for task trigger and feedback • Personalized tasks and training • Broadcasting information Discussion and Conclusion 22 • Generalizable? • Sports specific aspects, • but also, interesting new learning task takes
  • 23. References and further links This research was part of my PhD research project, and the full dissertation can be found here: http://hdl.handle.net/11250/2499694 [1] R. Schulz, G. M. N. Isabwe, & A. Prinz, “Development of a Task-driven Mobile Teaching Tool for Enhancing Teachers' Motivation,” Proceedings of the 8th International Conference on Computer Supported Education (CSEDU 2016), vol. 1, pp. 251-258, April 2016. [2] R. Schulz, G. M. Isabwe, & F. Reichert, „Investigating teachers’ motivation to use ICT tools in higher education,” 2015 Internet Technologies and Applications (ITA), pp. 62-67, IEEE, September 2015. [3] A. C. Borthwick, C. L. Anderson, E. S. Finsness, & T. S. Foulger, “Special article personal wearable technologies in education: Value or villain?,” Journal of Digital Learning in Teacher Education, vol. 31, no. 3, pp. 85-92, 2015. [4] M. Bower, & D. Sturman, “What are the educational affordances of wearable technologies?,” Computers & Education, vol. 88, pp. 343-353, 2015. [5] S. E. Stahl, H. S. An, D. M. Dinkel, J. M. Noble, & J. M. Lee, “How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough?,” BMJ open sport & exercise medicine, vol. 2, no. 1, 2016. [6] M. Swan, “Sensor mania! the internet of things, wearable computing, objective metrics, and the quantified self 2.0,” Journal of Sensor and Actuator networks, vol. 1, no. 3, pp. 217-253, 2012. [7] G. Bieber, M. Haescher, & M. Vahl, “Sensor requirements for activity recognition on smart watches,” Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, pp. 1-6, May 2013. [8] A. Kalyanaraman, J. Ranjan, & K. Whitehouse, “Automatic rock climbing route inference using wearables,” Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 41-44, September 2015. [9] S. Nylander, M. Jacobsson, & J. Tholander, “Runright: real-time visual and audio feedback on running,” CHI'14 Extended Abstracts on Human Factors in Computing Systems, pp. 583-586, 2014. [10] M. Alhonsuo, J. Hapuli, L.Virtanen, A. Colley, and J. Häkkilä. “Concepting wearables for ice-hockey youth,” Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 944–946, 2015. [11] S. De Freitas, & M. Levene, “Evaluating the development of wearable devices, personal data assistants and the use of other mobile devices in further and higher education institutions,” JISC Technology and Standards Watch Report, (TSW030), pp. 1-21, 2003. [12] T. Coffman, & M. B. Klinger, “Google glass: using wearable technologies to enhance teaching and learning,” Society for information technology & teacher education international conference, pp. 1777-1780, Association for the Advancement of Computing in Education (AACE), March 2015. [13] T. Wu, C. Dameff, & J. Tully, “Integrating Google Glass into simulation-based training: experiences and future directions,” Journal of Biomedical Graphics and Computing, vol. 4, no. 2, pp. 49-54, 2014. [14] ISO DIS. 2009. 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems. International Standardization Organization (ISO). Switzerland (2009). [15]F. Wang, & M. J. Hannafin, “Design-based research and technology-enhanced learning environments,” Educational technology research and development, vol. 53, no. 4, pp. 5-23, 2005. [16] R. Schulz, A. Prinz, & G. M. N. Isabwe, “The Use of Game World Tasks Concepts in Higher Education,” Serious Games. JCSG 2016. Lecture Notes in Computer Science, vol. 9894, pp. 67-72, Springer, Cham, September 2016. 23