SlideShare a Scribd company logo
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
2
www.bond.edu.au/profile/dr-james-birt
www.mixedrealityresearch.com
The future of Jobs
 4th Industrial Revolution
 Developments in AI, robotics,
visualization, nanotechnology, 3-D
printing, genetics & biotechnology
 Widespread disruption to business
and labour markets worldwide
 40% of current jobs gone in 10
years  primary disruption white
collar jobs!
Ceda Workforce Policy 2015Watch Future Proof – Four Corners ABC
Megatrends
 Rapid automation
 Digital technology
 Era of the
entrepreneur
 Aging population
 Increased job
complexity
 Globalisation
 Knowledge Economy Tomorrows Digitally Enabled Workforce
2015 Emerging
Technologies
Hype Cycle
Technology
Drivers
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
7
2016 – The
Future of Jobs
Report - Core
work skills
8
Its not about learning a tool
it’s about:
creative thinking, problem
solving, agility, digital skills,
entrepreneurship and
communication …
9
Cracking the Code – All School Kids will learn to code
and be exposed to new ways of problem solving and be
ready to embrace the digital age of innovation
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
11
Rethinking Degrees and
Jobs - Barbie Job of the
Year (2016)
Game Developer
12
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
www.mixedrealityresearch.com
Developing mixed platform visualisations &
simulations through virtual reality,
augmented reality, 3d printing and game
technology
Background Research
 Difficult to teach complex processes - without real world
models (Tasker & Dalton, 2008)
 Traditional methods often use abstract visualizations - don’t
capture complexity (Williamson et al., 2012)
 Focus on technology enhanced T&L (Johnson et al., 2016;
Keppell et al., 2011)
 Visualizations are positive learning support tools (Mayer, 2014;
Höffler, 2010)
 Kinaesthetic tools better form mental models (Pass & Sweller,
2014)
15
Most prior work in (multimedia…blended…dual modality) learning has
been formed around words & pictures with less attention to complex
learning environments such as interactive visualisations, games &
simulations (Ayres, 2015)
“this course is a 'skills' learning course … there
should be a way for us to actually get more time
doing skills … distance students at a severe
disadvantage … as an external I am missing out …
studying by distance you can read the skills but its
impossible to get feedback and to know if you’re
doing it right … no substitution for experience … any
software or equipment to at least go through the
motions of doing the skills?”
Sample - Student Evaluations
Stirling, A., & Birt, J. (2014). An enriched multimedia eBook application to facilitate learning of anatomy. Anatomical sciences education, 7(1), 19-27.
Stirling, A., & Birt, J. (2013). Getting to the HEART of Blended Learning. In Kinash, S., Knight, D. & Kordyban, R. (Eds.). Blended learning at Bond (pp.26-29).
Gold Coast, QLD: Office of Learning and Teaching, Bond University.
Study: An Enriched Multimedia eBook Application to Facilitate Learning
of Anatomy
Birt, J. (2012). Effective and engaging curriculum that challenges and motivates visual arts and design students in today's knowledge economy. In K. Wood,
D. Knight, & S. Kinash (Eds.). Scholarship of Teaching and Learning @ Bond, Volume 2 (pp. 160-167). Gold Coast, Queensland: Office of Teaching and
Learning, Bond University.
Birt, J. & Hovorka, D.S. (2014) Effect of mixed media visualization on learner perceptions, Proceedings of the 25th Australasian Conference on Information
Systems, AUT, Auckland, New Zealand, December 2014.
Birt, J. (2014). Mixed media visualization effect on student perceptions and learning outcomes. In B. Hegarty, J. McDonald, & S.-K. Loke (Eds.), Rhetoric and
Reality: Critical perspectives on educational technology. Proceedings ascilite Dunedin 2014 (pp. 514-518).
Birt, J. (2014). For improving student learning and engagement through practical juxtaposition of art and science in multimedia education. Australian Office of
Learning and Teaching National Citation for Outstanding Contributions to Student Learning.
Study: The Effect of Comparative Mixed Reality on Student
Perceptions and Learning Outcomes
Birt, J., Hovorka, D., & Nelson, J. (2015). Interdisciplinary Translation of Comparative Visualization. 26th Australasian Conference on Information Systems,
Adelaide, Australia, December 2015. Best paper award.
Birt, J., Nelson, J., & Hovorka, D. (2015). Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines. In T. Reiners, B.R. von Konsky, D.
Gibson, V. Chang, L. Irving, & K. Clarke (Eds.), Globally connected, digitally enabled. Proceedings ascilite 2015 in Perth (pp. CP:32-CP:36).
Study: Interdisciplinary Translation of Comparative Mixed
Reality Visualization
Traditional Teaching Method
Study: Augmenting Distance Education Skills Development in
Paramedic Science Through Mixed Reality Visualisations
Cowling, M., Moore, E., & Birt, J. (2015). Augmenting distance education skills development in paramedic science through mixed media visualisation. Paper
presented at the combined21st European Concurrent Engineering Conference, 11th Future Business Technology Conference, 19th Annual Euromedia
Conference. 27-29 April, 2015. Lisbon, Portugal. Available at: http://works.bepress.com/james_birt/21
Cowling, M. A., Birt. J. & Moore, E. (2015, October) Using 3D Printed Tools and an Augmented Reality Smartphone App to Enhance Paramedic Skill
Development. Poster session presented at Council of Ambulance Authorities Conference, Melbourne, Australia.
Moore, E., Cowling, M., & Birt, J. (2014, December) Exploring Possibilities in 3D Printing for Paramedic Science. Poster session presented at 4th ACU Simulation
in Health Education Showcase, Brisbane, Queensland
Moore, E., Cowling, M. A. & Birt. J. (2015, October) Improving Skill Development for Paramedics through Mixed Media Visualisation via 3D Printing and an
Augmented Reality App. Poster session presented at Paramedics Australasia International Conference, Adelaide, Australia.
YouTube - Playlist
Traditional Teaching Method
Cowling, M. & Birt, J. (2015). Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D Printing and Augmented Reality. In T. Reiners,
B.R. von Konsky, D. Gibson, V. Chang, L. Irving, & K. Clarke (Eds.), Globally connected, digitally enabled. Proceedings ascilite 2015 in Perth (pp. CP:62-CP:66).
Best concise paper award.
Study: Teaching Complex Theoretical Multi-Step Problems in ICT Networking
Through Physical Manipulation and Augmented Reality
youtu.be/0pHJWjG4-aQ
Traditional Teaching Method
22
Learners
Simulation/
Visualisation
Pedagogy
Accreditation
IndustryHigher
Education
Learning
Management
System
Learners
Simulation/
Visualisation
Pedagogy
Accreditation
IndustryHigher
Education
Learning
Management
System
Analytics +
Evidence
 Connections
Learners
Simulation/
Visualisation
Pedagogy
Accreditation
IndustryHigher
Education
Learning
Management
System
• Blending formal and informal learning
• Improving digital literacy
• Personalising learning
• Balancing connected and unconnected lives
• Education relevance
• Measuring learning
• Using researched learning designs
• Redesigning learning spaces
• Deeper learning
• Advancing culture of innovation
• Rethinking how we work
• BYOD – adaptive learning
• Augmented and virtual reality
(Horizon Report 2016 et al.)
& Objective of Mixed Reality Research
Prototype Example HeartMR
Mobile BYOD Mixed Reality simulation with data analytics transfer
26

More Related Content

PPT
From Digital essays to the formal model, building the capability of digital n...
PPTX
Y3 ICT and the Foundation Subjects - Lecture 1
PPTX
Modernising learning carnegie 26th oct (print)
PPTX
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
PPTX
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
PPTX
Ic ts in kindergarten
PDF
What Technology Preparation is Needed?
PPTX
Highbury opening presentation
From Digital essays to the formal model, building the capability of digital n...
Y3 ICT and the Foundation Subjects - Lecture 1
Modernising learning carnegie 26th oct (print)
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
Ic ts in kindergarten
What Technology Preparation is Needed?
Highbury opening presentation

Viewers also liked (20)

DOCX
Ruta de investigacion
PDF
Vrux talks 160708
DOC
Jack brophy resume_june_2016
PDF
Unicorns and the Future of Virtual Reality
PDF
Activity Recognition using RGBD
KEY
Mixed Reality Project
PPTX
Challenges in Designing a Menu System with Touch-less Technology
PDF
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
PPTX
Real-world Vision Systems Design: Challenges and Techniques
PDF
"Don’t Freeze! Survive the Ethics of a Mixed Reality Escape Room" by Sherry J...
PPTX
Life in 2100: Focused on Mixed Reality
PPTX
Setup for Visualisation & Interactive Prototyping with Unity3D
PPTX
Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
PPTX
Laurel Fitts - The Power of Mixed Reality
PDF
3DTV Transmission Aspects
PPTX
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
PDF
KaoNet: Face Recognition and Generation App using Deep Learning
PPTX
Developing for Room-Scale VR Using Unity3d
PDF
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
PDF
Tangible Interfaces & Mixed Reality : A step toward digital augmented enviro...
Ruta de investigacion
Vrux talks 160708
Jack brophy resume_june_2016
Unicorns and the Future of Virtual Reality
Activity Recognition using RGBD
Mixed Reality Project
Challenges in Designing a Menu System with Touch-less Technology
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
Real-world Vision Systems Design: Challenges and Techniques
"Don’t Freeze! Survive the Ethics of a Mixed Reality Escape Room" by Sherry J...
Life in 2100: Focused on Mixed Reality
Setup for Visualisation & Interactive Prototyping with Unity3D
Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Laurel Fitts - The Power of Mixed Reality
3DTV Transmission Aspects
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
KaoNet: Face Recognition and Generation App using Deep Learning
Developing for Room-Scale VR Using Unity3d
"The OpenCV Open Source Computer Vision Library: Latest Developments," a Pres...
Tangible Interfaces & Mixed Reality : A step toward digital augmented enviro...
Ad

Similar to Interactive Mixed Reality for Enhanced Learning, Skills and Engagement (20)

PPTX
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
PPTX
Integrating Mixed Reality Pedagogy into Education
PPTX
Weaving technology into the fabric of the classroom: Future jobs
PPTX
Pedagogy before Technology (Weaving Tech 2019)
PDF
Advanced Realities in Disruptive Education. ONE STC MOE_2019
PDF
39335591.pdf
PPTX
Effect of mixed media visualization on learner perceptions and outcomes
PPTX
The Future for Technologies in Schools: FutureSchools 2017
PPTX
Augmented reality and Learning Innovation
PPTX
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
PPTX
HICSS ATLT: Advances in Teaching and Learning Technologies
PPTX
The role of simulation for authentic learning: blending theory and practice
PDF
Bridging the XR Technology-to-Practice Gap: Methods and Strategies for Blend...
PPTX
10 Best Examples Of VR And AR In Education
PPTX
Visualisation and Simulation for teaching, learning and assessment
PPT
Arise Research Seminar
PDF
Adopting Virtual Reality for Education: Exploring Teachers’ Perspectives on R...
PDF
Adopting Virtual Reality for Education: Exploring Teachers’ Perspectives on R...
PDF
ADOPTING VIRTUAL REALITY FOR EDUCATION: EXPLORING TEACHERS’ PERSPECTIVES ON R...
PDF
ADOPTING VIRTUAL REALITY FOR EDUCATION: EXPLORING TEACHERS’ PERSPECTIVES ON R...
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
Integrating Mixed Reality Pedagogy into Education
Weaving technology into the fabric of the classroom: Future jobs
Pedagogy before Technology (Weaving Tech 2019)
Advanced Realities in Disruptive Education. ONE STC MOE_2019
39335591.pdf
Effect of mixed media visualization on learner perceptions and outcomes
The Future for Technologies in Schools: FutureSchools 2017
Augmented reality and Learning Innovation
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
HICSS ATLT: Advances in Teaching and Learning Technologies
The role of simulation for authentic learning: blending theory and practice
Bridging the XR Technology-to-Practice Gap: Methods and Strategies for Blend...
10 Best Examples Of VR And AR In Education
Visualisation and Simulation for teaching, learning and assessment
Arise Research Seminar
Adopting Virtual Reality for Education: Exploring Teachers’ Perspectives on R...
Adopting Virtual Reality for Education: Exploring Teachers’ Perspectives on R...
ADOPTING VIRTUAL REALITY FOR EDUCATION: EXPLORING TEACHERS’ PERSPECTIVES ON R...
ADOPTING VIRTUAL REALITY FOR EDUCATION: EXPLORING TEACHERS’ PERSPECTIVES ON R...
Ad

More from Bond University (9)

PPTX
Preparing Learners for Future Jobs
PDF
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
PPTX
The future of jobs focusing on Interactive Media and Design
PPTX
Introductory Augmented Reality in Unity with Android and Vuforia
PPTX
Gaze detection with Virtual Reality and Unity 3d
PPTX
Introductory Virtual Reality in Unity3d
PPTX
DIY Mobile VR with Unity 3d & Cardboard SDK
PPTX
Visualization and Interactive Prototyping with Unity3D
PPTX
Getting Serious about the Future of Design and Games
Preparing Learners for Future Jobs
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
The future of jobs focusing on Interactive Media and Design
Introductory Augmented Reality in Unity with Android and Vuforia
Gaze detection with Virtual Reality and Unity 3d
Introductory Virtual Reality in Unity3d
DIY Mobile VR with Unity 3d & Cardboard SDK
Visualization and Interactive Prototyping with Unity3D
Getting Serious about the Future of Design and Games

Recently uploaded (20)

PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PPTX
Introduction to pro and eukaryotes and differences.pptx
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PPTX
Introduction to Building Materials
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PPTX
20th Century Theater, Methods, History.pptx
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PPTX
Virtual and Augmented Reality in Current Scenario
PDF
Hazard Identification & Risk Assessment .pdf
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
What if we spent less time fighting change, and more time building what’s rig...
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
IGGE1 Understanding the Self1234567891011
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
Unit 4 Computer Architecture Multicore Processor.pptx
Paper A Mock Exam 9_ Attempt review.pdf.
Introduction to pro and eukaryotes and differences.pptx
202450812 BayCHI UCSC-SV 20250812 v17.pptx
A powerpoint presentation on the Revised K-10 Science Shaping Paper
Introduction to Building Materials
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
20th Century Theater, Methods, History.pptx
History, Philosophy and sociology of education (1).pptx
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
Virtual and Augmented Reality in Current Scenario
Hazard Identification & Risk Assessment .pdf
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
Chinmaya Tiranga quiz Grand Finale.pdf
What if we spent less time fighting change, and more time building what’s rig...
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
IGGE1 Understanding the Self1234567891011
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
TNA_Presentation-1-Final(SAVE)) (1).pptx

Interactive Mixed Reality for Enhanced Learning, Skills and Engagement

  • 3. The future of Jobs  4th Industrial Revolution  Developments in AI, robotics, visualization, nanotechnology, 3-D printing, genetics & biotechnology  Widespread disruption to business and labour markets worldwide  40% of current jobs gone in 10 years  primary disruption white collar jobs! Ceda Workforce Policy 2015Watch Future Proof – Four Corners ABC
  • 4. Megatrends  Rapid automation  Digital technology  Era of the entrepreneur  Aging population  Increased job complexity  Globalisation  Knowledge Economy Tomorrows Digitally Enabled Workforce
  • 7. 7 2016 – The Future of Jobs Report - Core work skills
  • 8. 8 Its not about learning a tool it’s about: creative thinking, problem solving, agility, digital skills, entrepreneurship and communication …
  • 9. 9 Cracking the Code – All School Kids will learn to code and be exposed to new ways of problem solving and be ready to embrace the digital age of innovation
  • 11. 11
  • 12. Rethinking Degrees and Jobs - Barbie Job of the Year (2016) Game Developer 12
  • 14. www.mixedrealityresearch.com Developing mixed platform visualisations & simulations through virtual reality, augmented reality, 3d printing and game technology
  • 15. Background Research  Difficult to teach complex processes - without real world models (Tasker & Dalton, 2008)  Traditional methods often use abstract visualizations - don’t capture complexity (Williamson et al., 2012)  Focus on technology enhanced T&L (Johnson et al., 2016; Keppell et al., 2011)  Visualizations are positive learning support tools (Mayer, 2014; Höffler, 2010)  Kinaesthetic tools better form mental models (Pass & Sweller, 2014) 15 Most prior work in (multimedia…blended…dual modality) learning has been formed around words & pictures with less attention to complex learning environments such as interactive visualisations, games & simulations (Ayres, 2015)
  • 16. “this course is a 'skills' learning course … there should be a way for us to actually get more time doing skills … distance students at a severe disadvantage … as an external I am missing out … studying by distance you can read the skills but its impossible to get feedback and to know if you’re doing it right … no substitution for experience … any software or equipment to at least go through the motions of doing the skills?” Sample - Student Evaluations
  • 17. Stirling, A., & Birt, J. (2014). An enriched multimedia eBook application to facilitate learning of anatomy. Anatomical sciences education, 7(1), 19-27. Stirling, A., & Birt, J. (2013). Getting to the HEART of Blended Learning. In Kinash, S., Knight, D. & Kordyban, R. (Eds.). Blended learning at Bond (pp.26-29). Gold Coast, QLD: Office of Learning and Teaching, Bond University. Study: An Enriched Multimedia eBook Application to Facilitate Learning of Anatomy
  • 18. Birt, J. (2012). Effective and engaging curriculum that challenges and motivates visual arts and design students in today's knowledge economy. In K. Wood, D. Knight, & S. Kinash (Eds.). Scholarship of Teaching and Learning @ Bond, Volume 2 (pp. 160-167). Gold Coast, Queensland: Office of Teaching and Learning, Bond University. Birt, J. & Hovorka, D.S. (2014) Effect of mixed media visualization on learner perceptions, Proceedings of the 25th Australasian Conference on Information Systems, AUT, Auckland, New Zealand, December 2014. Birt, J. (2014). Mixed media visualization effect on student perceptions and learning outcomes. In B. Hegarty, J. McDonald, & S.-K. Loke (Eds.), Rhetoric and Reality: Critical perspectives on educational technology. Proceedings ascilite Dunedin 2014 (pp. 514-518). Birt, J. (2014). For improving student learning and engagement through practical juxtaposition of art and science in multimedia education. Australian Office of Learning and Teaching National Citation for Outstanding Contributions to Student Learning. Study: The Effect of Comparative Mixed Reality on Student Perceptions and Learning Outcomes
  • 19. Birt, J., Hovorka, D., & Nelson, J. (2015). Interdisciplinary Translation of Comparative Visualization. 26th Australasian Conference on Information Systems, Adelaide, Australia, December 2015. Best paper award. Birt, J., Nelson, J., & Hovorka, D. (2015). Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines. In T. Reiners, B.R. von Konsky, D. Gibson, V. Chang, L. Irving, & K. Clarke (Eds.), Globally connected, digitally enabled. Proceedings ascilite 2015 in Perth (pp. CP:32-CP:36). Study: Interdisciplinary Translation of Comparative Mixed Reality Visualization Traditional Teaching Method
  • 20. Study: Augmenting Distance Education Skills Development in Paramedic Science Through Mixed Reality Visualisations Cowling, M., Moore, E., & Birt, J. (2015). Augmenting distance education skills development in paramedic science through mixed media visualisation. Paper presented at the combined21st European Concurrent Engineering Conference, 11th Future Business Technology Conference, 19th Annual Euromedia Conference. 27-29 April, 2015. Lisbon, Portugal. Available at: http://works.bepress.com/james_birt/21 Cowling, M. A., Birt. J. & Moore, E. (2015, October) Using 3D Printed Tools and an Augmented Reality Smartphone App to Enhance Paramedic Skill Development. Poster session presented at Council of Ambulance Authorities Conference, Melbourne, Australia. Moore, E., Cowling, M., & Birt, J. (2014, December) Exploring Possibilities in 3D Printing for Paramedic Science. Poster session presented at 4th ACU Simulation in Health Education Showcase, Brisbane, Queensland Moore, E., Cowling, M. A. & Birt. J. (2015, October) Improving Skill Development for Paramedics through Mixed Media Visualisation via 3D Printing and an Augmented Reality App. Poster session presented at Paramedics Australasia International Conference, Adelaide, Australia. YouTube - Playlist Traditional Teaching Method
  • 21. Cowling, M. & Birt, J. (2015). Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D Printing and Augmented Reality. In T. Reiners, B.R. von Konsky, D. Gibson, V. Chang, L. Irving, & K. Clarke (Eds.), Globally connected, digitally enabled. Proceedings ascilite 2015 in Perth (pp. CP:62-CP:66). Best concise paper award. Study: Teaching Complex Theoretical Multi-Step Problems in ICT Networking Through Physical Manipulation and Augmented Reality youtu.be/0pHJWjG4-aQ Traditional Teaching Method
  • 22. 22
  • 25. Learners Simulation/ Visualisation Pedagogy Accreditation IndustryHigher Education Learning Management System • Blending formal and informal learning • Improving digital literacy • Personalising learning • Balancing connected and unconnected lives • Education relevance • Measuring learning • Using researched learning designs • Redesigning learning spaces • Deeper learning • Advancing culture of innovation • Rethinking how we work • BYOD – adaptive learning • Augmented and virtual reality (Horizon Report 2016 et al.) & Objective of Mixed Reality Research
  • 26. Prototype Example HeartMR Mobile BYOD Mixed Reality simulation with data analytics transfer 26