SlideShare a Scribd company logo
Classrooms of the
Future: How to Add
Mixed Reality and
Robotics to a Schools
STEAM Infrastructure
Dr James Birt
Bond University
Dr Michael Cowling
CQUniversity
LIVE Recording @ youtu.be/hh3lAB8foHM
Dr Michael Cowling & The CREATE Lab
www.michaelacowling.com & www.thecreatelab.org
2
Dr James Birt & The Mixed Reality Research Lab
www.bond.edu.au/profile/dr-james-birt & www.mixedrealityresearch.com
3
Presentation Summary
4
Topic
The Future of Jobs
Emerging Technology Drivers
Required Skills
Learner & Institutional Transition
Mixed Reality
Robotics
STEAM Infrastructure
The Future STEAM Classroom
Pedagogy before Technology
Is this all a Gimmick?
https://youtu.be/RE5C19Y3DMU
5
The Future of Jobs
• 4th Industrial Revolution
• Developments in AI, robotics,
visualization, nanotechnology, 3-D
printing, genetics & biotechnology
• Widespread disruption to business &
labour markets worldwide – automation +
technology
• 40% of current jobs gone in 10 years 
primary disruption white collar jobs!
Ceda Workforce Policy 2015Watch Future Proof – Four Corners ABC
Tomorrows Digitally Enabled
Workforce
6
Technology
Drivers 7
2016 – The Future of
Jobs Report - Core
work skills
8
The NMC/CoSN
Horizon Report:
2016 K-12 Edition
examines
emerging
technologies for
their
potential impact
on and use in
teaching, learning,
and creative
inquiry in schools.
9Adams Becker, S., Freeman, A., Giesinger Hall, C., Cummins, M., and Yuhnke, B. (2016). NMC/CoSN Horizon Report: 2016 K-12 Edition. Austin, Texas: The New Media Consortium.
The 2016 NMC Technology
Outlook for Australian
Tertiary Education Report
reflects a collaborative
research effort between the
New Media Consortium
(NMC) and Open
Universities Australia to
inform Australian campus
leaders and decision-makers
about significant
developments in technologies
supporting teaching,
learning, and creative
inquiry in tertiary education.
10Adams Becker, S., Cummins, M., Davis, A., and Yuhnke, B. (2016). 2016 NMC Technology Outlook for Australian Tertiary Education: A Horizon Project Regional Report. Austin, Texas: The New Media
Consortium.
Mixed Reality and How it Fits
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12),
1321-1329.
11
Future Shock Bond University
https://youtu.be/lxvN2de_ODU
12
Case Study: Mixed Reality Simulation in Paramedic Distance Education
Mixed Reality PedagogyTraditional Teaching Method
13
Augmented reality hands-on skill training simulation,
focusing on laryngoscopy with foreign body removal
www.mixedrealityresearch.com/#paramedics
14
Case Study: Mixed Reality in ICT Networking to Visualize Complex
Theoretical Multi-Step Problems
Mixed Reality PedagogyTraditional Teaching Method
15
Augmented Reality simulation to assist understanding of
networking and the five layer TCP/IP model
www.mixedrealityresearch.com/#networkModeling
16
Case Study: Mixed Reality and Spatial Learning Analytics to Facilitate
Learning of Anatomy
Mixed Reality PedagogyTraditional Teaching Method
17
Mixed Reality Software & Hardware
Tools
• Unity3d game engine (www.unity3d.com)
• Vuforia augmented reality plugin
(www.vuforia.com)
• MySQL (www.mysql.com)
• Php (secure.php.net)
• Google Cardboard headset
(vr.google.com/cardboard)
• Makerbot 3D Printer (www.makerbot.com)
• Oculus Rift (www.oculus.com)
• Leap Motion (www.leapmotion.com)
• HTC VIVE (www.vive.com)
• Adobe Creative (www.adobe.com/CreativeCloud)
18
Robotics in the Classroom
Why Robotics in the Classroom?
• QLD Government – Advancing Education: An action plan for
education in Queensland
 “Through learning coding and robotics, we will prepare students for the
jobs of the future and develop their skills in critical thinking, creativity,
collaboration and innovation.”
• Existing initiatives all about using STEM to teach STEM concepts –
but what about using Technology to Enhance other Areas?
• Called Technology Enhanced Learning – much bigger than just
teaching STEM/STEAM – more about making all classrooms
STEAM-y
• Robotics can be used for much more than STEM; for instance, could
it be used for general classroom learning support?
20
Case Study: Robotic Teaching
Assistant
• Teachers are short of time
• Students sometimes worry about
asking a teacher questions or
interrupting the class
• Teaching Assistants can help, but
they’re not experts in the subject
matter – often volunteers or parents
• Robotics can provide students with a
familiar, humanoid system to interact
with
• Aim: To construct AI supported local
semi-autonomous robot helpers
21
What does a Teaching Assistant Do?
22
Task responsibilities Percent of Sample
Working with small groups of students on academic tasks
(e.g. reading, maths, word study, science)
100%
General classroom support for students and teachers 100%
Administrative duties for teachers (e.g. photocopying
gathering resources, data entry, filing, setting up activities)
96%
One-on-one support for ascertained students with
disabilities
67%
Top 4 Teaching Aide Tasks (Harris & Aprile, 2015)
Robotic Teaching Assistant Demonstration
https://youtu.be/mEskQ2V8tyg
23
NAO Robot
• Produced by Aldebaran Robotics
• Around 2 feet tall
• 2 cameras (top and bottom), multiple
microphones (including left and right)
• Basic Voice Recognition
• Full Articulation (moving hands, feet,
sitting down, laying down etc)
• Programmed using graphical tool
(Choreographe) or Python
24
Choreograph
e
Future STEAM Classrooms – what might they look like?
http://futureclassrooms.org/steam/
25
STEAM Infrastructure
• Cheap Solutions
 Mobile Mixed Reality Headset
 Samsung Gear VR, ColorCross, DayDream
 Lego Mindstorms – EV3 kit
 Sphero
• More Expensive Options
 Oculus Rift / HTC Vive
 Microsoft HoloLens
 3D Printer
 NAO Robot / Pepper Robot
• The right solution is a combination of the two,
building infrastructure for creativity
• Think MakerSpace, lots of little pieces for students to
play with.
26
27
Its not about teaching a tool
these change too quickly
it’s about:
Environments to nurture
creative thinking, problem
solving, agility, digital
skills, entrepreneurship
and communication …
Pedagogy before
technology & lessons
learned
Pedagogy before Technology
29

More Related Content

PPTX
mLearning
PDF
Enhancing Learning with Technology
PPTX
The world known supercomputer IBM watson
PPTX
iPads as collaborative tools to enhance biological identification skills in t...
PDF
Learning Analytics and Higher Education
PPTX
Open Learning Analytics
PPTX
COVID-19 and the Future of AI in Education and Training
PPTX
EdubloggerCon East 2011 IGNITE Presentation
mLearning
Enhancing Learning with Technology
The world known supercomputer IBM watson
iPads as collaborative tools to enhance biological identification skills in t...
Learning Analytics and Higher Education
Open Learning Analytics
COVID-19 and the Future of AI in Education and Training
EdubloggerCon East 2011 IGNITE Presentation

What's hot (12)

PPTX
Activity-based UbiComp for Health
PDF
Day 2 k-12 - 1130 - andrew mowat & adrienne michetti
PPTX
Digital productivity and balance
PPTX
Robots in education
PDF
2011, STEAM - STEM+ARTS - 21st Century Renaissance The STEM+ARTS Movement
PDF
Millet, Models for Mobile in Teaching and Learning
PDF
The Future of Technology in Education (UK)
PPT
Technology: enabling or subverting
PPTX
ICT and its impact on schools’ infrastructure, teaching and learning
PPT
Ittakesavillage
PPTX
Scssa dig tech_edinburgh_web
PPTX
The Future of Higher Education in the United States
Activity-based UbiComp for Health
Day 2 k-12 - 1130 - andrew mowat & adrienne michetti
Digital productivity and balance
Robots in education
2011, STEAM - STEM+ARTS - 21st Century Renaissance The STEM+ARTS Movement
Millet, Models for Mobile in Teaching and Learning
The Future of Technology in Education (UK)
Technology: enabling or subverting
ICT and its impact on schools’ infrastructure, teaching and learning
Ittakesavillage
Scssa dig tech_edinburgh_web
The Future of Higher Education in the United States
Ad

Similar to Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools STEAM Infrastructure (20)

PPTX
HICSS ATLT: Advances in Teaching and Learning Technologies
PPTX
Tech Futures: Innovating Pedagogy
PPTX
Understanding Emerging Technology and Its Impact on Online & Blended Learning
PPTX
An unbounded arc of learning opportunities
PPTX
Pedagogy before Technology (Weaving Tech 2019)
PDF
20210623 Digital Technologies and Innovations in Education
PPTX
Interaction system based on internet of things as support for education
PPTX
Computational Thinking and Acting: Future Technologies for Future Generations
PPTX
Teaching with Technology: Social Media Tools and Mobile Apps for Secondary S...
PPTX
Teaching with Technology: Social Media Tools and Mobile Apps for Primary Sch...
PPTX
Use of AI in Classrooms For Effective Learning .pptx
PPTX
ILA Presentation
PDF
Internetdagar: DigComp 2.2 update
PPTX
ieee edsoc tunisia DL MCastro 2022 07 final.pptx
PPTX
Blended Learning Meets Digital Media
PDF
Resetting education through recent research
PDF
Keynote Presentation of Manuel Castro
PPT
Keynote Green River & Whatcom (9-08)
PPT
Horizon
HICSS ATLT: Advances in Teaching and Learning Technologies
Tech Futures: Innovating Pedagogy
Understanding Emerging Technology and Its Impact on Online & Blended Learning
An unbounded arc of learning opportunities
Pedagogy before Technology (Weaving Tech 2019)
20210623 Digital Technologies and Innovations in Education
Interaction system based on internet of things as support for education
Computational Thinking and Acting: Future Technologies for Future Generations
Teaching with Technology: Social Media Tools and Mobile Apps for Secondary S...
Teaching with Technology: Social Media Tools and Mobile Apps for Primary Sch...
Use of AI in Classrooms For Effective Learning .pptx
ILA Presentation
Internetdagar: DigComp 2.2 update
ieee edsoc tunisia DL MCastro 2022 07 final.pptx
Blended Learning Meets Digital Media
Resetting education through recent research
Keynote Presentation of Manuel Castro
Keynote Green River & Whatcom (9-08)
Horizon
Ad

More from Bond University (18)

PPTX
Integrating Mixed Reality Pedagogy into Education
PPTX
Weaving technology into the fabric of the classroom: Future jobs
PPTX
Preparing Learners for Future Jobs
PDF
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
PDF
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
PPTX
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
PPTX
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
PPTX
The future of jobs focusing on Interactive Media and Design
PPTX
Introductory Augmented Reality in Unity with Android and Vuforia
PPTX
Gaze detection with Virtual Reality and Unity 3d
PPTX
Introductory Virtual Reality in Unity3d
PPTX
DIY Mobile VR with Unity 3d & Cardboard SDK
PPTX
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
PPTX
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
PPTX
Visualization and Interactive Prototyping with Unity3D
PPTX
Getting Serious about the Future of Design and Games
PPTX
Effect of mixed media visualization on learner perceptions and outcomes
PPTX
Setup for Visualisation & Interactive Prototyping with Unity3D
Integrating Mixed Reality Pedagogy into Education
Weaving technology into the fabric of the classroom: Future jobs
Preparing Learners for Future Jobs
Using Gamification and Mixed Reality Visualization to Improve Conceptual Unde...
Piloting Mixed Reality in ICT Networking to Visualize Complex Theoretical Mul...
Gold Coast Mayors Technology Awards 2016: Visualisation and Interactive Proto...
Interactive Mixed Reality for Enhanced Learning, Skills and Engagement
The future of jobs focusing on Interactive Media and Design
Introductory Augmented Reality in Unity with Android and Vuforia
Gaze detection with Virtual Reality and Unity 3d
Introductory Virtual Reality in Unity3d
DIY Mobile VR with Unity 3d & Cardboard SDK
Towards a Pedagogy of Comparative Visualization in 3D Design Disciplines
Teaching Complex Theoretical Multi-Step Problems in ICT Networking through 3D...
Visualization and Interactive Prototyping with Unity3D
Getting Serious about the Future of Design and Games
Effect of mixed media visualization on learner perceptions and outcomes
Setup for Visualisation & Interactive Prototyping with Unity3D

Recently uploaded (20)

PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PDF
Complications of Minimal Access Surgery at WLH
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
Institutional Correction lecture only . . .
PDF
01-Introduction-to-Information-Management.pdf
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
O7-L3 Supply Chain Operations - ICLT Program
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
Complications of Minimal Access Surgery at WLH
102 student loan defaulters named and shamed – Is someone you know on the list?
Final Presentation General Medicine 03-08-2024.pptx
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
BÀI TẬP BỔ TRỢ 4 KỸ NĂNG TIẾNG ANH 9 GLOBAL SUCCESS - CẢ NĂM - BÁM SÁT FORM Đ...
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Introduction_to_Human_Anatomy_and_Physiology_for_B.Pharm.pptx
2.FourierTransform-ShortQuestionswithAnswers.pdf
VCE English Exam - Section C Student Revision Booklet
Renaissance Architecture: A Journey from Faith to Humanism
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Supply Chain Operations Speaking Notes -ICLT Program
STATICS OF THE RIGID BODIES Hibbelers.pdf
Institutional Correction lecture only . . .
01-Introduction-to-Information-Management.pdf
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Pharmacology of Heart Failure /Pharmacotherapy of CHF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf

Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools STEAM Infrastructure

  • 1. Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools STEAM Infrastructure Dr James Birt Bond University Dr Michael Cowling CQUniversity LIVE Recording @ youtu.be/hh3lAB8foHM
  • 2. Dr Michael Cowling & The CREATE Lab www.michaelacowling.com & www.thecreatelab.org 2
  • 3. Dr James Birt & The Mixed Reality Research Lab www.bond.edu.au/profile/dr-james-birt & www.mixedrealityresearch.com 3
  • 4. Presentation Summary 4 Topic The Future of Jobs Emerging Technology Drivers Required Skills Learner & Institutional Transition Mixed Reality Robotics STEAM Infrastructure The Future STEAM Classroom Pedagogy before Technology
  • 5. Is this all a Gimmick? https://youtu.be/RE5C19Y3DMU 5
  • 6. The Future of Jobs • 4th Industrial Revolution • Developments in AI, robotics, visualization, nanotechnology, 3-D printing, genetics & biotechnology • Widespread disruption to business & labour markets worldwide – automation + technology • 40% of current jobs gone in 10 years  primary disruption white collar jobs! Ceda Workforce Policy 2015Watch Future Proof – Four Corners ABC Tomorrows Digitally Enabled Workforce 6
  • 8. 2016 – The Future of Jobs Report - Core work skills 8
  • 9. The NMC/CoSN Horizon Report: 2016 K-12 Edition examines emerging technologies for their potential impact on and use in teaching, learning, and creative inquiry in schools. 9Adams Becker, S., Freeman, A., Giesinger Hall, C., Cummins, M., and Yuhnke, B. (2016). NMC/CoSN Horizon Report: 2016 K-12 Edition. Austin, Texas: The New Media Consortium.
  • 10. The 2016 NMC Technology Outlook for Australian Tertiary Education Report reflects a collaborative research effort between the New Media Consortium (NMC) and Open Universities Australia to inform Australian campus leaders and decision-makers about significant developments in technologies supporting teaching, learning, and creative inquiry in tertiary education. 10Adams Becker, S., Cummins, M., Davis, A., and Yuhnke, B. (2016). 2016 NMC Technology Outlook for Australian Tertiary Education: A Horizon Project Regional Report. Austin, Texas: The New Media Consortium.
  • 11. Mixed Reality and How it Fits Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321-1329. 11
  • 12. Future Shock Bond University https://youtu.be/lxvN2de_ODU 12
  • 13. Case Study: Mixed Reality Simulation in Paramedic Distance Education Mixed Reality PedagogyTraditional Teaching Method 13
  • 14. Augmented reality hands-on skill training simulation, focusing on laryngoscopy with foreign body removal www.mixedrealityresearch.com/#paramedics 14
  • 15. Case Study: Mixed Reality in ICT Networking to Visualize Complex Theoretical Multi-Step Problems Mixed Reality PedagogyTraditional Teaching Method 15
  • 16. Augmented Reality simulation to assist understanding of networking and the five layer TCP/IP model www.mixedrealityresearch.com/#networkModeling 16
  • 17. Case Study: Mixed Reality and Spatial Learning Analytics to Facilitate Learning of Anatomy Mixed Reality PedagogyTraditional Teaching Method 17
  • 18. Mixed Reality Software & Hardware Tools • Unity3d game engine (www.unity3d.com) • Vuforia augmented reality plugin (www.vuforia.com) • MySQL (www.mysql.com) • Php (secure.php.net) • Google Cardboard headset (vr.google.com/cardboard) • Makerbot 3D Printer (www.makerbot.com) • Oculus Rift (www.oculus.com) • Leap Motion (www.leapmotion.com) • HTC VIVE (www.vive.com) • Adobe Creative (www.adobe.com/CreativeCloud) 18
  • 19. Robotics in the Classroom
  • 20. Why Robotics in the Classroom? • QLD Government – Advancing Education: An action plan for education in Queensland  “Through learning coding and robotics, we will prepare students for the jobs of the future and develop their skills in critical thinking, creativity, collaboration and innovation.” • Existing initiatives all about using STEM to teach STEM concepts – but what about using Technology to Enhance other Areas? • Called Technology Enhanced Learning – much bigger than just teaching STEM/STEAM – more about making all classrooms STEAM-y • Robotics can be used for much more than STEM; for instance, could it be used for general classroom learning support? 20
  • 21. Case Study: Robotic Teaching Assistant • Teachers are short of time • Students sometimes worry about asking a teacher questions or interrupting the class • Teaching Assistants can help, but they’re not experts in the subject matter – often volunteers or parents • Robotics can provide students with a familiar, humanoid system to interact with • Aim: To construct AI supported local semi-autonomous robot helpers 21
  • 22. What does a Teaching Assistant Do? 22 Task responsibilities Percent of Sample Working with small groups of students on academic tasks (e.g. reading, maths, word study, science) 100% General classroom support for students and teachers 100% Administrative duties for teachers (e.g. photocopying gathering resources, data entry, filing, setting up activities) 96% One-on-one support for ascertained students with disabilities 67% Top 4 Teaching Aide Tasks (Harris & Aprile, 2015)
  • 23. Robotic Teaching Assistant Demonstration https://youtu.be/mEskQ2V8tyg 23
  • 24. NAO Robot • Produced by Aldebaran Robotics • Around 2 feet tall • 2 cameras (top and bottom), multiple microphones (including left and right) • Basic Voice Recognition • Full Articulation (moving hands, feet, sitting down, laying down etc) • Programmed using graphical tool (Choreographe) or Python 24 Choreograph e
  • 25. Future STEAM Classrooms – what might they look like? http://futureclassrooms.org/steam/ 25
  • 26. STEAM Infrastructure • Cheap Solutions  Mobile Mixed Reality Headset  Samsung Gear VR, ColorCross, DayDream  Lego Mindstorms – EV3 kit  Sphero • More Expensive Options  Oculus Rift / HTC Vive  Microsoft HoloLens  3D Printer  NAO Robot / Pepper Robot • The right solution is a combination of the two, building infrastructure for creativity • Think MakerSpace, lots of little pieces for students to play with. 26
  • 27. 27 Its not about teaching a tool these change too quickly it’s about: Environments to nurture creative thinking, problem solving, agility, digital skills, entrepreneurship and communication …
  • 28. Pedagogy before technology & lessons learned