Design Beyond the Screen - Tony Aube at AmuseConf 2019
Tony Aubé
Designer
Disclaimer:
Inventing Osmo
Lesson Learned
Design Process
Redefining AR
1
2
3
4
1
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Mirror
Computer Vision
• Started 5 years ago
• Selling in 55+ countries
• Used in 35,000 schools
• Acquired by Byjus for $120M
How it began…
JéromePramod
Computer Vision
What if we gave
computer vision
to iPads?
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
What is the
purpose of
Osmo?
Hands-on
Kids (3-12)Hands-on
Screen
Addiction
“Healthy”
Educational
Fun
For kids
Hands-on
Start with why
A new UI
Mouse Touch screen Keyboard
Design Beyond the Screen - Tony Aube at AmuseConf 2019
mental
model
Focus on design
key design decisions
5
No vision markers
1
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
AR is a
magic trick
Design Beyond the Screen - Tony Aube at AmuseConf 2019
No whiteboard
2
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
?
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
No electronics
3
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Keep the interaction
in the real world
4
Hands-on
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
5
Sell the hardware,
give the software
free$
forever!
Healthy
Dark
patterns
Micro
payments
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Business model should
provides the correct incentives
for your product
Design Beyond the Screen - Tony Aube at AmuseConf 2019
No vision markers
No whiteboard
No electronics
Keep interaction in the real world
Sell the hardware
2
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
The combination of digital &
physical must be better than
the sum of its part
Most
important!
The combination of digital &
physical must be better than
the sum of its part
Tangram
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Intuitive, clear
relationship between
screen & table
Combined UX is
better than the
sum of its parts
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Better than the
sum of its parts
Could I
create a better
experience?
physical-only
Could I
create a better
experience?
screen-only
3
Pen & paper
1
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Photo & video
2
Create a drawing game
using our characters ”“
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Web & mobile prototyping tools
Augmented Reality
Photos & videos are your best friends
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Wizard of Oz
3
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Duet Photoshop
SideCar
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Find low cost ways to explore,
communicate and validate
your ideas
Without requiring engineering
Wizard of Oz
Fake it till you
make it
QR codes
4
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Build the infrastructure upfront
to help you iterate quickly
Test, test, test
5
Test every Thursdays
Logistics are exhausting
Coordinator
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Testing
Testing should be “casual”
not an “event”
Remove the burden of logistics
from the creative team
Everybody tests
Record everything
Pen & paper
Photos & videos
Wizard of Oz
QR codes
Test, test, test
1
2
3
4
5
4
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
What 3D software
do you use?
???
AR:
3d models
Camera feed
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
AR in 2019:
Our definition of AR
is too constrained
Design Beyond the Screen - Tony Aube at AmuseConf 2019
+
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Osmo’s big
innovation
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
We need to redefine AR
3d models
Camera feed
is the most important
ingredient of AR
AI
Smart speakers
Read Along with Disney
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
The future of AR will be
BORING
video platform
AR is the next
video platform
AR is the next
computing platform
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
this is a toy“ ”
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Design Beyond the Screen - Tony Aube at AmuseConf 2019
Thank you!
Follow me:
@aubetony
medium.com/@tonyaub
hello@tonyaube.com

More Related Content

PDF
Design Beyond the Screen - Mixed Reality at Osmo - Tony Aube XRDC 2018
PDF
Trends in the digital/physical world - March 2014
PDF
GAME DESIGN WORKSHOPS FOR CHILDREN USING AN EXPERIMENTAL LEARNING SOFTWARE PR...
PPTX
UCD from across the pond - A case study in remote UX
PPTX
Thinking 102 Game Thinking
PDF
Fringe User Experience: Designing for the Future
PDF
Amber Studio: How game design is changing your life
PPTX
Imagine if There was no User Interface & User Experience
Design Beyond the Screen - Mixed Reality at Osmo - Tony Aube XRDC 2018
Trends in the digital/physical world - March 2014
GAME DESIGN WORKSHOPS FOR CHILDREN USING AN EXPERIMENTAL LEARNING SOFTWARE PR...
UCD from across the pond - A case study in remote UX
Thinking 102 Game Thinking
Fringe User Experience: Designing for the Future
Amber Studio: How game design is changing your life
Imagine if There was no User Interface & User Experience

What's hot (10)

PPTX
The Trouble with All Those Boxes: Designing for Ecosystems Instead of Screens
PDF
Multi-Device Design & Development
PDF
Challenge presentation
PDF
Ihmiset ja Muutos @ TIVI UX - Think Big!
PPT
Interactive technology in classroom
PPTX
principles of interactive design
PPTX
Tools for Mobile UX Design
PDF
Flat Design - A Primer
PDF
Trends in the digital/physical world - December 2013
PDF
Creative Outlets Confratute 2015 DAY TWO
The Trouble with All Those Boxes: Designing for Ecosystems Instead of Screens
Multi-Device Design & Development
Challenge presentation
Ihmiset ja Muutos @ TIVI UX - Think Big!
Interactive technology in classroom
principles of interactive design
Tools for Mobile UX Design
Flat Design - A Primer
Trends in the digital/physical world - December 2013
Creative Outlets Confratute 2015 DAY TWO
Ad

Similar to Design Beyond the Screen - Tony Aube at AmuseConf 2019 (20)

PDF
Less interaction
PPTX
The future of User Interface
PPTX
Gamestorming presentation ix da
PDF
Jiff Design + Benefits Webinar
PPT
Video games & creativity
PDF
Push conference 2018 key takeaways
PDF
"What Makes a Mobile-Enabled Workforce Tick?" - Brett Looney
PPTX
EuroIA 2016 Designing Connected Products
PPT
Gamification for Your Brand
PDF
Indie Games - From Prototype to Polish, Tips & Tricks making your own indie g...
PPTX
Ready, Set Code!: Learning How to Code Through Games
PPTX
Programming ideas
PPTX
New Product development for Microsoft
PDF
When Games Go Small
PPTX
Stephan Tanguay - Virtual Intent - User Experience Design In VR / AR
PDF
The Future of User Interfaces
PPTX
Drawing Diagrams 101 - How to use Graphical Tablets for the Virtual Communica...
PDF
User Interfaces beyond the screen
PDF
Mobile UX Design
PDF
Mobile UX Design
Less interaction
The future of User Interface
Gamestorming presentation ix da
Jiff Design + Benefits Webinar
Video games & creativity
Push conference 2018 key takeaways
"What Makes a Mobile-Enabled Workforce Tick?" - Brett Looney
EuroIA 2016 Designing Connected Products
Gamification for Your Brand
Indie Games - From Prototype to Polish, Tips & Tricks making your own indie g...
Ready, Set Code!: Learning How to Code Through Games
Programming ideas
New Product development for Microsoft
When Games Go Small
Stephan Tanguay - Virtual Intent - User Experience Design In VR / AR
The Future of User Interfaces
Drawing Diagrams 101 - How to use Graphical Tablets for the Virtual Communica...
User Interfaces beyond the screen
Mobile UX Design
Mobile UX Design
Ad

More from Tony Aubé (9)

PDF
Intelligence Artificielle: Vers l'ère de l'imagination
PDF
The AI Revolution - Into the Age of Imagination - Tony Aubé at WAQ 23
PDF
How to Win at TikTok
PDF
Instagram is Dead, Long Live TikTok!
PDF
Introduction to Web 3 - Tony Aube at WAQ19
PDF
Blockchain and the Cryptocurrency Revolution - Tony Aubé at WAQ18
PDF
The New UI - Tony Aubé at WAQ16
PDF
AI meets Design - Tony Aubé at WAQ17
PDF
Motion Web Design: l'Animation au Service de l'Expérience Utilisateur - Tony ...
Intelligence Artificielle: Vers l'ère de l'imagination
The AI Revolution - Into the Age of Imagination - Tony Aubé at WAQ 23
How to Win at TikTok
Instagram is Dead, Long Live TikTok!
Introduction to Web 3 - Tony Aube at WAQ19
Blockchain and the Cryptocurrency Revolution - Tony Aubé at WAQ18
The New UI - Tony Aubé at WAQ16
AI meets Design - Tony Aubé at WAQ17
Motion Web Design: l'Animation au Service de l'Expérience Utilisateur - Tony ...

Recently uploaded (20)

PPTX
UNIT III - GRAPHICS AND AUDIO FOR MOBILE
PDF
Govind singh Corporate office interior Portfolio
PDF
2025_AIFG_Akane_Kikuchi_Empathy_Design.PDF
PPTX
22CDO02-IMGD-UNIT-I-MOBILE GAME DESIGN PROCESS
PPTX
Presentation1.pptxnmnmnmnjhjhkjkjkkjkjjk
PDF
Social Media USAGE .............................................................
PDF
Trends That Shape Graphic Design Services
PDF
GSH-Vicky1-Complete-Plans on Housing.pdf
PPTX
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
PDF
321 LIBRARY DESIGN.pdf43354445t6556t5656
PPTX
WHY UPLOADING IS IMPORTANT TO DOWNLOAD SLIDES.pptx
PPTX
SOBALAJE WORK.pptxe4544556y8878998yy6555y5
PPTX
Drawing as Communication for interior design
PPTX
22CDH01-V3-UNIT-I INTRODUCITON TO EXTENDED REALITY
PDF
Architecture Design Portfolio- VICTOR OKUTU
PPT
robotS AND ROBOTICSOF HUMANS AND MACHINES
PDF
THEORY OF ID MODULE (Interior Design Subject)
PPTX
Project_Presentation Bitcoin Price Prediction
PDF
Designing Through Complexity - Four Perspectives.pdf
PPT
Fire_electrical_safety community 08.ppt
UNIT III - GRAPHICS AND AUDIO FOR MOBILE
Govind singh Corporate office interior Portfolio
2025_AIFG_Akane_Kikuchi_Empathy_Design.PDF
22CDO02-IMGD-UNIT-I-MOBILE GAME DESIGN PROCESS
Presentation1.pptxnmnmnmnjhjhkjkjkkjkjjk
Social Media USAGE .............................................................
Trends That Shape Graphic Design Services
GSH-Vicky1-Complete-Plans on Housing.pdf
URBAN FINANCEnhynhynnnytnynnnynynyynynynyn
321 LIBRARY DESIGN.pdf43354445t6556t5656
WHY UPLOADING IS IMPORTANT TO DOWNLOAD SLIDES.pptx
SOBALAJE WORK.pptxe4544556y8878998yy6555y5
Drawing as Communication for interior design
22CDH01-V3-UNIT-I INTRODUCITON TO EXTENDED REALITY
Architecture Design Portfolio- VICTOR OKUTU
robotS AND ROBOTICSOF HUMANS AND MACHINES
THEORY OF ID MODULE (Interior Design Subject)
Project_Presentation Bitcoin Price Prediction
Designing Through Complexity - Four Perspectives.pdf
Fire_electrical_safety community 08.ppt

Design Beyond the Screen - Tony Aube at AmuseConf 2019