SlideShare a Scribd company logo
Hacks - Beyond Just Games
JEREMY JOHNSON
UX DESIGNER
DIofRuseECTORpex erience
          r
GAMER
@jeremyjohnson
   www.jeremyjohnsononline.com
2009
http://www.avenue-films.com/project-natal-the-journey.html
Microsoft's motion-sensor Kinect came out of the
company's research lab in Beijing, away from the
company's day-to-day business, she notes. "There was
a steel umbrella put over it, to keep out the rest of the
organization. Then Microsoft Research threw Kinect
over the wall to the Xbox group, which created their
own steel umbrella to shield it. They added some
scaffolding, but this was an innovation that was mostly
done in-house. It can happen in a big company. Of
course, this is entirely the reverse of the way Office/
Windows development happens."
boyd argues that the best place "to create steel
walls is in businesses outside your core cash cows.
The role of a big company is to keep the cash cow
rolling, and then build the new."

http://www.fastcompany.com/magazine/162/generation-flux-danah-boyd
Kinect Hacks: Beyond Just Games
18 Million
“Kinect, which launched slightly over a year ago, has sold an
impressive 18 million units worldwide. (At this rate, Kinect will
outsell the original Xbox by next year.)”
http://www.shacknews.com/article/71904/xbox-360-reaches-66-million-sales-kinect-at-18-million
GAMES
Kinect Hacks: Beyond Just Games
http://www.jeremyjohnsononline.com/2011/10/18/gamification-101-refresh-dallas-meeting/
“There’s a lot to learn from games. There are 30 years
of design lessons and thousands of products on the
market. Games have more concrete lessons to teach
application designers about learning, feedback, user
motivation and social systems than almost any field of
study.”

                                                                          - Danc




                                          http://www.lostgarden.com/2011/04/what-heck-happened-to-clippy-ribbon.html

                                                      http://www.officelabs.com/projects/ribbonhero2/Pages/default.aspx
                                      http://www.lostgarden.com/2010/05/wordcamp-2010-why-we-turned-microsoft.html
http://www.engadget.com/2010/12/09/kinect-finally-fulfills-its-minority-report-destiny-video/
“Kinect Hacks”
http://www.kinecthacks.com/
http://www.youtube.com/user/KinectHacks/featured
“Microsoft chief
                                  Steve Ballmer
                                  narrowed down
                                  the "early 2012"
                                  launch window
                                  for Kinect on the
                                  Windows PC
                                  during
                                  Microsoft's CES
                                  2012 keynote
                                  today: February
                                  1, 2012.”




http://www.joystiq.com/2012/01/09/kinect-for-windows-leers-at-february-1-launch-date/
http://techcrunch.com/2012/01/27/secret-windows-8-weapon-kinect-built-into-your-laptop/
http://www.xbox.com/en-US/Kinect/Kinect-Effect
UX DESIGNER
information architecture
interaction design
visual design
usability testing
desktop apps web apps RIAs
 mobile apps touch apps ??
Interaction Choreography
by Senior Principal Design Technologist Jared Ficklin

User interaction with technology is going above the glass. You no longer need an
explicit tool or even direct manipulation to drive a user interface. With the ability of
technology, like the Microsoft Kinect, to see users’ movements in space, gestures
are being added to traditional methods in new layers of interaction. Designing for
this new layer of interaction requires new thinking about dexterity, ergonomics,
and whether someone might feel silly or offensive with certain gestures. We are
so involved in this space right now, that we’ve had to move our design
technologists’ desks to create enough room for all the hand waving design.
http://designmind.frogdesign.com/blog/frogs-2012-technology-trend-predictions.html
Kinect Hacks: Beyond Just Games
vs
http://www.fastcodesign.com/1665827/microsoft-unleashes-the-kinect-and-promptly-misses-the-point
Kinect Hacks: Beyond Just Games
http://www.fastcodesign.com/1665827/microsoft-unleashes-the-kinect-and-promptly-misses-the-point
Kinect Hacks: Beyond Just Games
Kinect Hacks: Beyond Just Games
“The innovation here is the fluidity of
experience and focus on the data, without
using traditional user interface conventions
of windows and frames. Data becomes the
visual elements and controls. Simple
gestures and transitions guide the user
deeper into content. A truly elegant and
unique experience.”
http://en.wikipedia.org/wiki/Metro_(design_language)
Kinect Hacks: Beyond Just Games
KINECT HACKS
http://www.thecreatorsproject.com/blog/the-board-of-awesomeness-is-a-kinect-controlled-skateboard
Kinect Hacks: Beyond Just Games
http://www.pocket-lint.com/news/43671/kinect-hack-wiimote-robot-cat
http://venturebeat.com/2011/11/15/microsoft-code-space-kinect/
Kinect Hacks: Beyond Just Games
http://www.kinecthacks.com/kinect-video-manipulation/
http://www.niemanlab.org/2011/08/mirror-mirror-the-new-york-times-wants-to-serve-you-info-as-youre-brushing-your-teeth/
http://mashable.com/2012/01/09/bodymetrics-augmented-reality-shopping/
http://www.etre.com/blog/2012/01/puppet_parade_interactive_kinect_puppets/
http://www.creativeapplications.net/openframeworks/interactive-wall-at-ud-openframeworks-kinect/?utm_source=feed&utm_campaign=rss-mo-more&utm_medium=rss
http://www.theverge.com/microsoft/2012/1/11/2700832/kinect-fusion-swivel-facecake-hands-on

http://latimesblogs.latimes.com/technology/2012/01/virtual-dressing-room-takes-the-hassle-out-of-taking-off-your-clothes.html
http://techcrunch.com/2012/01/16/primesense-demos-a-gesture-based-next-gen-tv-interface
Solar powered house saves energy with Kinect

Now, in the name of conserving energy that vision could come true with a solar
house designed to use an Xbox Kinect to switch off energy consuming devices
with simple movements.


                                      http://dvice.com/archives/2012/01/solar-powered-h.php
http://dlb-network.com/2012/01/mass-effect-3-kinect-demo/
What now?
“Don’t try to figured
                                                         out how to cram
                                                         Kinect into an existing
                                                         UI paradigm, instead
                                                         design a UI paradigm
                                                         that’s from the
                                                         ground-up intended
                                                         to exploit the Kinect’s
                                                         functionality.”
http://www.teehanlax.com/labs/insights-into-kinect-ui/
http://www.useit.com/alertbox/kinect-gesture-ux.html
That there are no universal
standards for gestural interactions
yet is a problem in its own right,
because the UI cannot rely on
learned behavior. The Kinect has a
few system-wide standards,
however, which do help users.
http://www.useit.com/alertbox/kinect-gesture-ux.html
THE RULES Of KINECT
Explain what the player can do.

Represent what they are doing.

Make it fun to match the two.

  Test your implementation.


                        http://www.microsoft.com/download/en/details.aspx?id=27978
Things to Think About...
Distance and Environment
How far do they need to stand? How far do they think they need to stand?
Environment design of the area. Eyesight, size of the UI.


Ergonomics
Is it comfortable? Age? People with disabilities? Common movements vs.
uncommon. How long will they interact?


Fashion
Do they look silly? Will someone of a certain age/race/gender use this? What’s
acceptable for an Avatar?


UI Patterns
What do they know from click and touch interfaces? Is there something more
natural? Try and unlearn, and imagine.


3D Space
Is it close or far away? What do we infer from spatial positioning? Can you get
people to interact in 3D space on a 2D screen?
Things to Think About...
Screen Resolution
What’s the maximum amount of objects you can fit on a screen? What’s the
minimum size of an object need to be on the screen?


Privacy
Can you tailor to age? Race? Gender? What is helpful and what is potentially
scary? Can you keep a snapshot for marketing purposes?
THANKS!
jeremy@23hd.com
@ jeremyjohnson
www.jeremyjohnsononline.com

More Related Content

PPTX
Mini workshop on ar vr using unity3 d
PDF
Google Glass / Experience Report
PDF
GOOGLE GLΛSS By Google X and Google.inc
PDF
IoT Meetup Stockholm - Designing Connected Products
PDF
Seminar report on google glass
DOCX
Google Glass Seminar Report
PDF
Introduction to Wearables
PDF
Report on google glass(in pdf)
Mini workshop on ar vr using unity3 d
Google Glass / Experience Report
GOOGLE GLΛSS By Google X and Google.inc
IoT Meetup Stockholm - Designing Connected Products
Seminar report on google glass
Google Glass Seminar Report
Introduction to Wearables
Report on google glass(in pdf)

What's hot (18)

PDF
Thingscon Amsterdam 2015 - IoT Design Manifesto workshop
PDF
Connected Objects are natural born storyteller (IoT_Now)
PDF
virtual_chess
PPTX
Meta pro glasses ppt new
PDF
Reading UTC Launch Event
PDF
Sandeep-portfolio-2016
PDF
Developing for Google Glass
PDF
ARDUINOLIKE BOARDS: A SHORT HARDWARE REFERENCE GUIDE FOR MAKERS
PPTX
Ppt
PDF
Mobile Augmented Reality Development tools
PDF
Prototyping Experiences for Connected Products
PDF
How I Learned to Stop Worrying and Love Google Glass
PPTX
screen less display
PPTX
SCREENLESS DISPLAY
PDF
Google Glass: the next big thing ?
PPTX
Screenless pd presentation
PDF
[7/27 접근성세미나] 디자이너는 손놓고 있어도 되나요?
PDF
How People Use Iphone
Thingscon Amsterdam 2015 - IoT Design Manifesto workshop
Connected Objects are natural born storyteller (IoT_Now)
virtual_chess
Meta pro glasses ppt new
Reading UTC Launch Event
Sandeep-portfolio-2016
Developing for Google Glass
ARDUINOLIKE BOARDS: A SHORT HARDWARE REFERENCE GUIDE FOR MAKERS
Ppt
Mobile Augmented Reality Development tools
Prototyping Experiences for Connected Products
How I Learned to Stop Worrying and Love Google Glass
screen less display
SCREENLESS DISPLAY
Google Glass: the next big thing ?
Screenless pd presentation
[7/27 접근성세미나] 디자이너는 손놓고 있어도 되나요?
How People Use Iphone

Similar to Kinect Hacks: Beyond Just Games (20)

PDF
Designing for Sensors 
& the Future of Experiences
PDF
Kinectomania
PPTX
OSCON 2012: Design and Debug HTML5 Apps for Devices with RIB and Web Simulator
PPT
Concerto motionsummer2011week1
PPTX
PPTX
Microsoft Kinect and Kinect SDK
PDF
Gesture Gaming on the World Wide Web Using an Ordinary Web Camera
PDF
How ABB shapes the future of industry with Microsoft HoloLens and Unity - Uni...
PDF
ITCamp 2012 - Alex Gyoshev - Kendo-UI
PDF
Concerto motionsummer2011week1
PPTX
EuroIA 2016 Designing Connected Products
PDF
Kinect
PPTX
Microsoft Kinect for Human-Computer Interaction
PPTX
Kinect kunkuk final_
PDF
Open Web Camp 2014: Present & future of web development
PDF
Comp4010 Lecture7 Designing AR Systems
KEY
Usability Design: Because it's awesome
PDF
User Innovation - Xbox Kinect
PDF
ITCamp 2012 - Tim Huckaby - Keynote
PPTX
Interaction Design Roadmap
Designing for Sensors 
& the Future of Experiences
Kinectomania
OSCON 2012: Design and Debug HTML5 Apps for Devices with RIB and Web Simulator
Concerto motionsummer2011week1
Microsoft Kinect and Kinect SDK
Gesture Gaming on the World Wide Web Using an Ordinary Web Camera
How ABB shapes the future of industry with Microsoft HoloLens and Unity - Uni...
ITCamp 2012 - Alex Gyoshev - Kendo-UI
Concerto motionsummer2011week1
EuroIA 2016 Designing Connected Products
Kinect
Microsoft Kinect for Human-Computer Interaction
Kinect kunkuk final_
Open Web Camp 2014: Present & future of web development
Comp4010 Lecture7 Designing AR Systems
Usability Design: Because it's awesome
User Innovation - Xbox Kinect
ITCamp 2012 - Tim Huckaby - Keynote
Interaction Design Roadmap

More from Jeremy Johnson (20)

PDF
Modern Product Discovery: When, where, why, and how much?
PDF
Applying Service Design to the Workplace
PDF
Customer Experience in the Rise of the Digital Age — Atlanta XD Meeting 9/13/...
PDF
Businesses Want Results, Not Empathy Maps — #cxtalks Dallas 10 minute talk
PDF
UX Design, Friend of Foe #worldusabilityday
PDF
Product + UX: How to combine strengths to make something truly great! *Updated*
PDF
Including the User: How insights drive business #pswud2017
PDF
Product + UX: How to combine strengths to make something truly great!
PDF
Top 3 Ways to use your UX Team for Product Owners
PDF
UX = ROI: It's not just a myth
PDF
UX = ROI: It's not just a myth
PDF
Top 3 ways to use your UX team - producttank DFW Meetup
PDF
Top Trends In Product Design: Outcomes, Understanding Customers, and Building...
PDF
Top Three Modern Product Trends
PDF
10 Truths to Great Product Experiences
PDF
It's About Time - Lightning talk for UX Designers
PDF
Putting the "User" back in User Experience (Dallas Techfest Edition)
PDF
Ready to go Mobile? Today's Mobile Landscape: Responsive, Adaptive, Hybrid, a...
PDF
Putting the "User" back in User Experience
PDF
Pushing Through Failure (Quickly)
Modern Product Discovery: When, where, why, and how much?
Applying Service Design to the Workplace
Customer Experience in the Rise of the Digital Age — Atlanta XD Meeting 9/13/...
Businesses Want Results, Not Empathy Maps — #cxtalks Dallas 10 minute talk
UX Design, Friend of Foe #worldusabilityday
Product + UX: How to combine strengths to make something truly great! *Updated*
Including the User: How insights drive business #pswud2017
Product + UX: How to combine strengths to make something truly great!
Top 3 Ways to use your UX Team for Product Owners
UX = ROI: It's not just a myth
UX = ROI: It's not just a myth
Top 3 ways to use your UX team - producttank DFW Meetup
Top Trends In Product Design: Outcomes, Understanding Customers, and Building...
Top Three Modern Product Trends
10 Truths to Great Product Experiences
It's About Time - Lightning talk for UX Designers
Putting the "User" back in User Experience (Dallas Techfest Edition)
Ready to go Mobile? Today's Mobile Landscape: Responsive, Adaptive, Hybrid, a...
Putting the "User" back in User Experience
Pushing Through Failure (Quickly)

Recently uploaded (20)

PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
Cloud computing and distributed systems.
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Machine learning based COVID-19 study performance prediction
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
Big Data Technologies - Introduction.pptx
PPTX
A Presentation on Artificial Intelligence
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
cuic standard and advanced reporting.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
Understanding_Digital_Forensics_Presentation.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
Cloud computing and distributed systems.
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Advanced methodologies resolving dimensionality complications for autism neur...
NewMind AI Monthly Chronicles - July 2025
Reach Out and Touch Someone: Haptics and Empathic Computing
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
20250228 LYD VKU AI Blended-Learning.pptx
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
The Rise and Fall of 3GPP – Time for a Sabbatical?
Machine learning based COVID-19 study performance prediction
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Encapsulation_ Review paper, used for researhc scholars
Big Data Technologies - Introduction.pptx
A Presentation on Artificial Intelligence
Chapter 3 Spatial Domain Image Processing.pdf
cuic standard and advanced reporting.pdf
Review of recent advances in non-invasive hemoglobin estimation

Kinect Hacks: Beyond Just Games