Natural User Interfaces
2 likes816 views
This document discusses various technologies that enable more natural user interfaces. It describes early technologies like Videoplace from the 1970s that used cameras to track body movement. More recent technologies mentioned include mobile devices that use GPS, compasses and cameras for augmented reality; hand and finger tracking using Leap Motion; and virtual and augmented reality headsets like Oculus Rift, Google Glass, and Meta. The document outlines the goal of natural interfaces as allowing interaction that comes naturally while using technology and creating interfaces that themselves feel natural.
Natural User Interfaces
- 1. NATURAL USER INTERFACES Antão Almada Director, Strategic Software Development YDreams
- 2. Natural User Interfaces “natural” refers to a goal in the user experience – that the interaction comes naturally, while interacting with the technology, and that the interface itself is natural. - Wikipedia
- 4. GPS & Compass basedAugmented Reality Mobile devices
- 5. T(ether) High precision pose estimation and hand tracking
- 8. Contour and face tracking
- 9. Sphero
- 10. Reality Editor: Programming Smarter Objects
- 11. exTouch Affecting the real world
- 12. Depth sensing cameras 3D sensing of the real world
- 14. Airborne UltrasoundTactile Display The University of Tokyo
- 15. Leap Motion Hand and finger tracking
- 16. Holding a smartphone or a tablet Augmented reality, take picture, record video
- 17. Sixth Sense
- 18. Google Glass
- 19. Meta Stereoscopic, see-through with RGB and depth sensing cameras
- 20. Oculus Rift Raised $2,437,429 on Kickstarter
- 21. Omni Raised $1,109,351 on Kickstarter
- 22. Sixense STEM Wireless, modular motion tracking system
- 23. THE END Thank you very much!...
Editor's Notes
- #2: Follow me at:https://twitter.com/olschoolriderhttps://vimeo.com/olschoolriderhttp://www.pinterest.com/antaoalmada/boards/https://www.facebook.com/antao.almadahttp://www.flickr.com/photos/aalmada/
- #3: https://en.wikipedia.org/wiki/Natural_user_interface“Natural” still requires learning. It’s based on prior knowledge. This knowledge evolves with time. Many people now assume all public screens are multi-touch and support “swipe” gesture. Many screens still don’t…
- #4: NUI is not new. Myron Krueger was already working on camera-based interaction mid-70s. It took 30 years to reach mass market with PlaystationEyeToy.http://www.inventinginteractive.com/2010/03/22/myron-krueger/
- #5: Layar, Wikitude, Junaio, etc.Uses GPS and compass. Only works outside. Sensors have errors.Only works for object far away. The closer they are, the more issues arise.Video at http://www.youtube.com/watch?v=b64_16K2e08
- #6: From Tangible Media Group, MIT.Uses motion capture cameras.Works inside.Very high precision.Video at https://vimeo.com/42173010
- #7: From Tangible Media Group, MIT.Uses embedded camera and computer vision.Works everywhere there is a pattern (doesn’t work with flat surfaces).Video at https://vimeo.com/50854686
- #8: Anything that can be tracked by computer vision, can become an interface.Video athttps://vimeo.com/5188039
- #9: From YDreamsVideo at http://www.vimeo.com/3623041
- #10: From Sphero.Tracking visible objects.Sensor fusion (computer vision + accelerometer + gyroscopes) allows better tracking.Video at https://www.youtube.com/watch?v=UPn3jVGQw68
- #11: From Fluid Interfaces, MIT.Use of mobile augmented reality to manage the internet of things.Video at https://vimeo.com/74073989
- #12: From Tangible Media Group, MITMobile augmented reality to control motion of real objects.Video at https://vimeo.com/50854686
- #13: From YDreams.Depth-sensing augmented reality. User can touch virtual objects Although this demo uses shadows and audio queues, the lack of haptic feedback makes it hard for users to persieve the position of the virtual object.Video at https://vimeo.com/11160661
- #14: From Disney Research.Haptic feedback based on an directional air vortices gun.Video at http://www.youtube.com/watch?v=xaFBjUJj00M
- #15: From University of Tokyo.Haptic feedback based on ultrasound projection.Video athttp://www.youtube.com/watch?v=hSf2-jm0SsQ
- #16: Allows precise tracking of hands and fingers.Video by Xavier Seignard at https://vimeo.com/68530396Many more examples online….
- #17: Holding the device for a long time is very tiring. It’s awkward in some situations. Not everybody can hold it (handicapped).Image from http://cityphile.com/photo/augmented-reality-advertising-takeover-5/
- #18: From Fluid Interfaces Group, MITWearable.Requires a surface to project.Video at http://www.youtube.com/watch?v=Q4Z9sOtiWUY
- #19: Wearable.Touchpad.Voice action “ok glass,”:-Take a picture,-Record a video-Get directions to-Send a message toIdeal for some disabled people.
- #20: Stereoscopic. Includes a depth sensing sensor that allow sensing of the environment, hands and fingers.Raised $194,444 on Kickstarterhttp://www.kickstarter.com/projects/551975293/meta-the-most-advanced-augmented-reality-interface
- #21: http://www.kickstarter.com/projects/1523379957/oculus-rift-step-into-the-gameImage: http://en.wikipedia.org/wiki/File:Orlovsky_and_Oculus_Rift.jpg
- #22: http://www.kickstarter.com/projects/1944625487/omni-move-naturally-in-your-favorite-game
- #23: http://www.kickstarter.com/projects/89577853/stem-system-the-best-way-to-interact-with-virtual