Communitydays2015
Download as PPTX, PDF1 like696 views
The document discusses the evolution of human-computer interaction (HCI) technologies, primarily focusing on devices like Microsoft Kinect, Intel RealSense, Myo, and Leap Motion. It compares features, specifications, and application scenarios of different touchless technologies, highlighting pros and cons for each. The event 'C Days 2015' in Milan serves as a platform for showcasing advancements in interaction technologies and their practical implementations.
Communitydays2015
- 1. DEV09 – LA BATTAGLIA DEL TOUCHLESS Matteo Valoriani @MatteoValoriani Clemente Giorio @Tinux80
- 2. #CDays15 – Milano 24, 25 e 26 Marzo 2015 Grazie a Platinum Sponsor
- 3. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Who we are… Matteo Valoriani Microsoft MVP Kinect for Windows Intel Software Innovator PhD on HCI @Politecnico di Milano CEO of Fifth Ingenium Consultant Clemente Giorio Microsoft MVP Kinect for Windows Senior Developer at Crionet srl Instructor at Overnet Author at Packt Publishing Consultant
- 4. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Agenda • HCI evolution • Microsoft Kinect • Intel Real Sense • Myo • Leap Motion • ….. • Duo3D • Kinetics • … ….. Eye… eeg
- 5. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 CLI
- 6. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 GUI interface
- 7. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Touch Interface
- 8. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Natura User Interface
- 9. #CDays15 – Milano 24, 25 e 26 Marzo 2015 You have to be a magician… or at least a good illusionist
- 10. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
- 11. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Xbox One - Kinect 2 http://youtu.be/Hi5kMNfgDS4
- 12. #CDays15 – Milano 24, 25 e 26 Marzo 2015 Kinect 2 - Specs 3D DEPTH SENSOR RGB CAMERA MULTI-ARRAY MIC Hardware: Depth resolution: 512×424 RGB resolution: 1920×1080 (16:9) FrameRate: 60 FPS Latency: 60 ms
- 13. #CDays15 – Milano 24, 25 e 26 Marzo 2015 Kinect 2 vs Kinect 1 Version 1 Version 2 Depth range 0.4m → 4.0m 0.4m → 4.5m Color stream 640×480 1920×1080 Depth stream 320×240 512×424 Infrared stream None 512×424 Audio stream 4-mic array 16 kHz 4-mic array 48 kHz USB 2.0 3.0 Hand Traking External tools Yes Face Traking Yes Yes+Expressions FOV 57° H 43° V 70° H 60° V Tilt Motorized Manual
- 14. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 demo Titolo demo
- 15. Cons: The device is large A dedicated power cord is required The amount of data generated by the sensor also tends to saturate a USB controller Kinect cannot easily distinguish individual fingers on a hand Most of the features listed above require the Microsoft SDK, which is only supported for desktop applications on Windows 7 and 8. Pros Vs. Cons Pros: • Skeletal tracking • Face tracking • Multiple sensors: • Raw data • Voice control Best for: Kiosks, installations, and digital signage projects where the user will be standing fairly far away from the display.
- 16. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Pros Vs. Cons
- 17. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
- 18. Understands 4 basic types of input 19Intel® RealSense™ Hands-On Lab - Milan Categories of Input Capabilities Features Hands • Hand and Finger Tracking • Gesture Recognition • 22-point Hand and Finger Tracking • 9 static and dynamic mid-air gestures Face • Face Detection and Tracking • Multiple Face Detection and tracking • 78-point Landmark Detection (facial features) • Emotion Recognition (7 emotions, coming post-Beta) • Pulse Estimation • Face Recognition (Coming post-beta) Speech • Speech Recognition • Command and Control • Dictation • Text to Speech Environment • Segmentation • 3D Scanning • Augmented Reality • Background Removal • 3D Object / Face / Room Scanning (Coming post-beta) • 2D/3D Object Tracking • Scene Perception (coming post-beta)
- 19. Understands Hardware Limits 20Intel® RealSense™ Hands-On Lab - Milan
- 20. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 demo Titolo demo
- 21. Cons: Getting some of the deeper features (like age and gender detection) to work is a bit tricky. Device and software are in beta. Due to the close range of the tracking system, hand gestures must be designed such that a user’s hand doesn’t occlude their own view of the display. Pros Vs. Cons Pros: Smaller and less expensive Close-range tracking Hand posture/gesture recognition Facial analysis Speech (built-in support for speech synthesis powered by Nuance). Raw data Framework support: Processing, Unity and OpenFrameworks Best for: Desktop/laptop applications where the user will be seated in front of the PC. Close range applications where features, apart from hand tracking and recognition, are necessary without too much precision or accuracy.
- 22. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
- 23. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 demo Titolo demo
- 24. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Pros Vs. Cons
- 25. #CDays14 – Milano 25, 26 e 27 Febbraio 2014
- 26. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 demo Titolo demo https://www.youtube.com/watch?v=gby6hGZb3ww&t=27
- 27. Cons: Sensing range is fairly limited. Only fingers are tracked. There is no skeleton or face tracking. No access to the raw sensor data. Pros Vs. Cons Pros: Finger tracking is fast and accurate. Smaller and less expensive Framework support: .NET, Processing, Cinder, etc. Compatible: Mac OS and Windows Best for: Controlled kiosk environments with a pointing-based UI. Generally best for general audience desktop apps which can be distributed in the Airspace store.
- 28. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Recap • Devices • NUI • Usability
- 29. Leap, RealSense, Kinect 30Intel® RealSense™ Hands-On Lab - Milan 2,5 cm 60 cm 2 m 4 m
- 30. #CDays14 – Milano 25, 26 e 27 Febbraio 2014 Q&A Tutto il materiale di questa sessione su http://www.communitydays.it/ Lascia subito il feedback su questa sessione, potrai essere estratto per i nostri premi! Seguici su Twitter @CommunityDaysIT Facebook http://facebook.com/cdaysit #CDays15