Jakob Johansson (Gleechi AB) Hand Interaction in Virtual Environments
- 3. Surgeon Simulator by Bossa Studios
- 4. Toybox Demo by Oculus
- 6. Giant Cop by Other Ocean
- 7. ADR1FT by Three One Zero
- 8. Job Simulator by Owlchemy Labs
- 9. The cortical homunculus Primary motor cortex
- 10. 25 Mixamo
- 11. Performance speed, strength, repeatability, accuracy, etc.) Flexibility (quantity of tasks) What Hand do you need for your Application?
- 12. Performance simple, user-friendly, dev-friendly, responsive, etc. What Input do you need for your Application? Flexibility (quantity of tasks)
- 13. Some things we learned 1. Choose controller based on the use case
- 14. Daydream HTC Vive Perception Neuron Manus Machina Oculus Touch GloveOne Dexmo Glove Kinect One Sony PS4 Camera Nimble VR Intel RealsenseLeapMotion Sony Move STEM T-Glove Motion Controllers Gloves 3D sensors
- 16. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley
- 17. R2-D2 C-3PO
- 19. R2-D2 C-3PO
- 20. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves)
- 22. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves) 4. Be consistent
- 23. Representation Gloves / human hands Robot hands Transparent hands Cartoon hands Tools & controllers Interaction Highly natural Somewhat natural Object penetration Invisible Static Complex Abstract
- 24. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves) 4. Be consistent 5. Skip the arms… for now
- 25. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves) 4. Be consistent 5. Skip the arms… for now 6. Think long and hard about every object in the scene
- 27. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves) 4. Be consistent 5. Skip the arms… for now 6. Think long and hard about every object in the scene 7. Make it obvious how to interact with the object
- 28. The Gallery by Cloudhead Games
- 29. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves) 4. Be consistent 5. Skip the arms… for now 6. Think long and hard about every object in the scene 7. Make it obvious how to interact with the object 8. Pick the most natural grasps
- 30. M. R. Cutkosky (1989). “On grasp choice, grasp models, and the design of hands for manufacturing tasks” Grasp Taxonomies
- 31. Some things we learned 1. Choose controller based on the use case 2. Avoid the uncanny valley 3. Avoid hand personalities (use gloves) 4. Be consistent 5. Skip the arms… for now 6. Think long and hard about every object in the scene 7. Make it obvious how to interact with the object 8. Pick the most natural grasps 9. Use feedback
- 32. VirtualGrasp