Think beyond keyboard and screen - dev fest 2019
- 2. Think Beyond Keyboard and Screen by Kuldeep Singh Principal Technologist, ThoughtWorks kuldeep-reck thinkuldeep
- 4. Evolution of Technology & User Interactions Beyond Keyboard and Screens ARVR is here to stay Impact of ARVR Get ready...
- 5. Evolution of Technology and Interactions Recap
- 7. Evolution Batch Age 1940 1970 2000 CLI Age GUI Age Interactions Age 1980 1990 2010 Internet Age 2019 AI Age No Interactions Attentive WYSIWYG Seamless transition Touch and Feel Immersive
- 8. Virtual is new real.
- 9. Beyond Keyboard and Screen
- 10. ●No GUI or Minimal UI ●Sound and Touch ●Wearables ○ Clothing ○ Shoe ○ Gloves ○ Watch ●Smart dust No UI I'll believe it when I see it
- 11. ●Brain Computer Interface ●Smart contact lens ●Edible tech: Smart pills ●Foldable tech ●Scanners - Skin, Iris, Retina, Tears ●Behaviour & Emotions ●Gestures Getting inside
- 12. Holograms Volumetric Display 3D Videos HUD Augmented Reality and Virtual Reality Spatial Displays
- 13. Augmented reality (AR) overlays digital content in the live environment. Augmented Reality
- 14. A complete immersive experience that shuts out the physical world and takes into the virtual world. Virtual Reality
- 15. Combination of both AR and VR, where physical world and digital objects interact. Mixed Reality
- 16. ARVR is here to stay Where are we in ARVR space?
- 17. XR - AR/VR/MR, Augmented VR, Virtual AR Mixing, Interactions Treadmill with VR GPS enabled VR Tours Try augmenting on virtual objects
- 18. Terminologies ● IMU - Accelerometer, Gyroscope, Magnetometer ● Degree of Freedom - 3DOF, 6DOF ● Depth Sensing - IR, Dual Camera ● SLAM ● Feature Points - Cloud Anchors ● Occlusions ● Light Baking
- 19. Mobile XR
- 20. Web XR Do I need HMD device? Do I need apps to download? Do I need browser plugin to download? https://codelabs.developers.google.com/codelabs/ar-with-webxr/#0
- 21. Tools and Tech... Devices ● VR - Oculus Go, GearVR, Vive, Cardboard ● AR - Google Glass 2, Vuzix, Epson, Lenovo Mirage, Dell Visor ● MR - Hololens 2, Magic Leap, Lenovo ThinkReality A6, Dell Visor, Samsung Odyssey Development Tools ● ARCore and ARKit ● Wikitude - full computer visions engine sdk , C++, Java, Javascript, ObjC. ● Unreal Engine - Epic Games - C++ ● Vuforia - PTC ● Unity Engine - C# and Javascript ● UWP - MS.
- 22. ●Industry adoption (in last 2-3 years) - wait and watch ●Device incapability - Business need precision, more power, and adaptation to environment ●Outdoor is too much variations ●AI enabled Virtual Environment may help ●Laws and Regional Regulations - Face recognition, biometric data storage, GDPR ●Industry practices are missing. Challenges
- 23. Impact of ARVR How it impacts of life of software development and developers?
- 24. Software Engineering -> Art and Science ●Working conditions ●Context driven ●Virtual environments ●Sound and lights ●Color ●World space - Real Scale ●Estimations
- 25. Business Analysis >> Movie Director ●Gamify the experience ●Open 3D space ●Control the sound and lights ●Changing Inputs ●Changing Outputs ●Making it Real.
- 26. Graphic Designers >> Multimedia Artists ●3D Modeling ●Textures ●Animations ●Video mockups
- 27. Developer >> Mathematician >> Scientist ●Vector and Statistics ●Geography ●Physics ●Estimations ●CV, AI, ML ●Software development
- 28. ●Stay ready take up the challenge, and practice more... ●Create environments, and make it the mainstream... ●Setup studios - where people come and experiment, share devices. ●Trainings and community The way a head ...
- 29. Thank you! Kuldeep Singh Principal Technologist, Head of ARVR Practice, ThoughtWorks kuldeep-reck thinkuldeep Join us - ARVR Enthusiasts
Editor's Notes
- #8: Xerox - Alto failed, Star success but comercial failure Apple - Lisa - from Xerox but failed Apple Mac - too costly MIT - X-System - unix like system 1985 - MS Dos Go closer where it needs to be, connection between real and virtual getting strong, “We must evolve our thinking—and our capabilities— beyond the keyboard and the screen. Mixed reality will become the norm. Ease of doing always…. UX https://flatworldbusiness.wordpress.com/flat-education/previously/web-1-0-vs-web-2-0-vs-web-3-0-a-bird-eye-on-the-definition/
- #9: Go closer where it needs to be, connection between real and virtual getting strong, “We must evolve our thinking—and our capabilities— beyond the keyboard and the screen. Mixed reality will become the norm. Ease of doing always…. UX
- #11: Photo Credit : https://images.app.goo.gl/mjin3fvEZHfyPHzw9 https://images.app.goo.gl/s7F3kqv5bhgScFxp7
- #12: Brain waves & EEG traces