Autonomous Vehcles and Augmented Reality
Download as PPTX, PDF2 likes2,658 views
The document discusses the intersection of augmented reality (AR) and autonomous vehicles (AV), highlighting ongoing research and projects related to AR applications in transportation. It covers the need for interoperability within the AR ecosystem for safety and efficiency and mentions developments in the autonomous vehicle sector, including regulations and security challenges. Additionally, it introduces the Automated Vehicle Safety Consortium established to address these concerns as self-driving technology advances.
Autonomous Vehcles and Augmented Reality
- 1. Augmented Reality + Autonomous Vehicles Stephen Black
- 2. Hyperreality by Keiichi Matsuda https://www.youtube.com/watch?v=YJg02ivYzSs https://www.rt.com/news/455341-chinese-hackers- tesla-autopilot/ https://mashable.com/article/nissan-ar-virtual-reality- windshield-display/ These videos were shown just before the presentation began.
- 3. The following presentation uses references from the State of the AR Cloud Report published May 28, 2019 by the Open AR Cloud. All rights reserved. http://stateofthearcloud.com/ With the exception of Novaby, the 3D model making company, I have no relationships with any of the companies mentioned in this presentation. This research has been self-funded.
- 4. SB: immediate goal: produce projects in AR + an app Long term goal: Pixar of AR w Sayuri Okayama, three years AR researching AR in SE Asia + HK/Shenzhen resulting in Bubiko Foodtour + global academic and industrial connections.
- 5. AR AR AR General + Movie led to Bicycle Research led to Traffic/Vehicle/AV Research Research +Planning (The word ‘arbicle’ created.)
- 6. What is Augmented Reality, AR? AR is the addition of digital information to an object.
- 7. Phones, tablets, glasses and windshields DELIVERY: Besides television and movies And… bonnets!
- 8. AR1.0 Artivive Pokemon Go Leo Snapchat Harry Potter: Wizards Unite Bubiko Foodtour videos: DC Rainmaker AR Rouvy Bike Experience Cannondale Simon Service AR Preview
- 9. Bike/Road Emergency: digital information (2 way+) Video GPS Weather Audio Heart beat + Text Chronology/Speed Graphics Proximity/Object Tracking 3D Objects that do not move Impact communication 3D Objects that move Live Camera Phone Walkie Talkie
- 10. How to find the location? (the need for interoperability): Google maps Mapillary Military maps LADOT ebike monitoring maps(eg) Satellite-based maps monitoring floods, snow, ice, fire, crowds etc. City/State/Federal maps Company owned routing maps Bus routes Ride sharing maps Superworld Emergency routes Bike lanes Construction Traffic signals
- 11. GEOPOSE
- 12. The ability for a great variety of users to identify and share a common set of co-ordinates for digital models is mandatory for safety and the growth of all in the AR ecosystem, especially AV. The Open Air Cloud Association (OARC) is committed to interoperability in nearly all areas of AR. https://www.openarcloud.org/about
- 20. OARC From State of the AR Cloud Report 2019
- 23. California is a hotbed for autonomous vehicle testing, so changes made to the state’s rules governing these tests are followed closely by companies, like General Motors, Alphabet’s Waymo, and Uber, that are developing fleets of self-driving cars for public use. There are currently 62 companies permitted and 678 autonomous vehicles that are licensed with the DMV, officials say. Waymo is the only company with a permit to test fully driverless vehicles on public roads. https://www.theverge.com/2019/4/12/18308136/california-dmv-self-driving-trucks-light-duty
- 24. A New Defense Against Robocar Cyberattacks Ed GarstenSenior Contributor August 7 2019 https://www.forbes.com/sites/edgarsten/2019/08/07/a-new-defense-against-robocar-cyberattacks/#13b438d348df “ Autonomous vehicles contain between 300 million to 500 million lines of software code, compared to a Boeing 787 Dreamliner commercial jet with 15 million and 100 million lines of code in a premium car such as a Mercedes C-class, said Barzilai.” In effect, said Barzilai, automakers are treating vehicles as “data centers” sending security updates over the air which aggressive hackers are able to defeat. A group of automakers, along with the Society of Automotive Engineers has established the Automated Vehicle Safety Consortium (AVSC) to look into this very issue as the industry steps up development of so-called Level 4 and Level 5 self-driving vehicles. Joining the SAE in the consortium are General Motors Corp., Ford Motor Co. and Toyota Motor Corporation. Still in its early stages, the AVSC is not only involved with developing a set of safety principles for Level 4 and 5 autonomous vehicles, but, “data collection, protection and sharing required to reconstruct certain events,” according to its website. https://www.sae-itc.com/
- 26. AV AR CONTENT - Required by vehicle (safety+ routing + maintenance) - Content offered by companies - Content chosen by individuals - Content shared by fellow passengers (traveling to a sports or cultural event, group learning)
- 27. A bit about AR…. lighting Occlusion Digital avatars
- 29. AV as actor/actress ! ?
- 30. May AV
- 32. bROADWAY, a possible entertainment project, enjoyed in AVs on the roads of Detroit, provides insights into AR
- 34. To create a GEOPOSE 1. Physical space owner 1. SLAM(er) spatial location and mapping 3. AR Cloud space 4. End user(s)
- 36. Diego Rivera’s masterpiece at the Detroit Institute of the Arts
- 38. Apple AR art
- 39. The Fox is GEOFENCED!
- 41. Bose AR + AR to aid the blind projects
- 42. Derrick May, Juan Atkins, Kevin Saunderson (Belleville Three), Jack White, Bob Seger, Motown/Stevie Wonder + WORLD’S GREATEST SOUNDTRACK! THE CITY OF THE FUTURE: DETROIT
- 43. Thank you Stephen Black bubikofoodtour@gmail.com www.blacksteps.tv Twitter @bookmerah LinkedIn/Facebook: Stephen Black
- 44. Please consider voting for the two SXSW proposals that follow . Thank you! Stephen Black and Sayuri Okayama
Editor's Notes
- #5: We have given presentations at universities in Hong Kong and Bangkok, as well as MIT, and were invited to present to VCs at TechCrunch .Shenzhen. On Monday our proposals for presentation at SXSW went online, and I hope yu will consider voting for us.
- #6: The book is a work in progress, shown here to indicate commitment. Bicycles have quickly made use of AR. However, the more I learned, the moe puzzled I became...
- #8: These ideas related to AR were not so difficult to understand...
- #9: These examples of AR were also not difficult to understand.
- #10: Situations like this, however, made me feel like I was missing something...
- #11: Location, in addition to the previous points about communication…. I felt I must have been missing something that everyone else understood.
- #12: What if the vehicle were moving? In the Nissan video we saw a digital avatar. But how would that work on terms of GPS/the AR cloud?
- #13: THIS WAS WHAT I HAPPILY DISCOVERED TWO WEEKS AGO! There was no master plan that I was unaware of. One needs to be built! Just like with railroads, just like with the electricity and with the internet..standards! Standards are now needed in AR...
- #14: There is a long and informative interview with four representatives from the Open Augmented Reality CLoud on this podcast. Recommended.
- #15: One way of representing what happens in the cloud.
- #16: Point cloud. There are many ways of creating point clouds. Standards would encourage maximum interoperability.
- #17: https://www.clarissewiki.com/3.6/creating_a_point_cloud.html
- #18: Geographic Information Services… How much of what is under the road do they have records of?
- #19: Magic Leap… here teh y present levels that include the IoT Internet of Things and AI
- #20: The Magicverse, another name for the totality of static and nonstatic AR clouds.
- #22: Microsoft Azure Spatial anchor systems. There can be an endless number of clouds. Interoperability. A browser. AI assisted browswers.
- #23: This is from the Open Augmented Reality Cloud group. Already some governing bodies are being formed.
- #24: I have yet to research California’s policies on the interoperability of those clouds associated with AVs.
- #29: Studies re being released more and more. For example how much driving information should be displayed to the passengers. Male or female driving avatars? Do passengers prefer traditional seating, so that they can face forward?
- #31: Can we create a form of entertainment in which the unique properties of AVs are use to create entertainment?
- #32: Yes! Although this is theoretical, this idea of a AV=centric musical is entirely possible. Allow me to just throw out some ideas about howDetroit can do something amazing!
- #33: The project defined.
- #34: SHenzhen, China converted the city into a backdrop for a lightshow….
- #35: The Fox theatre and a bitof AR tech talk….
- #36: An AR artwork by Jeff Koons, sponsored by Snapchat. Other AR sculpures went up around the world, including near the Eiffel Tower.
- #37: Augmented Reality could add layers of expression and information to this masterpiece by Dieg Rivera.
- #40: Back to bROADWAY… and we have discovered that the Fox Theatre is geofenced. Geofencing is a blocking out of access,. Militarru basis, sensitve areas...the interior of homes. The Fox tTheatre is copyrighted, I believe.
- #41: Motown, another cultural asset that could be included in bROADWAY.
- #42: AUgmenting reality can be done or many purposes, and utilize any kind of data. There is a great deal being done to use AR to assist those with diabilities. Autonomou vehcles will be very helpful for the blind.