au·ton·o·mous Trends | Tech | Future
3 likes527 views
This document discusses autonomous vehicle technology, including the key components of perception, planning, control, and coordination. It describes the various sensors used in autonomous vehicles like LIDAR, cameras, radar, and ultrasonics. It provides an overview of the levels of vehicle autonomy from driver assistance features to fully autonomous vehicles. It also includes summaries of the autonomous efforts of major automakers and tier 1 suppliers as well as comparisons of different LIDAR technologies.
au·ton·o·mous Trends | Tech | Future
- 1. au·ton·o·mous Trends | Tech | Future Siddharth Chakravarty
- 2. Autonomous system overview Environment Perception Planning Control Sensors Actuator Hardware Software Yes Maybe High chance of missing • Perception, Planning, Control, and Coordination (PPC) is challenging • Multiple sensory inputs complemented with different algos are required to avoid false positives & negatives V2V* *Coordination with other Autonomous vehicles • Perception - ability of the system to collect information • Localization - ability to determine position in environment. • Planning refers to decision making • Control - ability to execute the planned actions Environmental conditions can pose challenge on PPC
- 3. Sensor layout for autonomy Source: Design News, 2016 Driver assistance systems sensor integration Sensor complexity Speed Parking assist Day time urban driving Night time urban driving Night time Highway driving Highway lane-keeping • Sensors have different strengths and weaknesses. Sensor fusion is required to make full use of the advantages of each sensor, especially when speed , object appearance, and weather conditions can impact perception.
- 4. Sensor costs and state of technology LIDAR Cost: $1k - $70k Players: Velodyne, Conti, Innoviz, etc. Video Camera Cost: $125 - $200 Players: Bosch , Alps, Gentex RADAR Cost: $50 - $150 Players: TI, Conti, Bosch Infotainment Cost: $300 -$1500 Players: Denso, Alpine, Conti, Harman Ultrasonic Cost: $50 - $100 Players: TI, Infineon, NXP Software Cost: Players: NVDIA, Aptiv, Argo AI, Blackberry Connectivity Cost: $1k - $8k Players: LairdTech, Bosch, Panasonic Battery Cost: 200 -500 $/kWh Players:A123, Panasonic, Samsung Source: BCG, McKinsey, PWC With the exception of Ultrasonic sensor, Video camera and Radar, the remainder of the components are under development.
- 5. Levels Of Autonomy IMU + Pressure sensor Ultrasound Camera Radar LIDAR Advanced software/ Mapping Level 5 Full Automation Autonomous driving Level 4 High Automation Highly automated driving Stop and go (urban) Level 3 Conditional Automation Automated parking Highway assist Stop and go (highway) Level 2 Partial Automation Automated parking Lane-keep assist Level 1 Driver Assistance Park Assist and braking Adaptive Cruise Blind spot warning Lane Departure Level 0 No Assistance Airbag Abs Current state of technology Jump in complexity between Levels 2 and 3 is huge. LIDAR and Software are key ingredients for autonomy Level 4 and 5 autonomy is the “holy grail” for all automotive companies$ $ Refer to Appendix A Source: SAE, GM handout
- 6. LIDAR • Of all the autonomy sensor tech blocks, LIDAR has received the most attention with a flurry of investment and M&A activity. Primarily to capture the market space that was dominated by Velodyne. A key impetus has been to move away from the traditional mechanical systems to more compact devices • Over the past few years over startups, OEMs (slide 11) and Tier1 (slide 13) suppliers have sought to develop their own LIDAR tech mainly through acquisitions. LIDAR components Laser Detector Circuit Optics The LIDAR component technology is quite well developed. The main impetus is primarily on reconfiguration and optimization for form factor and reliability Current Trend 905 nm 1550 nm Why ? Improve range Silicon InGaAs Detect longer wavelength laser Most LIDAR companies are using Tier 1 components or in house built custom products LIDAR trend 10” 29 lbs. , 64 lasers $70K Mechanical system • Solid state • Micro mirror • Optical array 2.8” 0.5 lbs. , 16 lasers $1000 - $3000
- 7. Pure play Automotive LIDAR Field test LIDAR type Partnership Velodyne Waymo, Ford Mechanical Baidu, Ford, Autoliv, Daimler, PSAFlash Luminar Volvo, Audi Mechanical other Toyota Innoviz BMW MEMS BMW, Jabil, Magna Aeye MEMS Quanenergy OPA Hyundai, Jaguar Land Rover and Renault-Nissan , Aptiv, NVIDIA Leddar Tech Flash Aptiv, Magneti Marelli Oryx Flash Nutonomy Ouster Mechanical other NVIDIA Tetravue Flash Bosch, Samsung Innovusion LiDAR+ Camera LIDAR technology SCANNING NON SCANNING Mechanical Non Mechanical Mechanical other OPA FMCW OPA: Optical phased array, FMCW: Frequency modulated, continuous wave, MEMS: micro-electro mechanical systems MEMS Flash • Over 50+ companies today existing in the LIDAR space developing technology for Automobiles to Drones. However only 9 of these are pure play LIDAR companies geared for the autonomous automotive market. • Refer to Appendix B for details
- 8. Autonomy scorecard – OEMs Autonomy deployment Acquisitions/ Investment Partnerships Vehicle platform GM 2019 • Cruise Automation • Strobe LIDAR • Lyft for ride sharing acquired 9% stake • Honda for EV and fuel cells Chevrolet Bolt Ford 2021 • Argo AI • SAIPS • Princeton Lightwave acquisition LIDAR • $150 million in Velodyne • Civil Maps • Nirenberg Neuroscience Ford Fusion Toyota 2020 • Jaybridge Robotics Team for TRI-AD for internal software • Nauto investment along with BMW and Allianz. • LIDAR Quanergy • Uber • NVIDA • Velodyne Hyundai 2020 • Perceptive Automata • Migo (ride share) • SMS, ASTYX, Aurora Samsung Hyundai Nexo
- 9. Autonomy scorecard – OEMs Autonomy deployment Acquisitions/Investments Partnerships Vehicle platform BMW 2021 • Innoviz and Blackmore Sensors and Analytics for LIDAR • Here Technologies (VW + Daimler) • Fiat Chrysler, Intel, Aptiv, Magna, Lyft (indirectly), Continental New EV Nissan 2021 • NASA, Renault, Mitsubishi, DeNA , Intel Mobileye Leaf Volkswagen Group 2022 • Here Technologies (Daimler + BMW) • Intel Mobileye, Luminar (LIDAR), NVIDIA, Aurora, Hyundai Multiple Honda • Waymo, GM and Baidu New EV / Acura Daimler 2020 • Mytaxi, Taxibeat • Here Technologies (BMW + VW) • Bosch, NVIDIA, Baidu, Velodyne, Quanergy S500
- 10. Autonomy scorecard – Tier 1 Autonomy deployment Acquisitions/Investments Partnerships LIDAR Rideshare/ Apps Mapping Lighting Info. Software Bosch 2020 with Daimler SPLT Here Tech DEEPMAP • Daimler, NVIDIA (chip), TomTom (mapping), Sony (image), Baidu Conti 2020 Cruising Chauffeur Adv. Scientific Concepts Inc Easymile Parkpocket Here Tech OSRAM Digilens Elektrobit Kathrein Quantum Inventions • Baidu, EasyMile, Unicom China, Docomo Delphi (APTIV) NuTonomy Ottomatika Control-Tec Movimento • Velodyne, NVDIA, Lyft, Grab, BMW Magna Innoviz Olsa Haptronik Telemotive Zubie • Lyft, Beijing Electric Vehicle, May Mobility
- 11. Autonomy scorecard – Tier 1 Autonomy deployment Acquisitions/Investments Partnerships LIDAR Rideshare/ Apps Mapping Lighting Info. Software Valeo Audi A8 2018 Drive4U® 2018 • LeddarTech, Navya Autoliv Volvo Fotonic ASTYX Zenuity • Velodyne, NVIDIA, seeingmachines Denso RideCell Dellfer Activescalar NRI Secure • Infineon (minority) ZF 2019 Ibeo • ZF owns 40% of Ibeo
- 12. The Race To Autonomy • GM is clearly the pack leader through acquisitions in hardware tech, platform and fuel technology along with strategic partnerships. • BMW and VW Group are a close second who are competing to create self-driving cars and integrating them into ride services fleets. • The Japanese companies have taken more of a wait and see approach, and are shying away from taking on expensive ventures that may not return profits in the near term • Tier 1 suppliers Continental and Bosch, are spreading their bets across the entire autonomous technology supply chain. In addition to making investments in hardware, Continental has been investmenting in the software and ride sharing space. • Other players such as Autoliv, Denso and Manga have also relied on software to further bolster their autonomous vehicle strategy • LIDAR, Software and Mapping companies top the acquisition list, along with partnership with ride hailing companies for many of the Tier 1 and OEMs.
- 13. Appendix A • Volkswagen Group of America • Mercedes Benz • Waymo LLC • Delphi Automotive • Tesla Motors • Bosch • Nissan • GM Cruise LLC • BMW • Honda • Ford • Zoox, Inc. • Drive.ai, Inc. • Faraday & Future Inc. • Baidu USA LLC • Valeo North America, Inc. • NIO USA, Inc. • Telenav, Inc. • NVIDIA Corporation • AutoX Technologies Inc • Subaru • Udacity, Inc • Navya Inc. • Renovo.auto • PlusAi Inc • Nuro, Inc • CarOne LLC • Apple Inc. • Pony.AI • TuSimple • Innovation Center, LLC • Almotive Inc • Aurora Innovation • Nullmax • Samsung Electronics • Continental Automotive Systems Inc • Voyage • CYNGN, Inc • Roadstar.Ai • Changan Automobile • Lyft, Inc. • Phantom AI • Apex.Al • Intel Corp • Ambarella Corporation • Gatik AI. Inc. • DiDi Research America LLC • TORC Robotics Inc • Boxbot Inc • EasyMile • Mando America Corporation • Xmotors.ai, Inc. • Imagry Inc. • Ridecell Inc. • AAA NCNU • Qualcomm Technologies, Inc. • aiPod, Inc. • SF Motors Inc. • ThorDrive Inc • Helm.AI Inc • Toyota Research Institute Permit Holders (Testing with a Driver) : As of December 7, 2018, DMV California has issued Autonomous Vehicle Testing Permits (with a driver) to the following entities
- 14. Appendix B LIDAR companies product offering Company Component/System Product offering TriLumina Laser Illumuniation module for LIDAR applications using vertical-cavity surface-emitting laser semi-conductor laser Voxtel Laser+Detector LIDAR laser and detector supplier Blackmore Sensors and Analytics LDAR 3D Imaging Lidar Solutions. Frequency-modulated continuous wave lidar imaging Velodyne LiDAR LIDAR Leading developer, manufacturer and supplier of high performance LiDAR sensors. Luminar Technologies Inc. LIDAR Producing advanced sensor technologies for the autonomous vehicle industry. Quanergy Systems Inc. LIDAR LiDAR sensors and software to capture and process real-time 3D mapping data. Oryx Vision LIDAR Solid state depth vision solutions for autonomous vehicles. Based on a radically innovative depth-sensing technology Innoviz.tech LIDAR Solid state with software for customized object detection. Colloboration Jabil, Delphi, Aptiv Aeye.ai LIDAR+Camera Combines LIDAR with computer vision to enable mapping of 3D cloud points to 2D computer vision Cepton LIDAR Uses micro motion instead of rotation mirrors and industry lightest system. Currently for Drone application, Automotive is also ongoing Ibeo LIDAR Specialist for automotive LIDAR sensor Innovusion LIDAR+Camera LiDAR raw data with camera video in the hardware layer which dramatically reduces latency, increases computing efficiency and creates a superior sensor experience. Image grade LiDAR. sensor systems for the level 4 and 5. Former Baidu and Velodyne employees Ouster Inc LIDAR Cost, weight, size - claims to have 64 beams for better resolution TetraVue LIDAR Solid state LIDAR - not much informationa available Robosense LIDAR MEMS solid-state LiDAR and OPA solid-state LiDAR. Claims to be market leader for LIDAR in China
- 15. Appendix B LIDAR companies product offering Company Component/System Product offering Valeo LIDAR Solid state LIDAR Ledder Tech LIDAR Solid state + MEMS LiDAR, Magneti Marelli stake TeleDyne LIDAR Industrial product for mapping and surveying Kaarta LIDAR Handheld Mapping devices Riegl USA LIDAR Indudstrial products for mapping and surveying Strobe Inc LIDAR Acquired by GM Argo AI LIDAR+AI Investment by Ford, acquired Lighwave Harris LIDAR Mutiple LIDAR products Analog Devices LIDAR Acquired Vescent photonics to develop ADAS Paracosm LIDAR Outdoor mapper Spectrolab LIDAR Boeing company Holosense LIDAR solid-state lidar based on metamaterials technology. Newsight Imaging LIDAR CMOS Image Sensor-Based Chips and LiDAR in collaboration LeiShen and Tier-1 and Automotive OEM Neptec Technologies LIDAR Industrial LIDAR- funded by NASA and the Canadian Space Agency Advanced Scientific Concepts LIDAR Acquired by continental
- 16. Appendix B LIDAR companies product offering Company Component/System Product offering Blickfeld LIDAR+AI Blickfeld develop and sell LiDAR sensors and provide the software to interpret complex 3d point clouds. Mapper.ai Mapping Machine readable mapping software Woolpert Mapping GIS/Mapping services for various applications Dewberry Mapping GIS/Mapping services for various applications DeepMap Mapping HD mapping service using customer data Dipper 3D Mapping Dronely Mapping LiDAR or 3D photogrammetry service USHR Mapping High-definition map technology- acquired Geodigital Lizardtech Mapping Software company that generates and processes LIDAR data to generate maps lvl5, Inc. Mapping Crowdsource vision data for Maps Mandli Communications Mapping GIS mapping service Point One Navigation Mapping Localization service Bluesky International Mapping GIS data for a range of survey, geographic and CAD data. Innocule MEMS Mirror MEMS Mirror for LIDAR, Acuired by Infineon + Osram Laser Microvision MEMS Mirror MEMS mirror for projector and LiDAR
- 17. Appendix B LIDAR companies product offering Company Component/System Product offering Arbe Robotics RADAR 4D radar system Diabotics Software LIDAR software Aptiv Software Delphi spin-off, software for Lyft, Innovate, & LeddarTech Phaontom.ai Software LIDAR software nutonomy Software Acquired by Delphi, Partner with Lyft and Groupe PSA Pixeva Software AI platform analytics - NVDIA