SlideShare a Scribd company logo
A Presentation on
Human Computer Interaction in
autonomous vehicles :Challenges
and Solutions
Presented By: Sanya Pandey
Roll no-202110101210003
BSC IT (AI)
Presented To-Abhijitya Sir
CONTENTS
 Introduction
 Different Level Of
Automation
 Proposed System
 Challenges
 Conclusion
 References
INTRODUCTION
NHTSA : “Vehicles, in which some controlling
functions are carried out w/o direct physical input.”
Sensing Environment through IR and Ultrasonic rays,
image processing, global positioning system, RADAR
etc.
The controller is designed to gather data from all
units and analyze it thoroughly to find the perfect
path for vehicle along with obstacles.
Different levels of Automation
Level 0: No automation at all.
Level 1:Cruise Control, Park assist
Level 2: Adaptive cruise control, lane assist
Level 3:Automation for limited environments
Level 4: Unable to perform is severe conditions
Level 5: Enter destination. That’s all!!
PROPOSED SYSTEM
1) While Overtaking The Other Vehicle:
Overtaking is an important part of driving especially
when it comes to autonomous driving.
Overtaking the other vehicle
 It calculates relative velocity along with changing
current lane in order to avoid collision.
 Velocity of our vehicle should be increased in
accordance with others
 Scenario can change drastically if error occurs
 Driver is required to pay attention at all the times
during this scenario.
1. Use of Graphical Display
 The display can show live streaming of road map
along with detected obstacles as well as other
cars.
 The controller can also input lane status to the
display.
 Highlight nearest cars in front of the vehicle and
behind the vehicle along with their distance from
vehicle and velocities.
Operating radius of vehicle
Above figure shows the operating radius (Red
circle) of the vehicle which is the space occupied
by the vehicle if turned in all directions.
Grey pentagon represents vehicle. Yellow lines
are for lanes.
1.2 Voice Message
 Vehicle will be shifting from automated mode
to normal mode as soon as driver takes the
control which in-turn will give an accelerator and
brake in diver’s command as well.
 While sending out a voice message through
infotainment systems the pitch and volume level
should be mainlined such that driver will give
full attention to it
2) While changing
lanes :
Change of lanes often occurs while taking
diversion, changing speed, over taking
another vehicle etc.
Lane changing scenario while taking diversion
General lane changing scenario
Image processing is used to detect separators.
Availability of lanes in on both the sides along
with obstacles
Alerting for wrong way
1. Use of Graphical Display
 Though live streaming is not required, we can
have a system on user demand.
 Distance from obstacles on both the sides along
with front and back clearance.
 If the clearance reaches minimum threshold user
will be alerted by flashing that obstacle.
1.3 Flashing Button
 In addition to these features, we can have a
button on screen with siren.
 This should be large in size and perfectly
visible to user
 Flashes when minimum threshold is reached.
Challenges
HMI signals should be fast. User actions are
dependent on them.
Multiple conflicts should be given priority
dynamically. Overtaking on straight road versus on
mountain road.
 The voice command from the system should be loud
and clear.
 The voice command can be generated in multiple
languages as user is not bound to understand one
common language.
Conclusion
 Alerting system should be improved using
combination of HMI techniques in Level 1,2 and 3 of
automation.
This will include new form of graphical display, voice
messages and flashing buttons.
A new term of operating radius can be introduced on
display.
References
 Gomes, Lee (28 August 2014). "Hidden Obstacles for
Google's Self-Driving Cars". MIT Technology Review.
Retrieved 22 January 2015.
 Abuelsamid, Sam (2016-07-01). "Tesla Autopilot Fatality
Shows Why Lidar And V2V Will Be Necessary for
Autonomous Cars". Forbes. Retrieved 2016- 07-01.
 GOOGLE
 YOUTUBE
PPT. Sx jarvis vitual assistant ai project

More Related Content

PDF
Practical Challenges to Deploying Highly Automated Vehicles
PDF
AUTONOMOUS VEHICLES 2.pdf
PPTX
2014 MATC Spring Lecture Series: Chris Schwarz
PPTX
Trends in Auto Tech
PDF
Sergejs Dombrovskis - Implementation and real-traffic assessment of a new inf...
PPTX
Automated Driving - Richard Schram - October 2018
PDF
IRJET- Study of Automated Highway System
PDF
Smartphone based ADAS
Practical Challenges to Deploying Highly Automated Vehicles
AUTONOMOUS VEHICLES 2.pdf
2014 MATC Spring Lecture Series: Chris Schwarz
Trends in Auto Tech
Sergejs Dombrovskis - Implementation and real-traffic assessment of a new inf...
Automated Driving - Richard Schram - October 2018
IRJET- Study of Automated Highway System
Smartphone based ADAS

Similar to PPT. Sx jarvis vitual assistant ai project (20)

PDF
Tendencias: Cómo nos va a afectar el Internet de las cosas - Self Driving Car...
PDF
Car HMi USA 2016 - Post Event Report
PPTX
Autonomous Industry Feedback
PDF
An OSGi based HMI for networked vehicles - Miguel García Longarón, TID
PPTX
firefighting robot embedded system project
PDF
ppt of v2v.pdf last year final project entc
PPTX
The Arduino Self-Driven Car is a project comprised by a car chassis
PDF
Autonomous Vehicles
PDF
Smart Enabling Technologies for Automated Driving
PPTX
Vehicular ad hoc network - VANET
PPTX
Driverless car
PPT
Will Cars Always Be Cars
PDF
I Car2.0
PPTX
Connected and Automated Vehicles: Where Are We Going and What Happens When We...
PPTX
Real time Driverless vehicles
DOCX
mechatronics - assignment 2
PDF
DRIVER ASSISTANCE FOR HEARING IMPAIRED PEOPLE USING AUGMENTED REALITY
PDF
sr5108
PPTX
Autonomous or self driving cars
PPTX
Driverless cars
Tendencias: Cómo nos va a afectar el Internet de las cosas - Self Driving Car...
Car HMi USA 2016 - Post Event Report
Autonomous Industry Feedback
An OSGi based HMI for networked vehicles - Miguel García Longarón, TID
firefighting robot embedded system project
ppt of v2v.pdf last year final project entc
The Arduino Self-Driven Car is a project comprised by a car chassis
Autonomous Vehicles
Smart Enabling Technologies for Automated Driving
Vehicular ad hoc network - VANET
Driverless car
Will Cars Always Be Cars
I Car2.0
Connected and Automated Vehicles: Where Are We Going and What Happens When We...
Real time Driverless vehicles
mechatronics - assignment 2
DRIVER ASSISTANCE FOR HEARING IMPAIRED PEOPLE USING AUGMENTED REALITY
sr5108
Autonomous or self driving cars
Driverless cars
Ad

Recently uploaded (20)

DOCX
Copy-OT LIST 12.8.25.docxjdjfufufufufuuffuf
PPTX
PLC ANALOGUE DONE BY KISMEC KULIM TD 5 .0
PPTX
rorakshsjppaksvsjsndjdkndjdbdidndjdbdjom.pptx
PDF
Maxon CINEMA 4D 2025 Crack Free Download Latest Version
PDF
ICT grade for 8. MATATAG curriculum .P2.pdf
PDF
2- Physical Layer (06).pdfgshshshbsbshshshhs
PDF
Topic-1-Main-Features-of-Data-Processing.pdf
PPTX
Grade 10 System Servicing for Hardware and Software
PPTX
RTS MASTER DECK_Household Convergence Scorecards. Use this file copy.pptx
PDF
Presented by ATHUL KRISHNA.S_20250813_191657_0000.pdf
PDF
2_STM32&SecureElements2_STM32&SecureElements
PPTX
AIR BAG SYStYEM mechanical enginweering.pptx
PPTX
Subordinate_Clauses_BlueGradient_Optimized.pptx
PDF
20A LG INR18650HJ2 3.6V 2900mAh Battery cells for Power Tools Vacuum Cleaner
PPTX
Presentation 1.pptxnshshdhhdhdhdhdhhdhdhdhd
PDF
Tcl Scripting for EDA.pdf
PPTX
unit1d-communitypharmacy-240815170017-d032dce8.pptx
PPTX
Unit-1.pptxgeyeuueueu7r7r7r77r7r7r7uriruru
PPTX
New professional education PROF-ED-7_103359.pptx
PPTX
Group 4 [BSIT-1C] Computer Network (1).pptx
Copy-OT LIST 12.8.25.docxjdjfufufufufuuffuf
PLC ANALOGUE DONE BY KISMEC KULIM TD 5 .0
rorakshsjppaksvsjsndjdkndjdbdidndjdbdjom.pptx
Maxon CINEMA 4D 2025 Crack Free Download Latest Version
ICT grade for 8. MATATAG curriculum .P2.pdf
2- Physical Layer (06).pdfgshshshbsbshshshhs
Topic-1-Main-Features-of-Data-Processing.pdf
Grade 10 System Servicing for Hardware and Software
RTS MASTER DECK_Household Convergence Scorecards. Use this file copy.pptx
Presented by ATHUL KRISHNA.S_20250813_191657_0000.pdf
2_STM32&SecureElements2_STM32&SecureElements
AIR BAG SYStYEM mechanical enginweering.pptx
Subordinate_Clauses_BlueGradient_Optimized.pptx
20A LG INR18650HJ2 3.6V 2900mAh Battery cells for Power Tools Vacuum Cleaner
Presentation 1.pptxnshshdhhdhdhdhdhhdhdhdhd
Tcl Scripting for EDA.pdf
unit1d-communitypharmacy-240815170017-d032dce8.pptx
Unit-1.pptxgeyeuueueu7r7r7r77r7r7r7uriruru
New professional education PROF-ED-7_103359.pptx
Group 4 [BSIT-1C] Computer Network (1).pptx
Ad

PPT. Sx jarvis vitual assistant ai project

  • 1. A Presentation on Human Computer Interaction in autonomous vehicles :Challenges and Solutions Presented By: Sanya Pandey Roll no-202110101210003 BSC IT (AI) Presented To-Abhijitya Sir
  • 2. CONTENTS  Introduction  Different Level Of Automation  Proposed System  Challenges  Conclusion  References
  • 3. INTRODUCTION NHTSA : “Vehicles, in which some controlling functions are carried out w/o direct physical input.” Sensing Environment through IR and Ultrasonic rays, image processing, global positioning system, RADAR etc. The controller is designed to gather data from all units and analyze it thoroughly to find the perfect path for vehicle along with obstacles.
  • 4. Different levels of Automation Level 0: No automation at all. Level 1:Cruise Control, Park assist Level 2: Adaptive cruise control, lane assist Level 3:Automation for limited environments Level 4: Unable to perform is severe conditions Level 5: Enter destination. That’s all!!
  • 5. PROPOSED SYSTEM 1) While Overtaking The Other Vehicle: Overtaking is an important part of driving especially when it comes to autonomous driving. Overtaking the other vehicle
  • 6.  It calculates relative velocity along with changing current lane in order to avoid collision.  Velocity of our vehicle should be increased in accordance with others  Scenario can change drastically if error occurs  Driver is required to pay attention at all the times during this scenario.
  • 7. 1. Use of Graphical Display  The display can show live streaming of road map along with detected obstacles as well as other cars.  The controller can also input lane status to the display.  Highlight nearest cars in front of the vehicle and behind the vehicle along with their distance from vehicle and velocities.
  • 8. Operating radius of vehicle Above figure shows the operating radius (Red circle) of the vehicle which is the space occupied by the vehicle if turned in all directions. Grey pentagon represents vehicle. Yellow lines are for lanes.
  • 9. 1.2 Voice Message  Vehicle will be shifting from automated mode to normal mode as soon as driver takes the control which in-turn will give an accelerator and brake in diver’s command as well.  While sending out a voice message through infotainment systems the pitch and volume level should be mainlined such that driver will give full attention to it
  • 10. 2) While changing lanes : Change of lanes often occurs while taking diversion, changing speed, over taking another vehicle etc. Lane changing scenario while taking diversion
  • 11. General lane changing scenario Image processing is used to detect separators. Availability of lanes in on both the sides along with obstacles Alerting for wrong way
  • 12. 1. Use of Graphical Display  Though live streaming is not required, we can have a system on user demand.  Distance from obstacles on both the sides along with front and back clearance.  If the clearance reaches minimum threshold user will be alerted by flashing that obstacle.
  • 13. 1.3 Flashing Button  In addition to these features, we can have a button on screen with siren.  This should be large in size and perfectly visible to user  Flashes when minimum threshold is reached.
  • 14. Challenges HMI signals should be fast. User actions are dependent on them. Multiple conflicts should be given priority dynamically. Overtaking on straight road versus on mountain road.  The voice command from the system should be loud and clear.  The voice command can be generated in multiple languages as user is not bound to understand one common language.
  • 15. Conclusion  Alerting system should be improved using combination of HMI techniques in Level 1,2 and 3 of automation. This will include new form of graphical display, voice messages and flashing buttons. A new term of operating radius can be introduced on display.
  • 16. References  Gomes, Lee (28 August 2014). "Hidden Obstacles for Google's Self-Driving Cars". MIT Technology Review. Retrieved 22 January 2015.  Abuelsamid, Sam (2016-07-01). "Tesla Autopilot Fatality Shows Why Lidar And V2V Will Be Necessary for Autonomous Cars". Forbes. Retrieved 2016- 07-01.  GOOGLE  YOUTUBE