SlideShare a Scribd company logo
REALTIME
OBJECT DETECTION
AND
NAVIGATION
" Vision Assistance Device with
Embedded Object Recognition for
Enhanced Mobility "
PROBLEM STATEMENT
Roadmap
SEM 3
Final
SEM 5
SEM 4
• Model Training
• Real-Time Implementation
• Performance Evaluation
One Object Detection
• Sensor Integration
• Simulation
• Prototype Development
Navigation and Integration
• User Interface
• Field Testing
Final Documentation
• Literature Review
• Skill Development
• Dataset Collection
Foundations and Research
• Identifying clothes, cooking safely, and maintaining hygiene are challenging without vision.
• Visually impaired individuals struggle with perception, especially outdoors where objects constantly change and move.
• They cannot see vehicles to determine when it’s safe to cross the street.
• They may not see crosswalk lines or other road markings that indicate safe crossing points.
• They cannot see people, animals, or vehicles moving toward them, making it difficult to avoid collisions.
• Blind individuals struggle to detect obstacles like poles, benches, or bicycles, risking collisions and injuries.
• Overhead obstacles like branches or signboards pose a danger, as they can't be detected by touch or sound, risking head injuries.
• Quieter electric and hybrid vehicles are a serious risk for blind individuals who may not hear them when crossing streets.
• In crowded places like markets, blind individuals struggle to avoid collisions as they can't see the flow of people.
• Blind individuals may struggle with accurately managing medication dosages and schedules.
ACTUAL PROBLEMS FACED BY BLIND PEOPLE
1. They rely on human assistance for guidance, a practice since the dawn of mankind.
2. Service dogs have aided visually impaired individuals with companionship and obstacle
avoidance since world war-I.
3. White canes, in use since world war-II, help detect obstacles through tactile feedback.
4. Braille blocks, introduced in 1965, provide tactile indicators for navigating public spaces.
5. The hoople, available since 1990, aids in identifying obstacles and navigating uneven terrain.
6. Smart canes integrate technology to detect obstacles and enhance mobility.
7. Solar-powered canes, a future innovation, will combine sustainable energy with advanced
mobility support.
8. Smart blind stick :- A stick which detect an objects in certain area and give output as a alert
sound through buzzer.
9. In present time some applications are available in market they are very costly.
PRESENT TIME SOLUTIONS
Source :- ScienceDirect
 The smart navigation system for the visually impaired works by capturing images from a camera attached to the user.
 These images are sent to a Raspberry Pi, a small computer that processes them.
 First, the images are saved, and then they are improved for better clarity. The system looks at the images to find objects around
the user, like walls or other obstacles. It also measures how far these objects are from the user.
 Based on this information, the Raspberry Pi creates audio messages and text alerts to tell the user
what’s around them.
 This information is then sent back to the user through sound, like headphones or a small speaker, helping them know
where obstacles are.
 The whole process allows the user to move safely and confidently.
 The device keeps checking and updating in real-time, making it more helpful than regular navigation aids. It helps visually
impaired individuals feel more secure and independent while walking in different environments.
Working Principle
01 Image Capture
STEP 1
03 Image Enhancement
STEP 3
05 Audio Feedback
STEP 5
02
Processing Unit.
STEP 2
04
Object Detection.
STEP 4
06
Real-Time Updates
STEP 6
FLOW CHART
 Microcontroller/Embedded System: Arduino, Raspberry Pi
 Camera Module: A camera module compatible with microcontroller (e.g., Raspberry Pi
Camera Module or USB Webcam).
 Object Recognition Software: Libraries such as TensorFlow, OpenCV, or YOLO for object
detection and recognition.
 Ultrasonic Sensors: For obstacle detection and distance measurement (e.g., HC-SR04).
 Communication and Output Components Speaker or Audio Output Module: For
providing auditory feedback (e.g., small speaker or buzzer).
 Bluetooth or Wi-Fi Module: For wireless communication and data transfer (e.g., HC-05
Bluetooth module or Wi-Fi module).
 Battery Pack: To power the entire system (e.g., Li-Po or rechargeable battery). For storing
data or logs if needed.
 SD Card (Optional): For storing data or logs if needed.
COMPONENTS
python
Database
Microcontroller
Input
Programing
language
MongoDB
Raspberry Pi
Output
External camera
Real-time Monitoring
Providesimmediateobjectdetectionand
response.
01.
Cost-Effective
Reducestheneedforcomplexhardwareby
leveragingsoftware-baseddetection.
03.
Improved Safety
Reducesrisksindynamicenvironmentswith
real-timeobstacledetection.
05.
Affordability
RaspberryPi-basedsolutionsarecost-effective
comparedtospecializeddevices.
07.
Hands-free Control
Facilitatesvoice-basedorautomated
navigationcommands.
02.
Real-time Precision
Enhanced real-time detection and navigation
withoutdelaysfoundinsomemarketdevices.
04.
Seamless Integration
Easiertointegratewithothersmartdevices.
06.
Empowerment
Enhancesindependenceandconfidence
inmobility.
08.
BENEFITS

More Related Content

PDF
RASPBERRY PI BASED SMART WALKING STICK FOR VISUALLY IMPAIRED PERSON
PDF
IRJET- Virtual Eye for Visually Blind People
PDF
IRJET - Smart E – Cane for the Visually Challenged and Blind using ML Con...
PDF
Visual, navigation and communication aid for visually impaired person
PDF
ARTIFICIAL INTELLIGENCE BASED SMART NAVIGATION SYSTEM FOR BLIND PEOPLE
PDF
IRJET - Smart Vision System for Visually Impaired People
PDF
IRJET- A Leading Hand for the Blind –A Review
PPTX
Updated_Obstacle_Detection_Cane_Literature_Review.pptx
RASPBERRY PI BASED SMART WALKING STICK FOR VISUALLY IMPAIRED PERSON
IRJET- Virtual Eye for Visually Blind People
IRJET - Smart E – Cane for the Visually Challenged and Blind using ML Con...
Visual, navigation and communication aid for visually impaired person
ARTIFICIAL INTELLIGENCE BASED SMART NAVIGATION SYSTEM FOR BLIND PEOPLE
IRJET - Smart Vision System for Visually Impaired People
IRJET- A Leading Hand for the Blind –A Review
Updated_Obstacle_Detection_Cane_Literature_Review.pptx

Similar to Design Engineeing project presentation for (20)

PPTX
Updated_Obstacle_Detection_Cane_Literature_Review.pptx
PDF
Obstacle Detection for Visually Impaired Using Computer Vision
PDF
IRJET - For(E)Sight :A Perceptive Device to Assist Blind People
DOCX
23090120014_Ahmad Lutfi Nur Wahid_Tugas Sanitasi.docx
PDF
Smart Navigation Assistance System for Blind People
PDF
Paper_39-SRAVIP_Smart_Robot_Assistant_for_Visually_Impaired.pdf
PDF
IRJET- Smart Helmet for Visually Impaired
PPTX
Obstacle_Detection_Cane_Literature_Review.pptx
PPTX
Obstacle_Detection_Cane_Literature_Review.pptx
PDF
Obstacle Detection and Navigation system for Visually Impaired using Smart Shoes
PDF
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
PDF
Navigation Assistance for Visually Challenged People
PDF
"Assistive Technology for the Visually Impaired," a Presentation from UC Sant...
PDF
IRJET- VI Spectacle – A Visual Aid for the Visually Impaired
PDF
Sanjaya: A Blind Assistance System
PDF
IRJET- Assistant Systems for the Visually Impaired
PPTX
IEEE Conference paper ppt Smart Assistive Navigation Devices for Visually imp...
PDF
DRISHTI – A PORTABLE PROTOTYPE FOR VISUALLY IMPAIRED
PPTX
Final year presentation for FYP Engineering Electrical 22
PDF
Voice Assistance Blind Stick Using Raspberry Pi And Machine Learning
Updated_Obstacle_Detection_Cane_Literature_Review.pptx
Obstacle Detection for Visually Impaired Using Computer Vision
IRJET - For(E)Sight :A Perceptive Device to Assist Blind People
23090120014_Ahmad Lutfi Nur Wahid_Tugas Sanitasi.docx
Smart Navigation Assistance System for Blind People
Paper_39-SRAVIP_Smart_Robot_Assistant_for_Visually_Impaired.pdf
IRJET- Smart Helmet for Visually Impaired
Obstacle_Detection_Cane_Literature_Review.pptx
Obstacle_Detection_Cane_Literature_Review.pptx
Obstacle Detection and Navigation system for Visually Impaired using Smart Shoes
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
Navigation Assistance for Visually Challenged People
"Assistive Technology for the Visually Impaired," a Presentation from UC Sant...
IRJET- VI Spectacle – A Visual Aid for the Visually Impaired
Sanjaya: A Blind Assistance System
IRJET- Assistant Systems for the Visually Impaired
IEEE Conference paper ppt Smart Assistive Navigation Devices for Visually imp...
DRISHTI – A PORTABLE PROTOTYPE FOR VISUALLY IMPAIRED
Final year presentation for FYP Engineering Electrical 22
Voice Assistance Blind Stick Using Raspberry Pi And Machine Learning
Ad

More from ArpitaPatel527902 (7)

PPT
ch8Bkdeedch aporbobotlity of the machine l
PPT
Classifier_1ch8 machine learning and deep
PPT
Exper_Machine Learning Data analysis data.ppt.ppt
PPT
Exper_Machine Learning Experimental data.ppt
PPTX
Unit 1 Fundamenatal of AI_1 for 1st year .pptx
PPTX
PythonPPT_Raj Programming for 1st year .pptx
PPTX
object detetion with voice description.pptx
ch8Bkdeedch aporbobotlity of the machine l
Classifier_1ch8 machine learning and deep
Exper_Machine Learning Data analysis data.ppt.ppt
Exper_Machine Learning Experimental data.ppt
Unit 1 Fundamenatal of AI_1 for 1st year .pptx
PythonPPT_Raj Programming for 1st year .pptx
object detetion with voice description.pptx
Ad

Recently uploaded (20)

PPTX
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
PDF
COURSE DESCRIPTOR OF SURVEYING R24 SYLLABUS
PDF
Soil Improvement Techniques Note - Rabbi
PDF
22EC502-MICROCONTROLLER AND INTERFACING-8051 MICROCONTROLLER.pdf
PPTX
Safety Seminar civil to be ensured for safe working.
PPT
INTRODUCTION -Data Warehousing and Mining-M.Tech- VTU.ppt
PDF
737-MAX_SRG.pdf student reference guides
PDF
EXPLORING LEARNING ENGAGEMENT FACTORS INFLUENCING BEHAVIORAL, COGNITIVE, AND ...
PPTX
CURRICULAM DESIGN engineering FOR CSE 2025.pptx
PPTX
Module 8- Technological and Communication Skills.pptx
PDF
Visual Aids for Exploratory Data Analysis.pdf
PPTX
Current and future trends in Computer Vision.pptx
PPTX
Fundamentals of safety and accident prevention -final (1).pptx
PPTX
6ME3A-Unit-II-Sensors and Actuators_Handouts.pptx
PDF
III.4.1.2_The_Space_Environment.p pdffdf
PDF
null (2) bgfbg bfgb bfgb fbfg bfbgf b.pdf
PPTX
Software Engineering and software moduleing
PDF
PREDICTION OF DIABETES FROM ELECTRONIC HEALTH RECORDS
PPTX
"Array and Linked List in Data Structures with Types, Operations, Implementat...
PDF
R24 SURVEYING LAB MANUAL for civil enggi
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
COURSE DESCRIPTOR OF SURVEYING R24 SYLLABUS
Soil Improvement Techniques Note - Rabbi
22EC502-MICROCONTROLLER AND INTERFACING-8051 MICROCONTROLLER.pdf
Safety Seminar civil to be ensured for safe working.
INTRODUCTION -Data Warehousing and Mining-M.Tech- VTU.ppt
737-MAX_SRG.pdf student reference guides
EXPLORING LEARNING ENGAGEMENT FACTORS INFLUENCING BEHAVIORAL, COGNITIVE, AND ...
CURRICULAM DESIGN engineering FOR CSE 2025.pptx
Module 8- Technological and Communication Skills.pptx
Visual Aids for Exploratory Data Analysis.pdf
Current and future trends in Computer Vision.pptx
Fundamentals of safety and accident prevention -final (1).pptx
6ME3A-Unit-II-Sensors and Actuators_Handouts.pptx
III.4.1.2_The_Space_Environment.p pdffdf
null (2) bgfbg bfgb bfgb fbfg bfbgf b.pdf
Software Engineering and software moduleing
PREDICTION OF DIABETES FROM ELECTRONIC HEALTH RECORDS
"Array and Linked List in Data Structures with Types, Operations, Implementat...
R24 SURVEYING LAB MANUAL for civil enggi

Design Engineeing project presentation for

  • 2. " Vision Assistance Device with Embedded Object Recognition for Enhanced Mobility " PROBLEM STATEMENT
  • 3. Roadmap SEM 3 Final SEM 5 SEM 4 • Model Training • Real-Time Implementation • Performance Evaluation One Object Detection • Sensor Integration • Simulation • Prototype Development Navigation and Integration • User Interface • Field Testing Final Documentation • Literature Review • Skill Development • Dataset Collection Foundations and Research
  • 4. • Identifying clothes, cooking safely, and maintaining hygiene are challenging without vision. • Visually impaired individuals struggle with perception, especially outdoors where objects constantly change and move. • They cannot see vehicles to determine when it’s safe to cross the street. • They may not see crosswalk lines or other road markings that indicate safe crossing points. • They cannot see people, animals, or vehicles moving toward them, making it difficult to avoid collisions. • Blind individuals struggle to detect obstacles like poles, benches, or bicycles, risking collisions and injuries. • Overhead obstacles like branches or signboards pose a danger, as they can't be detected by touch or sound, risking head injuries. • Quieter electric and hybrid vehicles are a serious risk for blind individuals who may not hear them when crossing streets. • In crowded places like markets, blind individuals struggle to avoid collisions as they can't see the flow of people. • Blind individuals may struggle with accurately managing medication dosages and schedules. ACTUAL PROBLEMS FACED BY BLIND PEOPLE
  • 5. 1. They rely on human assistance for guidance, a practice since the dawn of mankind. 2. Service dogs have aided visually impaired individuals with companionship and obstacle avoidance since world war-I. 3. White canes, in use since world war-II, help detect obstacles through tactile feedback. 4. Braille blocks, introduced in 1965, provide tactile indicators for navigating public spaces. 5. The hoople, available since 1990, aids in identifying obstacles and navigating uneven terrain. 6. Smart canes integrate technology to detect obstacles and enhance mobility. 7. Solar-powered canes, a future innovation, will combine sustainable energy with advanced mobility support. 8. Smart blind stick :- A stick which detect an objects in certain area and give output as a alert sound through buzzer. 9. In present time some applications are available in market they are very costly. PRESENT TIME SOLUTIONS
  • 7.  The smart navigation system for the visually impaired works by capturing images from a camera attached to the user.  These images are sent to a Raspberry Pi, a small computer that processes them.  First, the images are saved, and then they are improved for better clarity. The system looks at the images to find objects around the user, like walls or other obstacles. It also measures how far these objects are from the user.  Based on this information, the Raspberry Pi creates audio messages and text alerts to tell the user what’s around them.  This information is then sent back to the user through sound, like headphones or a small speaker, helping them know where obstacles are.  The whole process allows the user to move safely and confidently.  The device keeps checking and updating in real-time, making it more helpful than regular navigation aids. It helps visually impaired individuals feel more secure and independent while walking in different environments. Working Principle
  • 8. 01 Image Capture STEP 1 03 Image Enhancement STEP 3 05 Audio Feedback STEP 5 02 Processing Unit. STEP 2 04 Object Detection. STEP 4 06 Real-Time Updates STEP 6
  • 10.  Microcontroller/Embedded System: Arduino, Raspberry Pi  Camera Module: A camera module compatible with microcontroller (e.g., Raspberry Pi Camera Module or USB Webcam).  Object Recognition Software: Libraries such as TensorFlow, OpenCV, or YOLO for object detection and recognition.  Ultrasonic Sensors: For obstacle detection and distance measurement (e.g., HC-SR04).  Communication and Output Components Speaker or Audio Output Module: For providing auditory feedback (e.g., small speaker or buzzer).  Bluetooth or Wi-Fi Module: For wireless communication and data transfer (e.g., HC-05 Bluetooth module or Wi-Fi module).  Battery Pack: To power the entire system (e.g., Li-Po or rechargeable battery). For storing data or logs if needed.  SD Card (Optional): For storing data or logs if needed. COMPONENTS
  • 12. Real-time Monitoring Providesimmediateobjectdetectionand response. 01. Cost-Effective Reducestheneedforcomplexhardwareby leveragingsoftware-baseddetection. 03. Improved Safety Reducesrisksindynamicenvironmentswith real-timeobstacledetection. 05. Affordability RaspberryPi-basedsolutionsarecost-effective comparedtospecializeddevices. 07. Hands-free Control Facilitatesvoice-basedorautomated navigationcommands. 02. Real-time Precision Enhanced real-time detection and navigation withoutdelaysfoundinsomemarketdevices. 04. Seamless Integration Easiertointegratewithothersmartdevices. 06. Empowerment Enhancesindependenceandconfidence inmobility. 08. BENEFITS