SlideShare a Scribd company logo
REAL TIME TRAFFIC
  SIGN ANALYSIS
   Presented By-
              Rakesh Ravaso Patil
              T CO ‘B’ 12276
   Guided By-
              Ms. P. P. Lokhande
Overview
   Introduction
   Traffic sign analysis
     Color segmentation
     Edge detection

     Shape based detection

   Recognition
     Binary Thresholding
     Recognition and Matching using IPP

   Recognition of traffic signs using FPGA hardware
   How TSR is works?
   Conclusion
INTRODUCTION

   Advanced Driver Assistance Systems (ADAS)
     Lane Departure Warning
     Night Vision
     Automatic Parking
     Blind Spot Detection
     Traffic Sign Recognition
   First used In
     BMW 7 Series
     Volkswagen Phaeton
WHY WE REQUIRE THIS?

   Sleepy driver crashes SUV on Mumbai-Pune
    Expressway, 7 passengers killed. (TOI, March 5)
   Human error behind most Expressway mishaps.
    (TOI, March 5)
   In 2012, the expressway, witnessed 475 accidents in
    which 105 people died.
   MSRDC plan:
      Trauma Care & Copter Service

      CCTV Cameras

      Truck Terminals

      Reducing U-Turns
TRAFFIC SIGN

                     Possible
  Sign Type                                     Sign Shape
                 (Border) Colors
                                                 Triangle,
 Restricting &
                  Red, Blue, Black         Rectangle, Octagon,
   Warning
                                                  Circle
 Information         Blue, Red                   Rectangle
   Highway
                        Green                    Rectangle
 Information
                 Table: Standard Traffic Sign
REAL TIME TRAFFIC SIGN ANALYSIS
   Detection
   Recognition
   Problem facing
     Illumination affects the color analysis.

     Occlusion affects the shape analysis.

     Weather conditions such as rain, snow or fog
      affect the shape extraction.
     Physically damaged or changed surface metal of
      traffic signs affects the recognition.
TRAFFIC SIGN ANALYSIS




            Fig: Steps of TSR System
COLOR SEGMENTATION




      Fig: Traffic sign and Red/Blue segmented image
COLOR SEGMENTATION-ADVANTAGES

   Eliminates undesired colors, thus the number of
    edge pixels in the edge detection process decreases.

   The complexity decreases since only edge pixels are
    processed.

   Fault detections decrease in the detection process.

   Color segmentation gives information about the
    border color and the inner color of the sign.
EDGE DETECTION

   Identifying points in a digital image at which the
    image brightness changes sharply




                 Fig: Edge image with color segmentation
SHAPE BASED DETECTION

   Types: Triangle, Circle and Rectangle

   TRIANGULAR SIGN DETECTION
   Hough Transform using Slope-Intercept Line equ.
                       y=a.x + b
        where: x,y are coordinates
               a is the slope of the line
               b is the constant parameter…
   Use of Polar Coordinates instead of Cartesian
    Coordinates.
TRIANGULAR SIGN DETECTION




                     x.cosΘ + y.sinΘ=r
Where: r is distance between line & Origin
      Θ is angle from origin to the closest point to line
TRIANGULAR SIGN DETECTION




 Fig: Edge Image of a Triangular   Fig: Detected Lines after applying
            Traffic sign                   Hough Transform
CIRCULAR SIGN DETECTION

   Circular Hough Transform using parametric equation
    of Circle:
                    (x-xc)² + (y-yc)² = r²
   Because of Perspective distortion Circular traffic
    sign may appear as elliptical.
                   (x-xc)² + k.(y-yc)² = r²
CIRCULAR SIGN DETECTION




Fig: Detected Circle after applying CHT   Fig: Detected Ellipse after applying
                                                   Ellipse Detection
RECTANGULAR SIGN DETECTION




       Fig: Detected Lines of Rectangular
                   Traffic Sign
RECOGNITION


   A binary image is generated using ROI of the image.
   Morphological operations are applied to the binary
    image in order to remove the unwanted pixels.
   Informative Pixel Percentage (IPP).
BINARY THRESHOLDING

   ROI is the informative part of the image.
   Traffic sign consists of only two different colors. One
    is the informative color of ROI and the other is the
    background color.




                    Fig: Output of Binarization Process
RECOGNITION AND MATCHING
USING IPP
   TRIANGULAR SIGN RECOGNITION




            Fig: Divided Regions of Triangular Sign
CIRCULAR, RECTANGULAR SIGN
RECOGNITION




     Fig: Divided Regions of Circular and Rectangular Sign
RECOGNITION OF TRAFFIC SIGNS
USING FPGA HARDWARE
   VIRTEX5-FX70T FPGA
   XILINX Platform flash PROM
   DDR2 SDRAM
   LCD Display
HOW TSR IS WORKS?
CONCLUSION

   Automatic traffic sign detection and recognition is an
    important part of an ADAS.

   Traffic symbols have several distinguishing features
    that may be used for their recognition and
    detection.

   There are several factors that can hinder effective
    detection and recognition of traffic signs.

   The performance of the TSR system can be improved
    with increasing the number of divided regions.
Real time traffic sign analysis

More Related Content

PPTX
Traffic sign detection
PDF
GTSRB Traffic Sign recognition using machine learning
PPTX
Vehicle registration plate recognition system
ODP
Computer Vision for Traffic Sign Recognition
PPTX
Traffic sign recognition
PPTX
Automatic Number Plate Recognition(ANPR) System Project
PPTX
Automatic Number Plate Recognition (ANPR)
PPTX
AUTOMATIC CAR LICENSE PLATE RECOGNITION USING VEDA
Traffic sign detection
GTSRB Traffic Sign recognition using machine learning
Vehicle registration plate recognition system
Computer Vision for Traffic Sign Recognition
Traffic sign recognition
Automatic Number Plate Recognition(ANPR) System Project
Automatic Number Plate Recognition (ANPR)
AUTOMATIC CAR LICENSE PLATE RECOGNITION USING VEDA

What's hot (20)

PPTX
Vehicle Number Plate Recognition System
PPT
AUTOMATIC LICENSE PLATE RECOGNITION SYSTEM FOR INDIAN VEHICLE IDENTIFICATION ...
PDF
License Plate Recognition System using Python and OpenCV
PPTX
Face recognition technology
PPTX
Vehicle number plate recognition using matlab
PPTX
Driver Drowsiness Detection Review
PPTX
Number plate recogition
PPTX
Automatic number-plate-recognition
PPTX
Recognition and enhancement of traffic sign for computer generated images
PPT
Lpr2003
PPT
Vehicle detection through image processing
PDF
Computer vision lane line detection
PPTX
Automatic no. plate recognition
PPTX
Face Recognition Technology by Vishal Garg
PPTX
MATLAB Based Vehicle Number Plate Identification System using OCR
PPTX
Object detection
PPTX
Face recognigion system ppt
PPTX
Parking space detect
PPTX
Object recognition
PPTX
Driver DrowsiNess System
Vehicle Number Plate Recognition System
AUTOMATIC LICENSE PLATE RECOGNITION SYSTEM FOR INDIAN VEHICLE IDENTIFICATION ...
License Plate Recognition System using Python and OpenCV
Face recognition technology
Vehicle number plate recognition using matlab
Driver Drowsiness Detection Review
Number plate recogition
Automatic number-plate-recognition
Recognition and enhancement of traffic sign for computer generated images
Lpr2003
Vehicle detection through image processing
Computer vision lane line detection
Automatic no. plate recognition
Face Recognition Technology by Vishal Garg
MATLAB Based Vehicle Number Plate Identification System using OCR
Object detection
Face recognigion system ppt
Parking space detect
Object recognition
Driver DrowsiNess System
Ad

Viewers also liked (8)

PDF
Automatic detection and recognition of road sign for driver assistance system
PDF
Automatic Road Sign Recognition From Video
PDF
Drive 2 Digital November 2012
PPTX
Traffic Sign Retroreflectivity
PPTX
Traffic Signals Safety and Efficiency Project – Stage Two Implementation
PDF
A Vision based Driver Support System for Road Sign Detection
PDF
Iaetsd traffic sign recognition for advanced driver
PDF
14.road sign recognition system amine-jaidi
Automatic detection and recognition of road sign for driver assistance system
Automatic Road Sign Recognition From Video
Drive 2 Digital November 2012
Traffic Sign Retroreflectivity
Traffic Signals Safety and Efficiency Project – Stage Two Implementation
A Vision based Driver Support System for Road Sign Detection
Iaetsd traffic sign recognition for advanced driver
14.road sign recognition system amine-jaidi
Ad

Similar to Real time traffic sign analysis (20)

PDF
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
PDF
International Journal of Computational Engineering Research(IJCER)
PDF
International Journal of Computational Engineering Research(IJCER)
PPTX
Automatic vehicle license plate detection using VEDA
PDF
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
PDF
ieee_my_proj
PDF
Traffic Sign Detection and Recognition Using Colour Features towards Intellig...
PDF
7.traffic sign detection and recognition
PDF
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
PDF
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
PDF
License plate recognition
PDF
Ay36304310
PDF
Article rilem 2012_ino_mtq_pavemetrics
PPT
Vision Based Traffic Surveillance System
PDF
IRJET- Automatic Number Plate Recognition System in Real Time
PDF
License Plate Recognition using Morphological Operation.
PDF
3d scanning techniques
PDF
E011142632
PDF
Automatic Number Plate Recognition System A Histogram Based Approach
PDF
OCR optimization for vehicle number plate Identification based on Template ma...
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
Automatic vehicle license plate detection using VEDA
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
ieee_my_proj
Traffic Sign Detection and Recognition Using Colour Features towards Intellig...
7.traffic sign detection and recognition
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
License plate recognition
Ay36304310
Article rilem 2012_ino_mtq_pavemetrics
Vision Based Traffic Surveillance System
IRJET- Automatic Number Plate Recognition System in Real Time
License Plate Recognition using Morphological Operation.
3d scanning techniques
E011142632
Automatic Number Plate Recognition System A Histogram Based Approach
OCR optimization for vehicle number plate Identification based on Template ma...

Recently uploaded (20)

PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
01-Introduction-to-Information-Management.pdf
PDF
Classroom Observation Tools for Teachers
PDF
O7-L3 Supply Chain Operations - ICLT Program
PPTX
Pharma ospi slides which help in ospi learning
PPTX
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PPTX
Renaissance Architecture: A Journey from Faith to Humanism
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PDF
Origin of periodic table-Mendeleev’s Periodic-Modern Periodic table
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
Week 4 Term 3 Study Techniques revisited.pptx
PPTX
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
PDF
Insiders guide to clinical Medicine.pdf
2.FourierTransform-ShortQuestionswithAnswers.pdf
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
01-Introduction-to-Information-Management.pdf
Classroom Observation Tools for Teachers
O7-L3 Supply Chain Operations - ICLT Program
Pharma ospi slides which help in ospi learning
The Healthy Child – Unit II | Child Health Nursing I | B.Sc Nursing 5th Semester
Microbial disease of the cardiovascular and lymphatic systems
STATICS OF THE RIGID BODIES Hibbelers.pdf
Supply Chain Operations Speaking Notes -ICLT Program
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Renaissance Architecture: A Journey from Faith to Humanism
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
VCE English Exam - Section C Student Revision Booklet
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
Origin of periodic table-Mendeleev’s Periodic-Modern Periodic table
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Week 4 Term 3 Study Techniques revisited.pptx
Introduction to Child Health Nursing – Unit I | Child Health Nursing I | B.Sc...
Insiders guide to clinical Medicine.pdf

Real time traffic sign analysis

  • 1. REAL TIME TRAFFIC SIGN ANALYSIS Presented By- Rakesh Ravaso Patil T CO ‘B’ 12276 Guided By- Ms. P. P. Lokhande
  • 2. Overview  Introduction  Traffic sign analysis  Color segmentation  Edge detection  Shape based detection  Recognition  Binary Thresholding  Recognition and Matching using IPP  Recognition of traffic signs using FPGA hardware  How TSR is works?  Conclusion
  • 3. INTRODUCTION  Advanced Driver Assistance Systems (ADAS)  Lane Departure Warning  Night Vision  Automatic Parking  Blind Spot Detection  Traffic Sign Recognition  First used In  BMW 7 Series  Volkswagen Phaeton
  • 4. WHY WE REQUIRE THIS?  Sleepy driver crashes SUV on Mumbai-Pune Expressway, 7 passengers killed. (TOI, March 5)  Human error behind most Expressway mishaps. (TOI, March 5)  In 2012, the expressway, witnessed 475 accidents in which 105 people died.  MSRDC plan:  Trauma Care & Copter Service  CCTV Cameras  Truck Terminals  Reducing U-Turns
  • 5. TRAFFIC SIGN Possible Sign Type Sign Shape (Border) Colors Triangle, Restricting & Red, Blue, Black Rectangle, Octagon, Warning Circle Information Blue, Red Rectangle Highway Green Rectangle Information Table: Standard Traffic Sign
  • 6. REAL TIME TRAFFIC SIGN ANALYSIS  Detection  Recognition  Problem facing  Illumination affects the color analysis.  Occlusion affects the shape analysis.  Weather conditions such as rain, snow or fog affect the shape extraction.  Physically damaged or changed surface metal of traffic signs affects the recognition.
  • 7. TRAFFIC SIGN ANALYSIS Fig: Steps of TSR System
  • 8. COLOR SEGMENTATION Fig: Traffic sign and Red/Blue segmented image
  • 9. COLOR SEGMENTATION-ADVANTAGES  Eliminates undesired colors, thus the number of edge pixels in the edge detection process decreases.  The complexity decreases since only edge pixels are processed.  Fault detections decrease in the detection process.  Color segmentation gives information about the border color and the inner color of the sign.
  • 10. EDGE DETECTION  Identifying points in a digital image at which the image brightness changes sharply Fig: Edge image with color segmentation
  • 11. SHAPE BASED DETECTION  Types: Triangle, Circle and Rectangle  TRIANGULAR SIGN DETECTION  Hough Transform using Slope-Intercept Line equ. y=a.x + b where: x,y are coordinates a is the slope of the line b is the constant parameter…  Use of Polar Coordinates instead of Cartesian Coordinates.
  • 12. TRIANGULAR SIGN DETECTION x.cosΘ + y.sinΘ=r Where: r is distance between line & Origin Θ is angle from origin to the closest point to line
  • 13. TRIANGULAR SIGN DETECTION Fig: Edge Image of a Triangular Fig: Detected Lines after applying Traffic sign Hough Transform
  • 14. CIRCULAR SIGN DETECTION  Circular Hough Transform using parametric equation of Circle: (x-xc)² + (y-yc)² = r²  Because of Perspective distortion Circular traffic sign may appear as elliptical. (x-xc)² + k.(y-yc)² = r²
  • 15. CIRCULAR SIGN DETECTION Fig: Detected Circle after applying CHT Fig: Detected Ellipse after applying Ellipse Detection
  • 16. RECTANGULAR SIGN DETECTION Fig: Detected Lines of Rectangular Traffic Sign
  • 17. RECOGNITION  A binary image is generated using ROI of the image.  Morphological operations are applied to the binary image in order to remove the unwanted pixels.  Informative Pixel Percentage (IPP).
  • 18. BINARY THRESHOLDING  ROI is the informative part of the image.  Traffic sign consists of only two different colors. One is the informative color of ROI and the other is the background color. Fig: Output of Binarization Process
  • 19. RECOGNITION AND MATCHING USING IPP  TRIANGULAR SIGN RECOGNITION Fig: Divided Regions of Triangular Sign
  • 20. CIRCULAR, RECTANGULAR SIGN RECOGNITION Fig: Divided Regions of Circular and Rectangular Sign
  • 21. RECOGNITION OF TRAFFIC SIGNS USING FPGA HARDWARE  VIRTEX5-FX70T FPGA  XILINX Platform flash PROM  DDR2 SDRAM  LCD Display
  • 22. HOW TSR IS WORKS?
  • 23. CONCLUSION  Automatic traffic sign detection and recognition is an important part of an ADAS.  Traffic symbols have several distinguishing features that may be used for their recognition and detection.  There are several factors that can hinder effective detection and recognition of traffic signs.  The performance of the TSR system can be improved with increasing the number of divided regions.