SlideShare a Scribd company logo
MOVING VEHICLE DETECTION
GUIDE PROJECT
MEMBERS
DR. KHELCHANDRA THONGAM
PRIYANK BHARDWAJ
ROHIT KUMAR
SAHU
AJEYA
SIDDHARTHA
INTRODUCTION
INTELLIGENT TRANSPORTATION SYSTEM
• Traffic data may come from different sensors such as loop
detectors, ultrasonic
sensors, or cameras.
• Video-based camera systems coupled with computer vision
techniques offers alternative approach to spot sensors.
• VB camera systems are more sophisticated and powerful.
MOTIVATION
• There are many published works for moving vehicle detection
but there were certain areas of improvement in each like:
• how to detect the moving vehicles at night, casting shadow
elimination.
• Different from previous works, this algorithm learns from the
known examples and does not rely on the prior model of
vehicles, lighting, shadows, or headlights as example based
classification system is prevalently used in image-based
classification.
CHALLENGES
• Spot sensors have limited capabilities and are often both costly
and disruptive to install.
• Main challenge come from cast shadows, vehicle headlights,
and noise which produce incorrect segments.
• Sunlight cause shadows which are difficult to be distinguished
from the vehicle and cause segmentation errors.
• Vehicle headlights and bad illumination cause strong noise.
ALGORITHM DESCRIPTION
The whole algorithm includes the following steps:
1. Background estimation
2. block division
3. candidates’ selection
4. Feature extraction,
5. SVM-based classification,
6. Shape representation.
IMAGE
SEQUENC
E
BACKGROUN
D
ESTIMATION
BLOCK
DIVISION
FEATURE
EXTRACTIO
N
SVM BASED
CLASSIFICATI
ON
SVM-
TRAINING
SHAPE
REPRESENTATI
ON
CANDIDA
TE
SELECTIO
N
Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY
2007
BACKGROUND ESTIMATION
• In order to detect moving vehicles, we need to estimate the background of
the scene first.
• We will propose improved adaptive background extraction algorithm based
on Kalman filtering.
• The background on the pixel p of the (n + 1)th frame can be defined as
B(n + 1, p) = B(n, p) + β(n, p) + μ(n, p).
• The input image intensity is described as I(n, p) = B(n, p) + η(n, p).
• By combining (1) with (2), we have I(n + 1, p) = B(n, p) + ω(n + 1, p).
Updated area
Sliding window
Image
Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY
2007
BLOCK DIVISION AND CANDIDATES SELECTION
• The image will be divided into non-overlapped blocks, and
each block has the same size in a same image.
• We will find out the blocks with a gray-level change.
• The current image will be subtracted from the background to
get the difference image, and we compute its mean value for
each block.
• These candidates include real vehicles, casting shadows,
headlights, or noise.
3.FEATURE
EXTRACTION
• Histogram is used for the feature extraction.
• The range of the image’s grey level is taken [0,T] where T
=255.
• For difference image d{i,j} the range of its grey scale is
taken between [-T,T] or[0,2T].
• The histogram ha(r) is computed from the image d{i,j}.
• The histogram hb(r) is computed from the edge map E(i,j)
of the image d{I,j}.
• Here r is between –T<=r<=T.
Fig. referred from-wavemetrics.com
FORMULAS
• To compute the edge map,the formula =
• E(i, j) = 1/ 2 {|D(i + 1, j + 1) − D(i, j)| + |D(i + 1, j) −
D(i, j + 1)|}.
• A new histogram hc(r) is from by combining the
histogram of the difference image and its edge map.
• The new histogram hc(r) of dimension3T+R is
computed as
• hc(r) = ha(r), 0 ≤ r ≤ 2T hb(r − 2T − 1), 2T + 1 ≤ r ≤
3T + 2.
NORMALIZATIO
N
• .Normalisation of the feature is done to adopt the different block division by h(r)=hc(r)/S
where S is the size of block.
• .PCA, optimal orthonormal decomposition will be applied to reduce the noises from
feature.
• .From the collected sample ,a scatter matrix is obtained as.
S= 1/𝑁 𝑖=0
𝑁 ℎ𝑖 − 𝑚 (ℎ𝑖 − 𝑚) 𝑡
,here N =no. of training set.
• hi is the ith vector and (hi − m)t is the transpose of the vector of (hi − m).
• .For S ∈ R(3T +2)×(3T +2), it is easy to obtain its eigenvalues A = diag[λ1,...,λ3T +2], λ1
≥···≥ λ3T +2 and its eigen-vectors V = [ν1,...,ν3T +2]. Then, a new compressed vector
with a dimension p can be computed from the original vector h(r).
• gp = [ν1,...,νp] t h, when p ≤ 3T + 2.
EXTRACTED FEATURE
• Using compressed vectors as features, our
experiments will show that the classification result
is better than directly using the original histograms.
Moreover, the computation cost can also be
reduced.
Fig. referred from-
images.google.com
4.SUPPORT VECTOR MACHINE BASED
CLASSIFICATION.
SVM
• Support vector machines (SVMs) are a set of supervised
learning methods used
for classification, regression and outliers detection.
• It is used to generalization capabilities which are
achieved through a minimization of bound of the
general error.
• The aim is to define a hyperplane that divide the set of
examples such that all points with the same bound are
on the same side of the hyperplane.
• The extracted features are put into the SVMs for
training and the parameter of the SVM-based classifier
can be obtained.
Fig. referred from-
wikipedia.org
DETECTION STAGE
• The input is divided into many blocks.
• The feature vector is generated by PCA from the two kinds of histogram of the
images.
• It is put into the well-trained classifier to judge whether this region is covered with a
vehicle or others (such as shadow, headlight, or noise).
5. SHAPE REPRESENTATION
 SHAPE OF VECHICLES NEEDS TO BE EXTRACTED
FOR VEHICLE COUNTING,SPEED
ESTIMATION,TRACKING ETC.
 SVM BASED CLASSIFIER GROUPS BLOCKS INTO
VEHICLES AND NON VECHICLES
 BLOCKS CLASSIFIED AS VEHICLES ARE GROUPED
BY THEIR 8 CONNECTIVITY
 A CONVEX POLYGON IS DERIVED FROM A SET OF
RELATED BLOCKS
 THE POLYGON IS USED TO APPROXIMATE A
VECHICLE’S SHAPE IN THE FORM OF A
PARALLELOGRAM WHICH IS MORE ROBUST DUE
TO ITS SIMPLE REPRESENTATION
Fig: 8 direction
connectivity
Fig:Parallelogram
P1P2P3P4Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY 2007
Fig: White Boxes indicate
detected parts of vehicles
Fig: Shape representation
Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY
TECH REQUIREMENTS
 MATLAB
 LATEX
 MICROSOFT POWERPOINT
PROJECT’S TIME DIVISION
S.No. Description Date
1. Research 10/10/17 – 11/11/17
2. Project Implementation 15/11/17 – 31/01/18
3. Documentation 01/02/18 – 25/02/18
FUTURE WORK
 THE ALGORITHM CAN BE MADE MORE PRECISE BY
USING MORE INFORMATION SUCH AS COLOR
 USING SOME OTHER CLASSIFIERS SUCH AS CNN OR A
COMBINATION OF CLASSIFIERS TO IMPROVE
ACCURACY
REFERENCES
 JIE ZHOU , DASHAN GAO AND DAVID ZHANG , “MOVING
VEHICLE DETECTION FOR AUTOMATIC VEHICLE
MONITORING,” IEEE TRANSACTION ON VEHICULAR
TECHNOLOGY , VOL 56 , NO. 1 , PP. 51-59, JAN 2007
 ALI SHARIF RAZAVIAN ,HOSSEIN AZIZPOUR, JOSEPHINE
SULLIVAN, STEFAN CARLSSON, “CNN FEATURES OFF-
THE-SHELF: AN ASTOUNDING BASELINE FOR
RECOGNITION”, 2014 IEEE CONFERENCE ON
COMPUTER VISION AND PATTERN RECOGNITION
WORKSHOPS
THANK YOU

More Related Content

PPTX
COM2304: Intensity Transformation and Spatial Filtering – II Spatial Filterin...
PPTX
COM2304: Intensity Transformation and Spatial Filtering – I (Intensity Transf...
PPTX
3.point operation and histogram based image enhancement
PPTX
Image segmentation in Digital Image Processing
PDF
Structure and Motion - 3D Reconstruction of Cameras and Structure
PDF
4 image enhancement in spatial domain
PPT
Image enhancement ppt nal2
COM2304: Intensity Transformation and Spatial Filtering – II Spatial Filterin...
COM2304: Intensity Transformation and Spatial Filtering – I (Intensity Transf...
3.point operation and histogram based image enhancement
Image segmentation in Digital Image Processing
Structure and Motion - 3D Reconstruction of Cameras and Structure
4 image enhancement in spatial domain
Image enhancement ppt nal2

What's hot (20)

PPTX
Segmentation Techniques -II
PPTX
Digital Image Fundamentals - II
PPTX
Histogram Processing
PPTX
COM2304: Digital Image Fundamentals - I
PPT
Chapter10 image segmentation
PPTX
Image enhancement
PDF
04 image enhancement edge detection
PPT
Remote Sensing Lec 10
PPT
Image Texture Analysis
PPTX
Lect 03 - first portion
PPTX
LAPLACE TRANSFORM SUITABILITY FOR IMAGE PROCESSING
PDF
Image Enhancement
PPT
Build Your Own 3D Scanner: 3D Scanning with Swept-Planes
PPTX
COM2304: Intensity Transformation and Spatial Filtering – III Spatial Filters...
PPTX
Image enhancement techniques
PPT
Image segmentation
PDF
Contrast enhancement in digital images
PPT
03 digital image fundamentals DIP
PPTX
Image enhancement techniques
Segmentation Techniques -II
Digital Image Fundamentals - II
Histogram Processing
COM2304: Digital Image Fundamentals - I
Chapter10 image segmentation
Image enhancement
04 image enhancement edge detection
Remote Sensing Lec 10
Image Texture Analysis
Lect 03 - first portion
LAPLACE TRANSFORM SUITABILITY FOR IMAGE PROCESSING
Image Enhancement
Build Your Own 3D Scanner: 3D Scanning with Swept-Planes
COM2304: Intensity Transformation and Spatial Filtering – III Spatial Filters...
Image enhancement techniques
Image segmentation
Contrast enhancement in digital images
03 digital image fundamentals DIP
Image enhancement techniques
Ad

Similar to Moving vehicle detection from Videos (20)

PDF
FRONT AND REAR VEHICLE DETECTION USING HYPOTHESIS GENERATION AND VERIFICATION
PDF
IRJET- Front View Identification of Vehicles by using Machine Learning Te...
PDF
A robust ga knn based hypothesis
PPTX
AI IN VEHICLE COUNTING (1).pptx
PDF
Neural Network based Vehicle Classification for Intelligent Traffic Control
PDF
VEHICLE RECOGNITION USING VIBE AND SVM
PDF
VEHICLE RECOGNITION USING VIBE AND SVM
PDF
VEHICLE RECOGNITION USING VIBE AND SVM
PDF
Vehicle Recognition Using VIBE and SVM
PPTX
Vehicle Classification
PDF
Verification of Vehicles Based on Images by Tree Generation
PDF
Vehicle tracking and distance estimation based on multiple image features
PDF
Real Time Object Identification for Intelligent Video Surveillance Applications
PDF
IRJET - Vehicle Classification with Time-Frequency Domain Features using ...
PPTX
Mvs adas
PDF
A real-time system for vehicle detection with shadow removal and vehicle clas...
PDF
Whitepaper: M2M Telematics for Vehicle Detection Using Computer Vision - Happ...
PDF
Image classification
PDF
IRJET - Traffic Density Estimation by Counting Vehicles using Aggregate Chann...
PPTX
Cahall Final Intern Presentation
FRONT AND REAR VEHICLE DETECTION USING HYPOTHESIS GENERATION AND VERIFICATION
IRJET- Front View Identification of Vehicles by using Machine Learning Te...
A robust ga knn based hypothesis
AI IN VEHICLE COUNTING (1).pptx
Neural Network based Vehicle Classification for Intelligent Traffic Control
VEHICLE RECOGNITION USING VIBE AND SVM
VEHICLE RECOGNITION USING VIBE AND SVM
VEHICLE RECOGNITION USING VIBE AND SVM
Vehicle Recognition Using VIBE and SVM
Vehicle Classification
Verification of Vehicles Based on Images by Tree Generation
Vehicle tracking and distance estimation based on multiple image features
Real Time Object Identification for Intelligent Video Surveillance Applications
IRJET - Vehicle Classification with Time-Frequency Domain Features using ...
Mvs adas
A real-time system for vehicle detection with shadow removal and vehicle clas...
Whitepaper: M2M Telematics for Vehicle Detection Using Computer Vision - Happ...
Image classification
IRJET - Traffic Density Estimation by Counting Vehicles using Aggregate Chann...
Cahall Final Intern Presentation
Ad

Recently uploaded (20)

PDF
CCleaner Pro 6.38.11537 Crack Final Latest Version 2025
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PPTX
Reimagine Home Health with the Power of Agentic AI​
PPTX
Embracing Complexity in Serverless! GOTO Serverless Bengaluru
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PPTX
CHAPTER 2 - PM Management and IT Context
PDF
Website Design Services for Small Businesses.pdf
DOCX
Greta — No-Code AI for Building Full-Stack Web & Mobile Apps
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PDF
How to Make Money in the Metaverse_ Top Strategies for Beginners.pdf
PDF
CapCut Video Editor 6.8.1 Crack for PC Latest Download (Fully Activated) 2025
PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
PDF
Nekopoi APK 2025 free lastest update
PDF
AI-Powered Threat Modeling: The Future of Cybersecurity by Arun Kumar Elengov...
PDF
iTop VPN Free 5.6.0.5262 Crack latest version 2025
PPTX
Why Generative AI is the Future of Content, Code & Creativity?
PPTX
Oracle Fusion HCM Cloud Demo for Beginners
PPTX
Monitoring Stack: Grafana, Loki & Promtail
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
PDF
Digital Systems & Binary Numbers (comprehensive )
CCleaner Pro 6.38.11537 Crack Final Latest Version 2025
Internet Downloader Manager (IDM) Crack 6.42 Build 41
Reimagine Home Health with the Power of Agentic AI​
Embracing Complexity in Serverless! GOTO Serverless Bengaluru
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
CHAPTER 2 - PM Management and IT Context
Website Design Services for Small Businesses.pdf
Greta — No-Code AI for Building Full-Stack Web & Mobile Apps
Odoo Companies in India – Driving Business Transformation.pdf
How to Make Money in the Metaverse_ Top Strategies for Beginners.pdf
CapCut Video Editor 6.8.1 Crack for PC Latest Download (Fully Activated) 2025
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
Nekopoi APK 2025 free lastest update
AI-Powered Threat Modeling: The Future of Cybersecurity by Arun Kumar Elengov...
iTop VPN Free 5.6.0.5262 Crack latest version 2025
Why Generative AI is the Future of Content, Code & Creativity?
Oracle Fusion HCM Cloud Demo for Beginners
Monitoring Stack: Grafana, Loki & Promtail
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
Digital Systems & Binary Numbers (comprehensive )

Moving vehicle detection from Videos

  • 1. MOVING VEHICLE DETECTION GUIDE PROJECT MEMBERS DR. KHELCHANDRA THONGAM PRIYANK BHARDWAJ ROHIT KUMAR SAHU AJEYA SIDDHARTHA
  • 2. INTRODUCTION INTELLIGENT TRANSPORTATION SYSTEM • Traffic data may come from different sensors such as loop detectors, ultrasonic sensors, or cameras. • Video-based camera systems coupled with computer vision techniques offers alternative approach to spot sensors. • VB camera systems are more sophisticated and powerful.
  • 3. MOTIVATION • There are many published works for moving vehicle detection but there were certain areas of improvement in each like: • how to detect the moving vehicles at night, casting shadow elimination. • Different from previous works, this algorithm learns from the known examples and does not rely on the prior model of vehicles, lighting, shadows, or headlights as example based classification system is prevalently used in image-based classification.
  • 4. CHALLENGES • Spot sensors have limited capabilities and are often both costly and disruptive to install. • Main challenge come from cast shadows, vehicle headlights, and noise which produce incorrect segments. • Sunlight cause shadows which are difficult to be distinguished from the vehicle and cause segmentation errors. • Vehicle headlights and bad illumination cause strong noise.
  • 5. ALGORITHM DESCRIPTION The whole algorithm includes the following steps: 1. Background estimation 2. block division 3. candidates’ selection 4. Feature extraction, 5. SVM-based classification, 6. Shape representation. IMAGE SEQUENC E BACKGROUN D ESTIMATION BLOCK DIVISION FEATURE EXTRACTIO N SVM BASED CLASSIFICATI ON SVM- TRAINING SHAPE REPRESENTATI ON CANDIDA TE SELECTIO N Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY 2007
  • 6. BACKGROUND ESTIMATION • In order to detect moving vehicles, we need to estimate the background of the scene first. • We will propose improved adaptive background extraction algorithm based on Kalman filtering. • The background on the pixel p of the (n + 1)th frame can be defined as B(n + 1, p) = B(n, p) + β(n, p) + μ(n, p). • The input image intensity is described as I(n, p) = B(n, p) + η(n, p). • By combining (1) with (2), we have I(n + 1, p) = B(n, p) + ω(n + 1, p). Updated area Sliding window Image Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY 2007
  • 7. BLOCK DIVISION AND CANDIDATES SELECTION • The image will be divided into non-overlapped blocks, and each block has the same size in a same image. • We will find out the blocks with a gray-level change. • The current image will be subtracted from the background to get the difference image, and we compute its mean value for each block. • These candidates include real vehicles, casting shadows, headlights, or noise.
  • 9. • Histogram is used for the feature extraction. • The range of the image’s grey level is taken [0,T] where T =255. • For difference image d{i,j} the range of its grey scale is taken between [-T,T] or[0,2T]. • The histogram ha(r) is computed from the image d{i,j}. • The histogram hb(r) is computed from the edge map E(i,j) of the image d{I,j}. • Here r is between –T<=r<=T. Fig. referred from-wavemetrics.com
  • 10. FORMULAS • To compute the edge map,the formula = • E(i, j) = 1/ 2 {|D(i + 1, j + 1) − D(i, j)| + |D(i + 1, j) − D(i, j + 1)|}. • A new histogram hc(r) is from by combining the histogram of the difference image and its edge map. • The new histogram hc(r) of dimension3T+R is computed as • hc(r) = ha(r), 0 ≤ r ≤ 2T hb(r − 2T − 1), 2T + 1 ≤ r ≤ 3T + 2.
  • 11. NORMALIZATIO N • .Normalisation of the feature is done to adopt the different block division by h(r)=hc(r)/S where S is the size of block. • .PCA, optimal orthonormal decomposition will be applied to reduce the noises from feature. • .From the collected sample ,a scatter matrix is obtained as. S= 1/𝑁 𝑖=0 𝑁 ℎ𝑖 − 𝑚 (ℎ𝑖 − 𝑚) 𝑡 ,here N =no. of training set. • hi is the ith vector and (hi − m)t is the transpose of the vector of (hi − m). • .For S ∈ R(3T +2)×(3T +2), it is easy to obtain its eigenvalues A = diag[λ1,...,λ3T +2], λ1 ≥···≥ λ3T +2 and its eigen-vectors V = [ν1,...,ν3T +2]. Then, a new compressed vector with a dimension p can be computed from the original vector h(r). • gp = [ν1,...,νp] t h, when p ≤ 3T + 2.
  • 12. EXTRACTED FEATURE • Using compressed vectors as features, our experiments will show that the classification result is better than directly using the original histograms. Moreover, the computation cost can also be reduced. Fig. referred from- images.google.com
  • 13. 4.SUPPORT VECTOR MACHINE BASED CLASSIFICATION.
  • 14. SVM • Support vector machines (SVMs) are a set of supervised learning methods used for classification, regression and outliers detection. • It is used to generalization capabilities which are achieved through a minimization of bound of the general error. • The aim is to define a hyperplane that divide the set of examples such that all points with the same bound are on the same side of the hyperplane. • The extracted features are put into the SVMs for training and the parameter of the SVM-based classifier can be obtained. Fig. referred from- wikipedia.org
  • 15. DETECTION STAGE • The input is divided into many blocks. • The feature vector is generated by PCA from the two kinds of histogram of the images. • It is put into the well-trained classifier to judge whether this region is covered with a vehicle or others (such as shadow, headlight, or noise).
  • 17.  SHAPE OF VECHICLES NEEDS TO BE EXTRACTED FOR VEHICLE COUNTING,SPEED ESTIMATION,TRACKING ETC.  SVM BASED CLASSIFIER GROUPS BLOCKS INTO VEHICLES AND NON VECHICLES  BLOCKS CLASSIFIED AS VEHICLES ARE GROUPED BY THEIR 8 CONNECTIVITY  A CONVEX POLYGON IS DERIVED FROM A SET OF RELATED BLOCKS  THE POLYGON IS USED TO APPROXIMATE A VECHICLE’S SHAPE IN THE FORM OF A PARALLELOGRAM WHICH IS MORE ROBUST DUE TO ITS SIMPLE REPRESENTATION Fig: 8 direction connectivity Fig:Parallelogram P1P2P3P4Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY 2007
  • 18. Fig: White Boxes indicate detected parts of vehicles Fig: Shape representation Fig. referred from-IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 56, NO. 1, JANUARY
  • 19. TECH REQUIREMENTS  MATLAB  LATEX  MICROSOFT POWERPOINT
  • 20. PROJECT’S TIME DIVISION S.No. Description Date 1. Research 10/10/17 – 11/11/17 2. Project Implementation 15/11/17 – 31/01/18 3. Documentation 01/02/18 – 25/02/18
  • 21. FUTURE WORK  THE ALGORITHM CAN BE MADE MORE PRECISE BY USING MORE INFORMATION SUCH AS COLOR  USING SOME OTHER CLASSIFIERS SUCH AS CNN OR A COMBINATION OF CLASSIFIERS TO IMPROVE ACCURACY
  • 22. REFERENCES  JIE ZHOU , DASHAN GAO AND DAVID ZHANG , “MOVING VEHICLE DETECTION FOR AUTOMATIC VEHICLE MONITORING,” IEEE TRANSACTION ON VEHICULAR TECHNOLOGY , VOL 56 , NO. 1 , PP. 51-59, JAN 2007  ALI SHARIF RAZAVIAN ,HOSSEIN AZIZPOUR, JOSEPHINE SULLIVAN, STEFAN CARLSSON, “CNN FEATURES OFF- THE-SHELF: AN ASTOUNDING BASELINE FOR RECOGNITION”, 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS