IRJET- Build and Integrate Perception Features on Freescale Platform

International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 06 Issue: 06 | June 2019 www.irjet.net p-ISSN: 2395-0072
© 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 1254
Build and Integrate Perception Features on Freescale Platform
Darshana.A1, Anjali Kotnala2, Prof. Sankar Dasiga3
1M. Tech, Department of ECE, Nitte Meenakshi Institute of Technology, Bengaluru, Karnataka, India.
2Senior Development Specialist, KPIT Technologies Pvt ltd, Bengaluru, Karnataka, India
3Professor, Department of ECE, Nitte Meenakshi Institute of Technology, Bengaluru, Karnataka, India
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - The automotive industry is growing rapidly day
by day to increase the safety of a human on the road. Among
many technologies in automotive industries, the main
important technologies areADAS(AdvancedDriverAssistance
System) and ITS (Intelligent TransportSystem). Inthisproject,
Lane departure warning and vehicle detection is carried out
using S32V234evb.This Lane departure warning and vehicle
detection are the functionalities of the ADAS. It useselectronic
components to make driver safe by guiding on road through
warnings, signals etc. So, integrating these two functionalities
into single Freescale platform and optimizing the algorithm.
Key Words: ADAS, LDW, ITS, S32V234evb, S32DS vision
IDE.
1.INTRODUCTION
In earlier days, the means of transport was the
bullock carts, Horse cart, etc. After many years, public
transport was introduced for travellingoneplacetoanother,
which many people will prefer. So, as the economic growth
increase in a country, the people have opted for their own
transport like bike, car, etc. And for commercial purpose,
many vehicles are used to transport goods from one place to
another.
Many people are shifting from villages to cities for
their daily wages, to work in industries, etc. Population in
the cities are increasing which have effect on people using
their own vehicles on the road, leading to increase in traffic.
Due to increase in traffic, there is an increasing rate in
casualties taking place. And even on the highways, many
accidents are happening. The reason for the casualties is the
knowing or unknowingly happening mistakes by the driver
or the vehicle system. Many automotive manufacturing
companies are present where the production rate is
increasing due to increaseinbuyersanddemandonvehicles.
So, for the driver safety on the roads, many researches are
going on and many technologies are implemented, new
technologies success rate is increasing afterimplementation
in vehicles.
In the new technologies, one of the main technology
which is trending and increase in success rate than the
failure rate is the ADAS technology.
1.1 ADAS (Advanced Driver Assistance System)
Fig-1: Indicates the ADAS technology implementation in car and
functionalities of the ADAS.
To prevent the rate of casualties occurring on road,
mechanical parts are connected through electronic parts.
Here sensors play a major role in ADAS. Camera is the main
part and eye of the ADAS system. Functionalities of ADAS
will guide the driver on the road and takes overthecontrol if
the driver fails to take actions. Along with the Camera,
Radar/LiDAR, ultrasound etc. are the major parts of the
ADAS technology. The main idea behind the ADAS is the
human system interface, which keeps thedriver,vehiclesafe
on road. To prevent the casualties occurring due to human
error, this ADAS technology have been implemented. To
enhance the existing technology, automate, adapting the
technology are the key features to achievethesuccessrate in
ADAS.
There are 5 levels in ADAS, they are as follows:
Level 0: No automation, where the driver performs all the
driving tasks.
Level 1: Driver Assistance are the features that are included
in the car system, which assist the driver during few
situations.
Level 2: Partial Automation, which mainly deals with the
acceleration and steering. The driver should be aware and
alert about the environment andshouldbemonitoringevery
time and must be performing the driving tasks.
Level3: Conditional automation, here the driver should be
inside the car and must be ready for the alert message or the
notice to take the control of the car. But, driver can be
relaxed by not monitoring the environment.

Level 4: High automation, where the driver can be relaxed
and vehicle can perform all the driving tasks automatically,
but driver can take control whenever required.
Level 5: Full Automation, here the complete driving work
will be done by the vehicle, driver can sit comfortably
without the problems. Driver can take the control whenever
required.
The ADAS consists of different functionalities like
LDW, forward collision warning, blind spot detection,cruise
control etc. which is added in many vehicles like Audi cars,
BMW cars etc. In this project, the main focus is on to the
LDW and vehicle detection and these two are the
functionalities of ADAS. Normally, LDW and vehicle
detection lies in the level 2 and level 3 of ADAS.
1.2 Lane Departure Warning
The LDW system is used to warn the driver when
the vehicle departs the lane unknowingly. This change of
lane occurs due to drowsiness, using the phone during
driving, or due to loss of concentration on the car etc. So,
during such situation the ADAS system will alert the driver
and guide the driver through visual warnings or throughthe
audio warning. In visual warnings,thelaneswill bedetecting
and which will be green in color and if the lane departs then
that green color will turn to red color and alerting the driver
though visuals.
1.3 Vehicle Detection
Vehicles will be detected ahead though the camera,detected
vehicles will be represented through the bounding boxes.
This technology of vehicle detection can be applied in many
applications of ADAS like forward collision warning, blind
spot monitoring etc.
2. Related Work
In [1], it describes about the implementation of Lane
departure warning system using TMS320DM6437 where
different operators are used for detecting the edged, lines,
lanes and ROI is selected for performing the operations on
that particular area.
In [2], it describes about the lane departure warningusing
the one forward looking camera whereCRAL (ChangingRate
of Angles between the Lanes) and TLC (Time to Lane Cross)
are used and the result describes that, vision based LDW
provides the warning when lane change occurs.
In [3], it describes about theimplementationofLDWusing
embedded system and processing the video using video and
image processing platform. This system is testedinreal time
environment and verified.
In [4], it describes about the lane detection and vehicle
detection in real time using the different algorithms,
Different graphs are generated for differentoutputs,verified
and validated.
In [5], it describes about the concept of Mixture of
Gaussian and support vector machine and its application in
detection of vehicles and classification of detected vehicles
data for traffic analytics.
In [6], it describes about the implementation of lane
departure warning algorithm on dual core DSP processor
and it contains the HDR CMOS camera for capturing the
video of real time and the captured video to undergo video
processing to detect the lane which the vehicle has crossed
and give a visual warning for the driver.
In [7], it describes about the mobile lane departure
warning system where inbuilt camera is used for capturing
the lane. The algorithm is downloaded into the mobile for
processing the real time captured video anddetectthelanes.
This system is placed backside of the rear view mirror. It
works with high accuracy of detection.
3 Block Diagram and Methodology
Fig-2: indicates the block diagram of the project
The Components required for this project are:
a) Evaluation board: S32V234 evaluationsystemand
development platform.
b) Operating system: Linux
c) Board Support Packages: Latest BSP fromNXPfor
Linux.
d) Software: S32DS vision
Steps involved in implementation:
a) Preparing the SD card for the bootwithLinuxBoard
Support Packages.
b) Writing the C code for transferring the video from
the server (Computer) to the client (S32V234evb).
c) Study on the hardware and connection betweenthe
S32V234evb and Computer is established.
d) Creating the three tasks where the first task is used
to receive the video, second task is used for running

the algorithm, and third task is used for runningthe
video on the S32V234evb.
e) Building and compiling the code on S32DS vision
IDE.
Fig-3: Indicates flow chart of the project
For the project, download the latest Linux BSP from the
NXP website, extract the files and boot into the SD card by
creating the partitions where in 1st partition load the rootfs
file and in 2nd partition image along with the board support
packages will be loaded. There is another option to boot
directly to the eMMC memoryofS32V234evbbycreating the
partitions in the eMMC. This will make Linux OS to run on
S32V234evb where many electronic devices run on the
Linux which of high secure, highly stable, ease of use,
customization, ease of maintenance etc.
The pre-recorded video will be sent from the computer
to the S32V234evb using socket programming where the
S32V234evb board will act as client and computer will actas
a server. Initially the server code will be running on the
computer and waiting for the connection withtheclient.The
client code will be run of the computer, after debugging the
code, .elf file will be generated and that .elf file will be
dumped on to the SD card through remote debugging. Using
the putty terminal, the USB port that is used and speed of
data transfer will be set to the 115200. The boards IP
address is received at the computer when theputtyterminal
is executed, which ensures the S32V234evb board got
connected to the computer. And the socket program will be
executed and testedusingS32DSvisionIDEandS32V234evb
board.The connectionbetweenS32V234evbandcomputeris
established. Initially hardware architecture of the
S32V234evb is explored and connection is built.
For remote debugging and flashing the code on to the
S32V234evb, LAN cable is used where the board is
connected with the LAN cable and the computer will be
connected to the Wi-Fi. USB cable is connected to the
S32V234evb and to one of the USB port of computer, to
connect the Linux BSP to the terminal program, to give the
commands and obtaintheIP address.Powersupplyof12volt
is given to the S32V234evb via power supply cable. After
connecting all the cables, building and debuggingofthecode
is carried out.
4 Expected Output
Fig- 4: Indicates the Lane detection
In the above figure indicates the lane detection
where the green lines indicate the lanes hasbeendetected.If
the vehicle departs the lane, then that lane indicates the red
in color which is a sign of warning to the driver.
Fig-5: Indicates the vehicle detection
The above figure indicates the vehicle detection
where the bounding boxes are used to present the vehicle
detection. This vehicle detection is used for many
applications in ADAS, where it can be used for forward
collision warning, parking assist, etc.
5 Results
Fig-6:Indicates the building of code and genertion of .elf file

The above screenshot indicates the code running on S32DS
and after running the code, build is done, .elf file is
generated. The file that is generated is dumped on to the
S32V234evb.
Fig-7: Indicates debugging of the code
The above screenshot indicates the debugging of the code in
S32DS vision IDE and connecting the computer to the
S32V234evb.
6. Conclusions
In this project, implementationofLanedeparturewarning
and vehicle detection is done using S32V234evb. The
algorithm is executed on S32DS vision IDE. Initially the pre-
recorded video will be sent from the server(Computer) to
the client(S32V234evb), the pre-recorded video will be
passed through the algorithm, the lanes, vehicles will be
detected and in the pre-recorded video, all thescenarioswill
be considered. So lane will be detectedandwarned whenthe
vehicle crosses the lane, that warning will be of visual were
the lane that departed will be displayed as red in color.
During the implementation process, .elf file will be
dumped on to the board and executed. Uploading of the
project created .elf file onto the board was successful and
screenshot of it has been shown in results topic. Due
unavailability of display drivers of S32V23evbfromNXP, the
display of the output i.e lane detection and vehicle detection
on screen was not presented. These drivers shouldbeadded
by the NXP to illustrate the LDW or any other algorithms on
the S32V234 evb board.
7 Future Scope
This project can be improvised by getting the display
drivers, installing the display drivers from NXP to
demonstrate the code on S32V234evb. The algorithmcanbe
enhanced by merging the LDW and vehicle detection
algorithm, where the system will be detecting the lanes and
warning the driver if the lane change occurs similarly the
vehicles will be detecting if the ahead vehicle changes the
lane, then that situation should be warned to the driver
through the visual warning or audio warning. Algorithm
should be enhanced by making it work in bad weather
conditions, curve roads, bad light weather conditions.
8 References
[1] Hui Rong. Jinfeng Gong. Wei Huang, Jia He, “A Lane
Detection Method for Lane Departure Warning System,”
in IEEE International Conference on Optoelectronicsand
Image Processing, Tianjin, China, 2010.
[2] Hangen. He. ,Mo. Wu. Xiangjing An, “A Novel Approachto
Provide Lane Departure Warning Using Only One
Forward-Looking Camera,” in IEEE,Changsha,P.R.China
, 2006.
[3] Pei-Yung. Hsiao. ,Chun-Wei.Yeh, “A Portable Real-Time
Lane Departure Warning System based on Embedded
Calculating Technique,” in IEEE, 2006.
[4] Nguyen, VanQuang, et al. "A study on real-time detection
method of lane and vehicle for lane change assistant
system using vision system on highway." Engineering
science and technology, an international journal 21.5
(2018): 822-833.
[5] Arinaldi, Ahmad, Jaka Arya Pradana, and Arlan Arventa
Gurusinga. "Detection and classification of vehicles for
traffic video analytics." Procedia computer science 144
(2018): 259-268.
[6] fan gang,wu dong, Zhu Yunjiang, “Development of Lane
Departure Warning System Based On a Dual-Core DSP,”
in International Conference on Transportation,
Mechanical, and Electrical Engineering (TMEE) , china,
2011.
[7] Bing-Fei Wu. Wen-Hsin Lin. Chih-Chun Kao Yi-HanChen.
Chao-Jung Chen, “Mobile Lane Departure Warning
Systems,”inIEEEInternational SymposiumonConsumer
Electronics , Taiwan, 2009.
[8] Suhong Ko. Seongchan Gim,Ce Pan,.Jongman Kim,kihyun
pyun, “Road Lane DepartureWarningusingOptimal Path
Finding ofthe Dynamic Programming,” in SICE-ICASE
International Joint Conference , Bexco, Busan, Korea ,
2006.
[9]https://www.nxp.com/support/developer-
resources/evaluation-and-development-boards/ultra-
reliable-mcus-development-platform/s32v-mpus-
platforms/s32v-vision-and-sensor-fusion-evaluation-
system:S32V234EVB
[10] https://www.nxp.com/docs/en/quick-reference-
guide/S32V234-EVB2-QSG.pdf

IRJET- Build and Integrate Perception Features on Freescale Platform

More Related Content

What's hot (20)

Similar to IRJET- Build and Integrate Perception Features on Freescale Platform (20)

More from IRJET Journal (20)

Recently uploaded (20)

IRJET- Build and Integrate Perception Features on Freescale Platform