SlideShare a Scribd company logo
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
Francesco Calabrese, Yiannis Gkoufas
IBM Research - Ireland
Data driven transportation analytics
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
Data-driven decision making in Transportation and City-Planning
• In the era of Big Data, authorities are provided with a rapidly increasing number of datasets
and data-streams to facilitate them in monitoring and planning on a city level
• The goal is to empower the city operators to take advantage of those data and provide
better services to the citizens
• In the last decade, a lot of city-wide sensoring systems have been installed to various cities
in the world. Our research focus is the SCATS System in the City of Dublin
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
SCATS System in Dublin
• Intelligent Transportation System which involves installation of sensors on the
intersections of the City which monitor and report various KPIs related to traffic flow
(saturation, flow, green time, etc)
• The Dublin system is deployed across 550 intersections
with 3300 sensors in total and generating 150MB/hour
• Historical data are publicly available in the Dublinked
website:
• http://dublinked.com/datastore/datasets/dataset-289.php
• http://dublinked.com/datastore/datasets/dataset-305.php
• http://dublinked.com/datastore/datasets/dataset-274.php
time
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
Goals of SCATS-Analytics Platform
• Leverage both open data stream and historical data obtained from Dublin's SCATS sensors
• Run analytics on the raw data and provide insights on real-time
• Present the results in a comprehensive manner, easily accessible to the City-operators
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
SCATS-Analytics: Architecture Overview
• Real-time data stream is stored on a database
• The analytics run offline on fixed intervals producing the models for each detector
• Web application connects to real-time data stream, obtains the trained models and
performs online classification and detection
Historical Data
SCATS
Sensors
Trained Models
For Detectors
Analytics
WEB
Application
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
SCATS-Analytics: Challenges
• The input data were unfiltered and many times contained erroneous entries
• The large amount of data volume produced made it challenging to perform analytics
• The real-time KPIs were necessary to be extracted as fast as possible in order to give the
City-operator prompt input for decision-making
• Finally, the results of all those advanced analytics should be presented to the domain
expert in a user-friendly and comprehensive way
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
SCATS-Analytics: State Classification Scheme
Free flow F
Congestion C
Transient states U
(due to “network-effects”)
Optimal
service rate
Characterization of network traffic processes under adaptive traffic control systems
A. Pascale, T.L. Hoang, R. Nair
21st International Symposium on Transporation and Traffic Theory, 2015
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation8
SCATS-Analytics: City-wide overview
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation9
SCATS-Analytics: Historical data inspection
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
SCATS-Analytics: Lessons Learned
• Available Open Data are useful to be incorporated in the process of decision-making, but
domain knowledge is required to fully leverage on them.
• Investing on improving the quality and the availability of data sources can only be beneficial
for the citizens
• When designing a platform, it's necessary to keep the end-user involved in the process of
the development, looking for feedback and in the end creating a high-level user experience
© 2010 IBM Corporation
IBM Research - Ireland
© 2014 IBM Corporation
THANK YOU
Questions?

More Related Content

PDF
Utrecht Region : healthy urban living
PPTX
Catch! Workshop concept 2 - Improving travel plan monitoring with better, mor...
PPTX
Catch! Workshop concept 1 - Using data to minimise the disruption of infrastr...
PDF
RIPE NCC Operator Tools
PDF
coweta-county-georgia
PPTX
Transport Systems Innovation Workshop
PPTX
PLS 2016: SMART CITIES are they really happening?
PDF
Workshop on Vehicular Networks and Sustainable Mobility Testbed - Tânia calça...
Utrecht Region : healthy urban living
Catch! Workshop concept 2 - Improving travel plan monitoring with better, mor...
Catch! Workshop concept 1 - Using data to minimise the disruption of infrastr...
RIPE NCC Operator Tools
coweta-county-georgia
Transport Systems Innovation Workshop
PLS 2016: SMART CITIES are they really happening?
Workshop on Vehicular Networks and Sustainable Mobility Testbed - Tânia calça...

What's hot (20)

PDF
Mapping the Digital Infrastructure Future
PPTX
Catch! - The project, the data & the challenge
PPTX
DSUG Fall2017: The Digitalized Utility and Digitalized Worker – New York Powe...
PDF
2015.09.18 Improving Highway Traffic Flows Using Smart Technologies
PDF
Asset View High level Datasheet
PDF
Turn Flows Presentation 2 (Daniel C Follett)
PDF
Community Networks: An Alternative Paradigm for Developing Network Infrastruc...
PPTX
Bruce Thompson on digital disruption and the environment
PDF
2015.09.07 IMPROVING HIGHWAY TRAFFIC FLOWS USING SMART TECHNOLOGIES
PPTX
The Mobile Internet: Meeting Demand and Growing Profitably
PPTX
Catch! Workshop concept 4 - Transforming Home-to-School transport with target...
PDF
Expectations for 5 g in future automated vehicle applications r4
PPT
LG Inform and other public sector APIs to build apps
PDF
Workshop on Cyber-physical Systems Platforms – Tânia Calçada “UrbanSense Plat...
PPTX
Visualizing Cellular Audience for Streaming KPI's
PPTX
PLS 2017: Smart street lighting: sensors vs big data
PDF
AsstrA Supplier's Portal
PPTX
District Level Integration
PDF
How fleet advantage analytics uses predic engine and iot with machine learning
PDF
Sss14duke BT Innovate Research Design
Mapping the Digital Infrastructure Future
Catch! - The project, the data & the challenge
DSUG Fall2017: The Digitalized Utility and Digitalized Worker – New York Powe...
2015.09.18 Improving Highway Traffic Flows Using Smart Technologies
Asset View High level Datasheet
Turn Flows Presentation 2 (Daniel C Follett)
Community Networks: An Alternative Paradigm for Developing Network Infrastruc...
Bruce Thompson on digital disruption and the environment
2015.09.07 IMPROVING HIGHWAY TRAFFIC FLOWS USING SMART TECHNOLOGIES
The Mobile Internet: Meeting Demand and Growing Profitably
Catch! Workshop concept 4 - Transforming Home-to-School transport with target...
Expectations for 5 g in future automated vehicle applications r4
LG Inform and other public sector APIs to build apps
Workshop on Cyber-physical Systems Platforms – Tânia Calçada “UrbanSense Plat...
Visualizing Cellular Audience for Streaming KPI's
PLS 2017: Smart street lighting: sensors vs big data
AsstrA Supplier's Portal
District Level Integration
How fleet advantage analytics uses predic engine and iot with machine learning
Sss14duke BT Innovate Research Design
Ad

Viewers also liked (14)

PDF
RESULTS SUMMARY
PPTX
social media with Northwestern Technologies
PDF
Briceño salud mental y globalización
DOCX
Celebrity branding
PDF
Learn Android Programming, Make Money
PDF
Energy business opportunities in mexico
PPTX
Nintendo VIDEOJUEGOS CULTURA
PDF
Для ценителей прекрасного (GiftsPro)
PDF
Зелень для весны (GiftsPro)
DOCX
Actividad 3 Construcción de un sitio web de comercio electronico
PPSX
Hvordan bruger jeg lægdsruller i min slægtsforskning
PPT
Course work briefs
PDF
054 ครอบครัวไทยเป็นสุข1
PPTX
Who Am I Terri Worman
RESULTS SUMMARY
social media with Northwestern Technologies
Briceño salud mental y globalización
Celebrity branding
Learn Android Programming, Make Money
Energy business opportunities in mexico
Nintendo VIDEOJUEGOS CULTURA
Для ценителей прекрасного (GiftsPro)
Зелень для весны (GiftsPro)
Actividad 3 Construcción de un sitio web de comercio electronico
Hvordan bruger jeg lægdsruller i min slægtsforskning
Course work briefs
054 ครอบครัวไทยเป็นสุข1
Who Am I Terri Worman
Ad

Similar to Data Driven Tranportation Analytics (20)

PPT
Od ifriday openraildata
PPT
How can Open Data Revolutionise your Rail Travel?
PDF
Next genits closing_event
PPT
Disruptive open transport data
PDF
Big data week l'impact du big data sur l'intelligence urbaine ibm research ...
PPTX
DEVNET-1145 How APIs are Driving City Digitization
PDF
Mobile QoS Management using Complex Event Processing
PDF
Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia
PDF
New Technologies to Shape The Future of Transport - It’s About the Data - Dav...
PPTX
inLab FIB Presentation at ICT2013EU
PDF
Wireless communication in big data era vfinal upload
PDF
InLab FIB (UPC) Presentation
PPT
A Full End-to-End Platform as a Service for Smart City Applications
PDF
iot-and-smart-cities-lea-blackstock
PPTX
Mashup & case study
PPTX
How Spark Enables the Internet of Things: Efficient Integration of Multiple ...
PDF
Transport for London - Using Data to Keep London Moving
PPTX
Real time path planning based on hybrid vanet enhanced transportation system
PDF
Internet Measurements Infrastructure at KENET
PPTX
How Spark Enables the Internet of Things- Paula Ta-Shma
Od ifriday openraildata
How can Open Data Revolutionise your Rail Travel?
Next genits closing_event
Disruptive open transport data
Big data week l'impact du big data sur l'intelligence urbaine ibm research ...
DEVNET-1145 How APIs are Driving City Digitization
Mobile QoS Management using Complex Event Processing
Confluent Cloud inside the Digital Transformation of Autostrade per l’Italia
New Technologies to Shape The Future of Transport - It’s About the Data - Dav...
inLab FIB Presentation at ICT2013EU
Wireless communication in big data era vfinal upload
InLab FIB (UPC) Presentation
A Full End-to-End Platform as a Service for Smart City Applications
iot-and-smart-cities-lea-blackstock
Mashup & case study
How Spark Enables the Internet of Things: Efficient Integration of Multiple ...
Transport for London - Using Data to Keep London Moving
Real time path planning based on hybrid vanet enhanced transportation system
Internet Measurements Infrastructure at KENET
How Spark Enables the Internet of Things- Paula Ta-Shma

More from Dublinked . (20)

PDF
Route to PA Project Meeting Dublinked Presentation 03.12.2015
PDF
Boost you Open Data with Co-Creation
PDF
Housing Intelligence for Dublin
PDF
Organicity - Co-creating Future Cities
PPT
The Local Asset Mapping Project (LAMP)
PPT
The 1911 Census
PPT
Future Skills Needs for Data and Analytics
PDF
Girls Hack Ireland
PDF
Dublinked - Celebrating Over Three Years of Open Data for the Dublin Region
PPTX
The CSO Open Data Experience
PPTX
Data, Infrastructure and Public Policy
PPTX
Startup Ireland and the Startup Gathering 2015
PDF
Catalysing research and enterprise collaboration in the data ecosystem
PDF
Open Data StartUp Stories in Ireland
PPTX
Roscommon County Council Open Data Portal
PPTX
Developing technology solutions for communities
PPTX
Open Data Ireland: Developing a national open data strategy
PDF
Open Knowledge Ireland
PDF
The Irish Times Data Blog
PPTX
Open Data: an Open and Shut Case?
Route to PA Project Meeting Dublinked Presentation 03.12.2015
Boost you Open Data with Co-Creation
Housing Intelligence for Dublin
Organicity - Co-creating Future Cities
The Local Asset Mapping Project (LAMP)
The 1911 Census
Future Skills Needs for Data and Analytics
Girls Hack Ireland
Dublinked - Celebrating Over Three Years of Open Data for the Dublin Region
The CSO Open Data Experience
Data, Infrastructure and Public Policy
Startup Ireland and the Startup Gathering 2015
Catalysing research and enterprise collaboration in the data ecosystem
Open Data StartUp Stories in Ireland
Roscommon County Council Open Data Portal
Developing technology solutions for communities
Open Data Ireland: Developing a national open data strategy
Open Knowledge Ireland
The Irish Times Data Blog
Open Data: an Open and Shut Case?

Recently uploaded (20)

PPTX
climate analysis of Dhaka ,Banglades.pptx
PPT
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
1_Introduction to advance data techniques.pptx
PPTX
CEE 2 REPORT G7.pptxbdbshjdgsgjgsjfiuhsd
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
PPTX
Supervised vs unsupervised machine learning algorithms
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
PPTX
Introduction to Knowledge Engineering Part 1
PDF
Lecture1 pattern recognition............
PPT
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
PPTX
Business Ppt On Nestle.pptx huunnnhhgfvu
PPTX
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
PPTX
STUDY DESIGN details- Lt Col Maksud (21).pptx
PPTX
Database Infoormation System (DBIS).pptx
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
climate analysis of Dhaka ,Banglades.pptx
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
1_Introduction to advance data techniques.pptx
CEE 2 REPORT G7.pptxbdbshjdgsgjgsjfiuhsd
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
IBA_Chapter_11_Slides_Final_Accessible.pptx
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
Supervised vs unsupervised machine learning algorithms
Introduction-to-Cloud-ComputingFinal.pptx
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
Introduction to Knowledge Engineering Part 1
Lecture1 pattern recognition............
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
Business Ppt On Nestle.pptx huunnnhhgfvu
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
STUDY DESIGN details- Lt Col Maksud (21).pptx
Database Infoormation System (DBIS).pptx
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx

Data Driven Tranportation Analytics

  • 1. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation Francesco Calabrese, Yiannis Gkoufas IBM Research - Ireland Data driven transportation analytics
  • 2. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation Data-driven decision making in Transportation and City-Planning • In the era of Big Data, authorities are provided with a rapidly increasing number of datasets and data-streams to facilitate them in monitoring and planning on a city level • The goal is to empower the city operators to take advantage of those data and provide better services to the citizens • In the last decade, a lot of city-wide sensoring systems have been installed to various cities in the world. Our research focus is the SCATS System in the City of Dublin
  • 3. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation SCATS System in Dublin • Intelligent Transportation System which involves installation of sensors on the intersections of the City which monitor and report various KPIs related to traffic flow (saturation, flow, green time, etc) • The Dublin system is deployed across 550 intersections with 3300 sensors in total and generating 150MB/hour • Historical data are publicly available in the Dublinked website: • http://dublinked.com/datastore/datasets/dataset-289.php • http://dublinked.com/datastore/datasets/dataset-305.php • http://dublinked.com/datastore/datasets/dataset-274.php time
  • 4. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation Goals of SCATS-Analytics Platform • Leverage both open data stream and historical data obtained from Dublin's SCATS sensors • Run analytics on the raw data and provide insights on real-time • Present the results in a comprehensive manner, easily accessible to the City-operators
  • 5. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation SCATS-Analytics: Architecture Overview • Real-time data stream is stored on a database • The analytics run offline on fixed intervals producing the models for each detector • Web application connects to real-time data stream, obtains the trained models and performs online classification and detection Historical Data SCATS Sensors Trained Models For Detectors Analytics WEB Application
  • 6. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation SCATS-Analytics: Challenges • The input data were unfiltered and many times contained erroneous entries • The large amount of data volume produced made it challenging to perform analytics • The real-time KPIs were necessary to be extracted as fast as possible in order to give the City-operator prompt input for decision-making • Finally, the results of all those advanced analytics should be presented to the domain expert in a user-friendly and comprehensive way
  • 7. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation SCATS-Analytics: State Classification Scheme Free flow F Congestion C Transient states U (due to “network-effects”) Optimal service rate Characterization of network traffic processes under adaptive traffic control systems A. Pascale, T.L. Hoang, R. Nair 21st International Symposium on Transporation and Traffic Theory, 2015
  • 8. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation8 SCATS-Analytics: City-wide overview
  • 9. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation9 SCATS-Analytics: Historical data inspection
  • 10. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation SCATS-Analytics: Lessons Learned • Available Open Data are useful to be incorporated in the process of decision-making, but domain knowledge is required to fully leverage on them. • Investing on improving the quality and the availability of data sources can only be beneficial for the citizens • When designing a platform, it's necessary to keep the end-user involved in the process of the development, looking for feedback and in the end creating a high-level user experience
  • 11. © 2010 IBM Corporation IBM Research - Ireland © 2014 IBM Corporation THANK YOU Questions?