SlideShare a Scribd company logo
Open, Convert, Use
The Citadel Open Data ecosystem
What is Citadel?
• Citadel is a project co-funded by the EC
–
–
–
–
–

To create a common European open data ecosystem
To allow apps to be used in different cities
To make it easy to open up data (for cities)
To make it easy to use this data (for citizens and developers )
Not only through standards, but through easy and usable tools as well

Open

Convert

Use
Open

• Many governments are opening up data
• Citadel focuses on cities
– Strong links with local community
– But often lack in ICT budgets or know how (small cities)
– Strong demand for Open Data!!
Citadel technical
Benefits
• Inform
– Allergies?
– Make it visible which trees will need to be cut soon
– Remarkable trees

• Engage citizens to identify risks, diseases
• Crowd-source the information in a timely manner
• Fun
What took us so long?
•
•
•
•

We don’t check each tree every week
We don’t want to provide data that is inaccurate
We don’t have the exact geo-location for every tree.
We don’t know what the best format is to do so
CSV
The Swiss army knife of open data
•
•
•
•
•
•

simple
common
non-proprietary
easy to export (from Ecxel)
readable
…
CSV
CSV doesn’t always cut it
• Different delimiters (tabs, semicolons, commas)
– “F. Mercury; musician” ≠ “F. Mercury”; “Musician”

•
•
•
•

Encoding hell (Greek characters?)
Different line endings on different operating systems
Often has markup, subtitles, etc…
No semantics (which column names are used in France?)
JRC Forest Map 2000. Source: EC-JRC – FRC Unit (earthzine.org)
Open

Convert

Use
Platform concept
• Open
– Anyone can do it: publishing Excel files is a good
start

• Convert
– Converter tools transform and publish CSV/Excel
files (the majority of datasets) as “live” JSON files

• Use
– The App Generator Tool allows you to immediately
use selected datasets
ODC architecture
Converter development
• Version 1: on-line PHP
– Test concept with partners and cities
– Quick & dirty, but very simple to understand

• Version 2: off-line Java
– More complex semantic functions
– More stable development, possible batch use

• Version 3: on-line Java
– Anytime, anywhere
Demo

Converter

Data Days 2014, Ghent, 18 Feb 2014
Interaction with Cities
• Enthusiastic reaction (we got something right)
– 16 datasets converted over winter holidays

• Empowering civil servants as co-designers
– Experimenting with prototypes, betas

• Motivating for data quality
– Seeing the process end-to-end
Ecosystem development
• Converter enhancements
– Adaptations to convert other datasets

• New templates
– New templates can be developed for different
data structures (eg socio-economic data)

• Dataset enhancements
– “Rich” datasets (eg containing links in text fields)
can link to external functionalities (ie reservations)
Next Steps
• Mobile access
– Integration with AGT for on-the-fly conversions

• Support on-going day-to-day use
– Save semantic mappings for re-use
– Support batch processing
– Integrate with AGT dataset listings

• Continue co-design with pilots
Open

Convert

Use
Citadel lifecycle

Open

Convert

Data Days 2014, Ghent, 18 Feb 2014

Use
Data (re-)use
• Thousands of datasets are published every day
– by public and private sources
– in different formats
– in many different domains

• Is there any value in publishing them?
• Is it worth the effort/cost?
• How are they used?

Data Days 2014, Ghent, 18 Feb 2014
Citadel approach
• Make it easy to publish data
• Make it easy for people to use data
• Quick and simple apps
– Increase the citizens’ innovation potential
– Demonstrate the value of the dataset

– Apps that can be used in different cities

Data Days 2014, Ghent, 18 Feb 2014
How this is achieved
• Mobile application templates (for different
types of data)
–
–
–
–
–

Parking
Events in the city
Points of Interest in the city
Crowd-sourcing Information
Environmental Data

• Application Generation Tool
– 4 steps to create an app

• Citadel Hub
– Documentation, resources, discussion forum
Data Days 2014, Ghent, 18 Feb 2014
Citadel Mobile Application Templates
• Common template features:
– HTML5, jQuery mobile, php ( + mysql)
– Datasets in common JSON format
• Environmental uses Xively feeds

– 'Near-me' functionality using HTML5 geo-location feature
– Map and list views
– Category based filtering
• All categories loaded dynamically

– Back end functionality for storage
Data Days 2014, Ghent, 18 Feb 2014
Parking places
• Information about the parking lots in a city
• List of total/available parking places
• List of places for disabled's people vehicles
• Variation: On-Street parking

Data Days 2014, Ghent, 18 Feb 2014
Events in the city
• Different event
categories: festivals,
exhibitions,

presentations, etc.
• Detailed description of
each event: time, place,
fees, transportation,
pictures
• Filter by date
• Add to favorites

Data Days 2014, Ghent, 18 Feb 2014
Points of Interest (PoIs) in the city
• Different categories of
PoIs: museums, hotels,
restaurants, etc.
• Filtering function
• Detailed description of
each PoI
• Voting mechanism
• Add to favorites

Data Days 2014, Ghent, 18 Feb 2014
User-generated PoIs or crowd-sourced
information
• “Add new PoI”
functionality
• Different categories of
user-generated PoIs
• Detailed description of
each user-generated
PoI
• “Add to favourites”

Data Days 2014, Ghent, 18 Feb 2014
Environmental data
• Xively feeds
• Environmental data for
different locations

(simulation of live feeds
for Athens and
Manchester).
• Available sensors shown
on the map
• Detailed page shows
environmental data for
each sensor (including
historical data)
Data Days 2014, Ghent, 18 Feb 2014
Demo

AGT

Data Days 2014, Ghent, 18 Feb 2014
Application Generation Tool
Screenshots 1/2

Data Days 2014, Ghent, 18 Feb 2014
Application Generation Tool
Screenshots 2/2

Data Days 2014, Ghent, 18 Feb 2014
In summary...
• The power of open data lies, not only on publishing,
but on re-using
 Public administrators become aware of what data
is useful or interesting for citizens
 The relationship between City officials and
citizens is strengthened
 The innovation potential of citizens increases in a
very participatory way

Data Days 2014, Ghent, 18 Feb 2014
Thank you!
Open
Convert
Use

Thimo Thoeye (City of Gent)
Jesse Marsh (Alfamicro)
Evangelos Argyzoudis (Intrasoft Intl)

Data Days 2014, Ghent, 18 Feb 2014
Thank you for your attention
Thimo Thoeye (Stad Gent), thimothoeye@gmail.com
Jesse Marsh (Alfamicro), jesse@atelier.it
Leonardo Dal Zovo (Alfamicro), ldalzovo@gmail.com
Evangelos Argyzoudis (Intrasoft), evangelos.argyzoudis@intrasoft-intl.com
Leonidas Kallipolitis, l.kallipolitis@atc.gr

More Related Content

PDF
11 Open data and Data Sources
PPTX
INSPIRING CAPABILITIES OF USING LITHUANIAN SPATIAL DATA PORTAL
PDF
Building smart green mobility in South Tyrol through an open data hub
PDF
Rolling Climate Change, Transportation & Land Use Planning into One Innovativ...
PPTX
Turku Random Tour presentation
PPTX
Opendata Zurich @ ENERGIC-Workshop GIUZ
PDF
Atlas of Innovation Spaces
PDF
DSD-INT 2016 A crowd-sourced spatial database can change the way we work - Va...
11 Open data and Data Sources
INSPIRING CAPABILITIES OF USING LITHUANIAN SPATIAL DATA PORTAL
Building smart green mobility in South Tyrol through an open data hub
Rolling Climate Change, Transportation & Land Use Planning into One Innovativ...
Turku Random Tour presentation
Opendata Zurich @ ENERGIC-Workshop GIUZ
Atlas of Innovation Spaces
DSD-INT 2016 A crowd-sourced spatial database can change the way we work - Va...

What's hot (12)

PDF
HRI presentation smart environmental information seminar - 31Oct2013
PPTX
Introduction to OpenStreetMap
PPTX
E&L-presentatie - Linked Data Benchmark Council
PPTX
What's up, Europeana Newspapers?
PPTX
JRC, GHA Live presentation: Maps, GISs and SDIs
ODP
Introduction to OpenStreetMap - UCC YouthMappers
PDF
Open data hackathon jelgava - report
PDF
Werner Zanotti - Brixen Tourismus - New web portal brixen.org and integration...
PDF
Unfolding the City
PDF
2017 iii 3_jiri_polacek_inspire_implementationasalinkbetweenegovernmentandenv...
PPT
Jordi Martí-Henneberg, Luís Espinha da Silveira, Daniel Alves & Josep Puig,To...
PDF
Dublinked Data Visualisation Competition Launch Event - AIRO NUIM Presentation
HRI presentation smart environmental information seminar - 31Oct2013
Introduction to OpenStreetMap
E&L-presentatie - Linked Data Benchmark Council
What's up, Europeana Newspapers?
JRC, GHA Live presentation: Maps, GISs and SDIs
Introduction to OpenStreetMap - UCC YouthMappers
Open data hackathon jelgava - report
Werner Zanotti - Brixen Tourismus - New web portal brixen.org and integration...
Unfolding the City
2017 iii 3_jiri_polacek_inspire_implementationasalinkbetweenegovernmentandenv...
Jordi Martí-Henneberg, Luís Espinha da Silveira, Daniel Alves & Josep Puig,To...
Dublinked Data Visualisation Competition Launch Event - AIRO NUIM Presentation
Ad

Viewers also liked (8)

PDF
Dynacity Data Challenge
PPTX
Citadel
PDF
Flagis Academic Session
PPTX
Linked Open Data @ Stad Gent
PDF
Apps 4 dummies shopt IT (V-ICT-OR)
PDF
Open Data in Gent
PDF
Breadcrumbs presentatie
PDF
Dynacity Data Challenge
Citadel
Flagis Academic Session
Linked Open Data @ Stad Gent
Apps 4 dummies shopt IT (V-ICT-OR)
Open Data in Gent
Breadcrumbs presentatie
Ad

Similar to Citadel technical (20)

PDF
Initiative CityData30 in Geomundus
PPTX
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
PDF
'Smart Cities'/'Open Data' event in Westminster on 13/11/14: AB, AS and BC pr...
PPTX
Ontology Engineering at Scale for Open City Data Sharing
PDF
Open Data Portals: 9 Solutions and How they Compare
PPTX
Data Days: Citadel pilots results
PPTX
صحافة البيانات والمعلومات
PPTX
Linked Open Data
PPT
Open Data Trentino - Seminar at Universidad Simon Bolivar - 15th October 2013
PPTX
Open Data policy implementations: Creating economic value
PDF
Lorena Pocatilu - strategies for smart city knowledge platform and open data
PDF
The recovery of netherlands geographic information system (nlgis 2)
 
PDF
Workshop: Open Data - What's the Point?
PPTX
Open Data Aha! Renfrewshire Open Data 'Enlightenment' event
PPT
Open Data in Gdansk
PPT
Tomasz Nadolny: Open Data in Gdańsk
PPT
Open Gdansk - Analitics Conf - Gdansk
PPTX
‘What IN the WORLD is Open data anyway?’ and other valid questions | Julia Gl...
PPSX
Fortune Time Institute: Big Data - Challenges for Smartcity
PDF
Introduction to open data
Initiative CityData30 in Geomundus
Citadel Apps4Dummies London Workshop - 13th Nov 2014 - Adrain Slatcher, Alice...
'Smart Cities'/'Open Data' event in Westminster on 13/11/14: AB, AS and BC pr...
Ontology Engineering at Scale for Open City Data Sharing
Open Data Portals: 9 Solutions and How they Compare
Data Days: Citadel pilots results
صحافة البيانات والمعلومات
Linked Open Data
Open Data Trentino - Seminar at Universidad Simon Bolivar - 15th October 2013
Open Data policy implementations: Creating economic value
Lorena Pocatilu - strategies for smart city knowledge platform and open data
The recovery of netherlands geographic information system (nlgis 2)
 
Workshop: Open Data - What's the Point?
Open Data Aha! Renfrewshire Open Data 'Enlightenment' event
Open Data in Gdansk
Tomasz Nadolny: Open Data in Gdańsk
Open Gdansk - Analitics Conf - Gdansk
‘What IN the WORLD is Open data anyway?’ and other valid questions | Julia Gl...
Fortune Time Institute: Big Data - Challenges for Smartcity
Introduction to open data

More from Thimo Thoeye (6)

PDF
Linked open data sandwich
PPTX
TechBoost 2017
PDF
Stad Gent & OSLO²
PDF
Innovating Cities with Nature (EUROCITIES)
PDF
UDMS 24/04/2015
PPTX
De Krook@Stuurgroep GLL
Linked open data sandwich
TechBoost 2017
Stad Gent & OSLO²
Innovating Cities with Nature (EUROCITIES)
UDMS 24/04/2015
De Krook@Stuurgroep GLL

Citadel technical

  • 1. Open, Convert, Use The Citadel Open Data ecosystem
  • 2. What is Citadel? • Citadel is a project co-funded by the EC – – – – – To create a common European open data ecosystem To allow apps to be used in different cities To make it easy to open up data (for cities) To make it easy to use this data (for citizens and developers ) Not only through standards, but through easy and usable tools as well Open Convert Use
  • 3. Open • Many governments are opening up data • Citadel focuses on cities – Strong links with local community – But often lack in ICT budgets or know how (small cities) – Strong demand for Open Data!!
  • 5. Benefits • Inform – Allergies? – Make it visible which trees will need to be cut soon – Remarkable trees • Engage citizens to identify risks, diseases • Crowd-source the information in a timely manner • Fun
  • 6. What took us so long? • • • • We don’t check each tree every week We don’t want to provide data that is inaccurate We don’t have the exact geo-location for every tree. We don’t know what the best format is to do so
  • 7. CSV The Swiss army knife of open data • • • • • • simple common non-proprietary easy to export (from Ecxel) readable …
  • 8. CSV CSV doesn’t always cut it • Different delimiters (tabs, semicolons, commas) – “F. Mercury; musician” ≠ “F. Mercury”; “Musician” • • • • Encoding hell (Greek characters?) Different line endings on different operating systems Often has markup, subtitles, etc… No semantics (which column names are used in France?)
  • 9. JRC Forest Map 2000. Source: EC-JRC – FRC Unit (earthzine.org)
  • 11. Platform concept • Open – Anyone can do it: publishing Excel files is a good start • Convert – Converter tools transform and publish CSV/Excel files (the majority of datasets) as “live” JSON files • Use – The App Generator Tool allows you to immediately use selected datasets
  • 13. Converter development • Version 1: on-line PHP – Test concept with partners and cities – Quick & dirty, but very simple to understand • Version 2: off-line Java – More complex semantic functions – More stable development, possible batch use • Version 3: on-line Java – Anytime, anywhere
  • 14. Demo Converter Data Days 2014, Ghent, 18 Feb 2014
  • 15. Interaction with Cities • Enthusiastic reaction (we got something right) – 16 datasets converted over winter holidays • Empowering civil servants as co-designers – Experimenting with prototypes, betas • Motivating for data quality – Seeing the process end-to-end
  • 16. Ecosystem development • Converter enhancements – Adaptations to convert other datasets • New templates – New templates can be developed for different data structures (eg socio-economic data) • Dataset enhancements – “Rich” datasets (eg containing links in text fields) can link to external functionalities (ie reservations)
  • 17. Next Steps • Mobile access – Integration with AGT for on-the-fly conversions • Support on-going day-to-day use – Save semantic mappings for re-use – Support batch processing – Integrate with AGT dataset listings • Continue co-design with pilots
  • 19. Citadel lifecycle Open Convert Data Days 2014, Ghent, 18 Feb 2014 Use
  • 20. Data (re-)use • Thousands of datasets are published every day – by public and private sources – in different formats – in many different domains • Is there any value in publishing them? • Is it worth the effort/cost? • How are they used? Data Days 2014, Ghent, 18 Feb 2014
  • 21. Citadel approach • Make it easy to publish data • Make it easy for people to use data • Quick and simple apps – Increase the citizens’ innovation potential – Demonstrate the value of the dataset – Apps that can be used in different cities Data Days 2014, Ghent, 18 Feb 2014
  • 22. How this is achieved • Mobile application templates (for different types of data) – – – – – Parking Events in the city Points of Interest in the city Crowd-sourcing Information Environmental Data • Application Generation Tool – 4 steps to create an app • Citadel Hub – Documentation, resources, discussion forum Data Days 2014, Ghent, 18 Feb 2014
  • 23. Citadel Mobile Application Templates • Common template features: – HTML5, jQuery mobile, php ( + mysql) – Datasets in common JSON format • Environmental uses Xively feeds – 'Near-me' functionality using HTML5 geo-location feature – Map and list views – Category based filtering • All categories loaded dynamically – Back end functionality for storage Data Days 2014, Ghent, 18 Feb 2014
  • 24. Parking places • Information about the parking lots in a city • List of total/available parking places • List of places for disabled's people vehicles • Variation: On-Street parking Data Days 2014, Ghent, 18 Feb 2014
  • 25. Events in the city • Different event categories: festivals, exhibitions, presentations, etc. • Detailed description of each event: time, place, fees, transportation, pictures • Filter by date • Add to favorites Data Days 2014, Ghent, 18 Feb 2014
  • 26. Points of Interest (PoIs) in the city • Different categories of PoIs: museums, hotels, restaurants, etc. • Filtering function • Detailed description of each PoI • Voting mechanism • Add to favorites Data Days 2014, Ghent, 18 Feb 2014
  • 27. User-generated PoIs or crowd-sourced information • “Add new PoI” functionality • Different categories of user-generated PoIs • Detailed description of each user-generated PoI • “Add to favourites” Data Days 2014, Ghent, 18 Feb 2014
  • 28. Environmental data • Xively feeds • Environmental data for different locations (simulation of live feeds for Athens and Manchester). • Available sensors shown on the map • Detailed page shows environmental data for each sensor (including historical data) Data Days 2014, Ghent, 18 Feb 2014
  • 29. Demo AGT Data Days 2014, Ghent, 18 Feb 2014
  • 30. Application Generation Tool Screenshots 1/2 Data Days 2014, Ghent, 18 Feb 2014
  • 31. Application Generation Tool Screenshots 2/2 Data Days 2014, Ghent, 18 Feb 2014
  • 32. In summary... • The power of open data lies, not only on publishing, but on re-using  Public administrators become aware of what data is useful or interesting for citizens  The relationship between City officials and citizens is strengthened  The innovation potential of citizens increases in a very participatory way Data Days 2014, Ghent, 18 Feb 2014
  • 33. Thank you! Open Convert Use Thimo Thoeye (City of Gent) Jesse Marsh (Alfamicro) Evangelos Argyzoudis (Intrasoft Intl) Data Days 2014, Ghent, 18 Feb 2014
  • 34. Thank you for your attention Thimo Thoeye (Stad Gent), thimothoeye@gmail.com Jesse Marsh (Alfamicro), jesse@atelier.it Leonardo Dal Zovo (Alfamicro), ldalzovo@gmail.com Evangelos Argyzoudis (Intrasoft), evangelos.argyzoudis@intrasoft-intl.com Leonidas Kallipolitis, l.kallipolitis@atc.gr

Editor's Notes

  • #21: In the case of Citadel we deal with public sources: municipalities which are either well-established in the open data field (e.g. Ghent or Manchester) but also cities which are in their infancy, in terms of open data.A common problem they have is that they don’t know how the data they publish are being used.How is the value of a dataset determined?By how hard it is to publish it?By how hard it is to keep it updated?How useful is it?