SlideShare a Scribd company logo
RESTorestful semantic search tool for geospatial
Jérôme Gasperi
RESTo - restful semantic search tool for geospatial
is an implementation of OGC13-026 OpenSearch
Extension for Earth Observation
Architecture
PostgreSQL
Gazetteer
Collection	

Manager
Resource	

Manager
Query	

Storage
Query	

Analyzer
RESTo modules
More to
come...
RESTo backend
PostGIS
hstore
uses
RESTofrontend
mapshup iTag
Core
RESTo
External services
resto db
EO
collections *
(*) Collections can be stored within
RESTo database or in external
databases
PHP
javascript PHP
RESTo
Services
Admin
https POST
Ingest metadata
INGEST
ScriptsDownload
http GET
THEIA
metacatalog
HMA
catalog
CEOS
http GET
(ATOM, GeoJSON)
User
http GET
SEARCH
(HTML)
R R Rreliablerestful responsive
Rrestful
GET / List all collections
POST / Create a new collection
GET /collection/$describe Describe collection OpenSearch service
GET /collection Search collection
POST /collection Insert a resource within collection
DELETE /collection Delete collection
PUT /collection Update collection
GET /collection/identifier Show resource metadata
GET /collection/identifier/$download Download resource product
Rresponsive
DesktopsTabletsMobiles
0 to 500 px 501 to 959 px 960 to > 1280 px
Rreliable
Time period of 1 month within a 10x10 km2 box
SEARCH
INGEST
0.2s
0.5s
1 000 000
SPOT DATABASENew products retrieved every 3 hours from ADS catalog
Per product for a ~5000 products ingestion
Order of magnitude compute on a Dual Core 2.6 GHz | 4 Go RAM | HDD 500 To
RRESTo
IngestSearch
POSTGET
RRESTo
Ingest
POST
During ingestion process , resources are automatically
tagged with location and land use
github.com/jjrom/itag
!
Tag this footprint with continent, country and Land use
!
http://goo.gl/WtbcbR

iTag
Additionally, conditional ingestion rules can be defined at
the collection level to provide specific tags
Add tags #mh370,#plane,#malaysianairline
to resources acquired between 2014, march 8th and 2014, april 14th
in the south of the Indian Ocean
!
http://goo.gl/W8VlPV
e.g.
RRESTo
Search
GET
RESTo provides semantic search capabilities
It uses a Query Analyzer to translate natural language query into
a set of EO OpenSearch parameters
Query Analyzer goodies
Multilingual - current languages are EN, FR, IT and DE
Synonyms supported (e.g. unit «m» is «m», «meter» or «meters»)
Each collection can define its own dedicated keywords
Automatic typing error correction using similarity
Embed a Gazetteer containing ~9 000 000 toponyms
« Images of urban area in the US acquired in the last 10 days with less than 5 % of cloud cover »
Example
« Images of urban area in the US acquired in the last 10 days with less than 5 % of cloud cover »
Example
keyword location date acquisition parameter
2. Each search result has an « human readable url » that can
be indexed by web crawler (i.e. google robots)
1. Search parameters are derived from
Natural Language query
3. Keywords on resources are links to search requests :
they can be indexed by web crawler…and so on
Search (example)
2. Each search result has an « human readable url » that can
be indexed by web crawler (i.e. google robots)
1. Search parameters are derived from
Natural Language query
3. Keywords on resources are links to search requests :
they can be indexed by web crawler…and so on
Search (example)
http://goo.gl/GvMEHj
http://mapshup.info/resto
!
github.com/jjrom/resto

More Related Content

PPTX
Try It The Google Way .
PPTX
Bridging Batch and Real-time Systems for Anomaly Detection
PPTX
Introduction to Apache Pig
DOCX
PDF
Chunked, dplyr for large text files
PPTX
Frequent Itemset Mining on BigData
PPTX
SH 2 - SES 3 - MongoDB Aggregation Framework.pptx
PDF
Docopt, beautiful command-line options for R, user2014
Try It The Google Way .
Bridging Batch and Real-time Systems for Anomaly Detection
Introduction to Apache Pig
Chunked, dplyr for large text files
Frequent Itemset Mining on BigData
SH 2 - SES 3 - MongoDB Aggregation Framework.pptx
Docopt, beautiful command-line options for R, user2014

What's hot (20)

KEY
Papyri.info's Linked Data Story
PDF
The Directions Pipeline at Mapbox - AWS Meetup Berlin June 2015
PDF
Influxdb and time series data
PPTX
2014 moore-ddd
PDF
What is Dictionary In Python? Python Dictionary Tutorial | Edureka
PDF
Be lazy & scale
PPT
Mapreduce in Search
PPTX
DataStructure Concepts-HEAP,HASH,Graph
PPTX
Big Data Science with H2O in R
PPTX
Team3 presentation
PDF
Big Data Day LA 2015 - Large Scale Distinct Count -- The HyperLogLog algorith...
PPTX
Android Lab Test : Reading the foot file list (english)
PPTX
Big Data & Hadoop Data Analysis
PPTX
Cscope and ctags
PDF
Insight_150115_Demo
PDF
HyperLogLog in Hive - How to count sheep efficiently?
PDF
Using Free and Open Source GIS to Automatically Create Standards-Based Spatia...
PDF
PyCon 2012 - Data Driven Design
PPT
Repl internals
Papyri.info's Linked Data Story
The Directions Pipeline at Mapbox - AWS Meetup Berlin June 2015
Influxdb and time series data
2014 moore-ddd
What is Dictionary In Python? Python Dictionary Tutorial | Edureka
Be lazy & scale
Mapreduce in Search
DataStructure Concepts-HEAP,HASH,Graph
Big Data Science with H2O in R
Team3 presentation
Big Data Day LA 2015 - Large Scale Distinct Count -- The HyperLogLog algorith...
Android Lab Test : Reading the foot file list (english)
Big Data & Hadoop Data Analysis
Cscope and ctags
Insight_150115_Demo
HyperLogLog in Hive - How to count sheep efficiently?
Using Free and Open Source GIS to Automatically Create Standards-Based Spatia...
PyCon 2012 - Data Driven Design
Repl internals
Ad

Similar to RESTo - restful semantic search tool for geospatial (20)

PPT
OpenSearch 2010-09
PDF
Data Mesh-up and Mapping using Semantic Wiki
PDF
Drupal and the GeoSpatial Web
ODP
OpenStreetMap (en Zzzinc)
KEY
Drupal mapping
PDF
Your Own Private GeoWeb
PDF
FreeMap Palestine November 2008
PDF
OpenStreetMap at Camp Roberts
PDF
Semantic search within Earth Observation products databases based on automati...
PDF
Library of Congress - Neogeography and Geospatial data preservation
PDF
Volunteered Geographic Information and OpenStreetMap
PDF
Geos2011 - Lorenzino Vaccari - Keynote speech
PDF
O'Reilly WebCast - Trends And Technologies In Where2.0
PDF
Eswc lsagrsv9-boris-110602060147-phpapp02
PDF
Integrating PostGIS in Web Applications
KEY
NASA SensorWeb Enterprise Services
PDF
Philippine Geospatial Forum Presentation 20130311
PDF
OldMapsOnline.org: Open Source & Online Tools for Old Maps
PDF
Map4rdf - Faceted Browser for Geospatial Datasets
OpenSearch 2010-09
Data Mesh-up and Mapping using Semantic Wiki
Drupal and the GeoSpatial Web
OpenStreetMap (en Zzzinc)
Drupal mapping
Your Own Private GeoWeb
FreeMap Palestine November 2008
OpenStreetMap at Camp Roberts
Semantic search within Earth Observation products databases based on automati...
Library of Congress - Neogeography and Geospatial data preservation
Volunteered Geographic Information and OpenStreetMap
Geos2011 - Lorenzino Vaccari - Keynote speech
O'Reilly WebCast - Trends And Technologies In Where2.0
Eswc lsagrsv9-boris-110602060147-phpapp02
Integrating PostGIS in Web Applications
NASA SensorWeb Enterprise Services
Philippine Geospatial Forum Presentation 20130311
OldMapsOnline.org: Open Source & Online Tools for Old Maps
Map4rdf - Faceted Browser for Geospatial Datasets
Ad

More from Gasperi Jerome (20)

PDF
Big data from space - Module Big Data ISAE 2017
PDF
Le Big Data et les données Copernicus
PDF
2016.02.18 big data from space toulouse data science
PDF
2015.11.12 big data from space - cusi toulouse
PDF
Big Data - Accès et traitement des données d’Observation de laTerre
PDF
2014.09.04 federated ground segments - toulouse
PDF
Web Processing Service
PDF
2014.04.22 - HyDre - Hydroweb Distribution Server
PDF
Semantic search for Earth Observation products
PDF
Single Sign On with OAuth and OpenID
PDF
CNES Data Center
PDF
CNES OpenSearch implementations
PDF
Web Processing Service
PDF
Unify Earth Observation products access with OpenSearch
PDF
CNES activities on semantic search
PDF
Traitements de données à la demande - Introduction au Web Processing Service
PDF
Data access and data extraction services within the Land Imagery Portal
PDF
Semantic search applied to Earth Observation products
PDF
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
PDF
Experimenting a cloud based solution for image processing and data access
Big data from space - Module Big Data ISAE 2017
Le Big Data et les données Copernicus
2016.02.18 big data from space toulouse data science
2015.11.12 big data from space - cusi toulouse
Big Data - Accès et traitement des données d’Observation de laTerre
2014.09.04 federated ground segments - toulouse
Web Processing Service
2014.04.22 - HyDre - Hydroweb Distribution Server
Semantic search for Earth Observation products
Single Sign On with OAuth and OpenID
CNES Data Center
CNES OpenSearch implementations
Web Processing Service
Unify Earth Observation products access with OpenSearch
CNES activities on semantic search
Traitements de données à la demande - Introduction au Web Processing Service
Data access and data extraction services within the Land Imagery Portal
Semantic search applied to Earth Observation products
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Experimenting a cloud based solution for image processing and data access

Recently uploaded (20)

PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Web App vs Mobile App What Should You Build First.pdf
PPTX
TLE Review Electricity (Electricity).pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
A comparative study of natural language inference in Swahili using monolingua...
PPTX
OMC Textile Division Presentation 2021.pptx
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Hybrid model detection and classification of lung cancer
PDF
A comparative analysis of optical character recognition models for extracting...
PPTX
1. Introduction to Computer Programming.pptx
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PDF
Approach and Philosophy of On baking technology
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PDF
Heart disease approach using modified random forest and particle swarm optimi...
PDF
Mushroom cultivation and it's methods.pdf
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Zenith AI: Advanced Artificial Intelligence
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
cloud_computing_Infrastucture_as_cloud_p
Web App vs Mobile App What Should You Build First.pdf
TLE Review Electricity (Electricity).pptx
Unlocking AI with Model Context Protocol (MCP)
A comparative study of natural language inference in Swahili using monolingua...
OMC Textile Division Presentation 2021.pptx
A novel scalable deep ensemble learning framework for big data classification...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
Hybrid model detection and classification of lung cancer
A comparative analysis of optical character recognition models for extracting...
1. Introduction to Computer Programming.pptx
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Approach and Philosophy of On baking technology
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Heart disease approach using modified random forest and particle swarm optimi...
Mushroom cultivation and it's methods.pdf
MIND Revenue Release Quarter 2 2025 Press Release
Zenith AI: Advanced Artificial Intelligence

RESTo - restful semantic search tool for geospatial

  • 1. RESTorestful semantic search tool for geospatial Jérôme Gasperi
  • 2. RESTo - restful semantic search tool for geospatial is an implementation of OGC13-026 OpenSearch Extension for Earth Observation
  • 3. Architecture PostgreSQL Gazetteer Collection Manager Resource Manager Query Storage Query Analyzer RESTo modules More to come... RESTo backend PostGIS hstore uses RESTofrontend mapshup iTag Core RESTo External services resto db EO collections * (*) Collections can be stored within RESTo database or in external databases PHP javascript PHP
  • 4. RESTo Services Admin https POST Ingest metadata INGEST ScriptsDownload http GET THEIA metacatalog HMA catalog CEOS http GET (ATOM, GeoJSON) User http GET SEARCH (HTML)
  • 5. R R Rreliablerestful responsive
  • 7. GET / List all collections POST / Create a new collection GET /collection/$describe Describe collection OpenSearch service GET /collection Search collection POST /collection Insert a resource within collection DELETE /collection Delete collection PUT /collection Update collection GET /collection/identifier Show resource metadata GET /collection/identifier/$download Download resource product
  • 9. DesktopsTabletsMobiles 0 to 500 px 501 to 959 px 960 to > 1280 px
  • 11. Time period of 1 month within a 10x10 km2 box SEARCH INGEST 0.2s 0.5s 1 000 000 SPOT DATABASENew products retrieved every 3 hours from ADS catalog Per product for a ~5000 products ingestion Order of magnitude compute on a Dual Core 2.6 GHz | 4 Go RAM | HDD 500 To
  • 14. During ingestion process , resources are automatically tagged with location and land use github.com/jjrom/itag
  • 15. ! Tag this footprint with continent, country and Land use ! http://goo.gl/WtbcbR
 iTag
  • 16. Additionally, conditional ingestion rules can be defined at the collection level to provide specific tags Add tags #mh370,#plane,#malaysianairline to resources acquired between 2014, march 8th and 2014, april 14th in the south of the Indian Ocean ! http://goo.gl/W8VlPV e.g.
  • 18. RESTo provides semantic search capabilities It uses a Query Analyzer to translate natural language query into a set of EO OpenSearch parameters
  • 19. Query Analyzer goodies Multilingual - current languages are EN, FR, IT and DE Synonyms supported (e.g. unit «m» is «m», «meter» or «meters») Each collection can define its own dedicated keywords Automatic typing error correction using similarity Embed a Gazetteer containing ~9 000 000 toponyms
  • 20. « Images of urban area in the US acquired in the last 10 days with less than 5 % of cloud cover » Example
  • 21. « Images of urban area in the US acquired in the last 10 days with less than 5 % of cloud cover » Example keyword location date acquisition parameter
  • 22. 2. Each search result has an « human readable url » that can be indexed by web crawler (i.e. google robots) 1. Search parameters are derived from Natural Language query 3. Keywords on resources are links to search requests : they can be indexed by web crawler…and so on Search (example)
  • 23. 2. Each search result has an « human readable url » that can be indexed by web crawler (i.e. google robots) 1. Search parameters are derived from Natural Language query 3. Keywords on resources are links to search requests : they can be indexed by web crawler…and so on Search (example) http://goo.gl/GvMEHj