SlideShare a Scribd company logo
®
Validation of services,
data and metadata
Luis Bermudez (OGC)
ESIP Summer Meeting 2016
Durham, NC
July 21, 2016
Composition of this talk
• Why validation
• ESIP needs
• OGC Compliance Program
• The tool
2
WHY validation?
3
Maps
Coverages
Vector
Time Series
Eureka!
My model
is perfect
Server
Client
Maps
Coverages
Vector
Time Series
? ?
?
?
Service
Service
Catalog
Are the
services
correctly
registered so
that they can be
found and use?
OGC
®
© 2016 Open Geospatial Consortium, Inc.
ESIP community has
documented the need
8
Discovery Grand Challenge
http://wiki.esipfed.org/index.php/Discovery_White_Paper#The_Grand_Challenge
Need for validation
OGC
®
© 2016 Open Geospatial Consortium, Inc.
OGC compliance program
11
Open Geospatial Consortium
534 volunteer
organizations
6905 portal
users
More than 60 standards
Validation of services, data and metadata
Conformance = fulfillment of
specified requirements
http://www.sxc.hu/photo/149744
Implementations can get OGC
Certified
Currently
851 implementations
203 compliant products
For Users: Proof that a solution
works
(www.opengeospatial.org/ resource/products/compliant)
http://www.opengeospatial.org/resource/products/compliant
For implementers: Get more
business
How does it work?
OGC
®
© 2016 Open Geospatial Consortium, Inc.
19
Conformant = Compliant =
Super passing the test
+
license
If not we can say
Implement
Available and Expected Tests 2016
Available Tests Version Projected in 2016 Version
Catalogue Service - Web (CSW) 2.0.2 Catalogue Service - Web (CSW) 3.0
Geography Markup Language (GML) 3.2.1 GeoPackage 1.0
OGC KML 2.2 KML 2.3
Sensor Observation Service (SOS) 1.0.0 O&M 2.0
Sensor Observation Service (SOS) 2.0 SensorML 1.0
Sensor Planning Service (SPS) 1.0 SensorML 2.0
Sensor Planning Service (SPS) 2.0 SensorThings API 1.0
Simple Feature Access - SQL (SFS) 1.1 WFS (Basic) 1.1
Simple Feature Access - SQL (SFS) 1.2.1 WMTS 1.0
Web Coverage Service (WCS) 1.0.0 WPS 1.0
Web Coverage Service (WCS) 1.1.1 DGIWG Profiles
Web Coverage Service (WCS) 2.0.1
Web Feature Service (WFS) 1.0.0
Web Feature Service (WFS) 1.1.0
Web Feature Service (WFS) 2.0
Web Map Service (WMS) 1.1.1
Web Map Service (WMS) 1.3.0
WMS Client 1.3
How to ask for compliance?
“ … Purchaser seeks geospatial products that
provide maximum interoperability with purchaser’s
and data sharing partner’s systems. To accomplish
this, purchaser seeks to make maximum use of
open standards provided by the Open Geospatial
Consortium (OGC), ISO …”
OGC Compliance Overview - Guide for
Software Acquisition White paper (15-002r5)
http://docs.opengeospatial.org/wp/15-002r5/15-002r5.html
The Open Source Tool
Tools, community and support
Code
Contributors
Public Forum
Support
Open Source
XSLT
Tools
Communities Collaboration
Giacomo Martirano
Stefania Morrone
Enable testing of INPSIRE metadata profiles
Processing non-ASCII chars
GML CRS, and polygons definitions
Anybody can run the test
Tester selects
test suite
Tester names
session
Selection of Test
Testing in Progress
Tester provides end
point of the service
Console provides
feedback on test
assertions
Tester
Selects
Options
Summary of Results
Types of Tests
• Encodings
– SensorML, KML, GML, Metadata in
XML, …
• Servers
– CAT, WFS, WMS, WCS, SOS, …
• Clients
– WMS 1.3
Example in EuropeExample in Europe
Data validation for
INSPIRE Themes
In collaboration with Epsilon Italia
TEAM Engine and
GML 3.2.1 test suit
Metadata and Services
Validation for
Germany and INSPIRE
TEAM Engine and
CSW and WMS test suites
http://cloud.epsilon-italia.it/ http://testsuite.gdi-de.org/gdi/
Community Support
Metadata Validation
used in
CINERGI
(Community Inventory of
EarthCube Resources for
Geosciences Interoperability)
32
ILYA ZASLAVSKY
RAQUELCALDERON
CHRISCONDIT
JEFFREYGRETHE
AMARNATH GUPTA
BURAKOZYURT
THOMASWHITENACK
DAVIDVALENTINE
ALICEGILIARINI
AARON GONG
University of California San Diego
STEPHEN RICHARD, LEAHMUSIL
Arizona Geological Survey
KERSTIN LEHNERT, LESLIEHSU
LDEO, Columbia University
TANU MALIK
University of Chicago
LUISBERMUDEZ
Open Geospatial Consortium
Community
Inventory of
EarthCube
Resources for
Geoscience
Interoperability CINERGIProject Overview
Goals
• Large inventory of high quality information
resources across disciplines, with traceable
provenance, usable across EarthCube research
scenarios
• Engaging geoscience community in creating and
curating the inventory
• Enabling search and integration across domains, and
facilitating navigation across information objects of
different types (resources, people, software, etc..)
34
3 Levels Community Inventories
Validation
1 – Schema
2 – Rules not enforced by schema
3 – Community rules
http://cite-dev-
03.opengeospatial.org/te
amengine/
Level 1 - Schema
Level 2 – Rules not enforceable via
Schema
Level 3 – Community Rules
Results
Validation of services, data and metadata
Example files for metadata
validation
Go to the validation web site:
http://cite-dev-03.opengeospatial.org/teamengine/
Provide an XML instance
http://cinergi.sdsc.edu/getmetadata/F3ACDE93-F0E3-
4F7E-AD26-F2B87DD4DB4B.xml
And if needed provide a schematron
http://cite-dev-03.opengeospatial.org/teamengine/geo-
extend-iso.sch
41
GML Validation
Common Database on Designated Areas
1.4 GB
100,181 Features
CDDA application schema
INSPIRE Protected Sites schema
XML Schema Validation
About 1 min to test against
Schema with 1 GB Java heap size
Test data provided b
Epsilon Italia
OGC
®
© 2016 Open Geospatial Consortium, Inc.
Catalog (CAT 3.0) Validation
43
• https://www.youtube.com/watch?v=dWf0X6naiRU
CAT 3.0 Blog
http://www.opengeospatial.org/blog/2448
link
http://demo.pycsw.org/cite/csw?
mode=opensearch&
service=CSW&
version=3.0.0&
request=GetRecords&
elementsetname=full&
typenames=csw:Record&
resulttype=results&
q=Greece
Help and questions when testingHelp and questions when testing
cite-forum@
lists.opengeospatial.org
Community support with about
About 300 members
Thank you
Luis Bermudez
lbermudez@opengeospatial.org
@berdez
https://www.linkedin.com/in/bermudez
Presentation at:
http://bit.ly/2a1Ttm5

More Related Content

PPTX
OGC Sensor Web Enablement SOS 2.0, SensorML and WaterML
PPTX
Akili Data Integration using PPDM
PDF
Comparison between OGC Sensor Observation Service and SensorThings API
PDF
WITSML data processing with Kafka and Spark Streaming
PDF
GIS Technology and E&P in Petroleum Industry Context, Applications and Impact...
PDF
Data Modelling is NOT just for RDBMS's
PDF
Data modelling where did it all go wrong?
PPTX
WITSML to PPDM mapping project
OGC Sensor Web Enablement SOS 2.0, SensorML and WaterML
Akili Data Integration using PPDM
Comparison between OGC Sensor Observation Service and SensorThings API
WITSML data processing with Kafka and Spark Streaming
GIS Technology and E&P in Petroleum Industry Context, Applications and Impact...
Data Modelling is NOT just for RDBMS's
Data modelling where did it all go wrong?
WITSML to PPDM mapping project

Viewers also liked (15)

PDF
Information is at the heart of all architecture disciplines & why Conceptual ...
PPTX
Incorporating ERP metadata in your data models
PPTX
Simple workflow to populate PPDM tables from well files
PDF
The role of Data Virtualisation in your EIM strategy
PPTX
WITSML
PDF
Business intelligence 3.0 and the data lake
PDF
Data Modelling and WITSML
PPTX
Becoming a Data Driven Oil and Gas Enterprise with Advanced Analytics and Hadoop
PDF
Data Lake,beyond the Data Warehouse
PPTX
Data Governance
PPTX
Akili Oil & Gas Data Practice - PPDM
PPTX
Power bi desktop et Power BI Service
PDF
Data Governance: Keystone of Information Management Initiatives
PDF
Ibm data governance framework
PPT
Data Architecture for Data Governance
Information is at the heart of all architecture disciplines & why Conceptual ...
Incorporating ERP metadata in your data models
Simple workflow to populate PPDM tables from well files
The role of Data Virtualisation in your EIM strategy
WITSML
Business intelligence 3.0 and the data lake
Data Modelling and WITSML
Becoming a Data Driven Oil and Gas Enterprise with Advanced Analytics and Hadoop
Data Lake,beyond the Data Warehouse
Data Governance
Akili Oil & Gas Data Practice - PPDM
Power bi desktop et Power BI Service
Data Governance: Keystone of Information Management Initiatives
Ibm data governance framework
Data Architecture for Data Governance
Ad

Similar to Validation of services, data and metadata (20)

PPTX
Efficient use of Standards-based Interfaces and Encodings in Geospatial Intel...
PDF
Geospatial Temporal Open Standards for Big Data from Space (BiDS2014)
PPT
OGC Compliance and Certification - 2019
PPTX
Setting up and testing NSG and DGIWG Profiles
PPT
OPen Source Web Test Engine for Geospatial Standards
PDF
Workshop on OGC Compliance at GEOBUIZ Summit 2016
PDF
Evolution of System Architectures: Where Do We Need to Fail Next?
PDF
GeoNetwork, The Open Source Solution for the interoperable management of ge...
PPT
20100512 Workflow Ramage
ODP
FreeGIS.net, INSPIRE, Open Source Software and OGC standards
PDF
Geoint2017 training open interfaces - luis bermudez
PPTX
OGC standards relevant to ISPRS
PPT
June 2012 _ OGC and ISO
PDF
Interoperability and Standards for Disaster Risk Management
PPTX
OGC Update for State of Geospatial Tech at T-Rex
PDF
Inspire Helsinki 2019 - Keynote Bart De Lathouwer
PDF
Inspire Helsinki 2019 Keynote by Bart De Lathouwer
PDF
Inspire Helsinki 2019 - Keynote Bart De Lathouwer
PDF
2015 FOSS4G Track: Open Specifications for the Storage, Transport and Process...
PDF
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
Efficient use of Standards-based Interfaces and Encodings in Geospatial Intel...
Geospatial Temporal Open Standards for Big Data from Space (BiDS2014)
OGC Compliance and Certification - 2019
Setting up and testing NSG and DGIWG Profiles
OPen Source Web Test Engine for Geospatial Standards
Workshop on OGC Compliance at GEOBUIZ Summit 2016
Evolution of System Architectures: Where Do We Need to Fail Next?
GeoNetwork, The Open Source Solution for the interoperable management of ge...
20100512 Workflow Ramage
FreeGIS.net, INSPIRE, Open Source Software and OGC standards
Geoint2017 training open interfaces - luis bermudez
OGC standards relevant to ISPRS
June 2012 _ OGC and ISO
Interoperability and Standards for Disaster Risk Management
OGC Update for State of Geospatial Tech at T-Rex
Inspire Helsinki 2019 - Keynote Bart De Lathouwer
Inspire Helsinki 2019 Keynote by Bart De Lathouwer
Inspire Helsinki 2019 - Keynote Bart De Lathouwer
2015 FOSS4G Track: Open Specifications for the Storage, Transport and Process...
NWGISS: The Web GIS Software Suite for Interoperable Access and Manipulation ...
Ad

More from Luis Bermudez (20)

PPTX
Simple APIs for Health Tracking - COVID Case
PPTX
Map store geosolutions
PPTX
Plataforma de gestión de riesgos de código libre - GeoSolutions
PPTX
Estándares tecnológicos para la interoperabilidad en la administración inteli...
PPTX
Habilitando Toma de Decisiones a Través de Estándares Abiertos
PPTX
OGC Innovation Program and Maritime Limits and Boundary Pilot
PDF
Using Blockchain in Geospatial Applications
PPTX
Machine Learning in GeoHealth Applications
PPTX
Interoperabilidad, Estándares e Innovación
PDF
Addressing Health Challenges Through Spatial Analytics using Geospatial Data ...
PDF
Bold GIS
PPTX
Geospatial Data and Key Characteristics of Geospatial Data Analysis and Science
PDF
Open Geospatial Consortium and Smart Cities
PDF
Introducción al OGC y el Programa de Conformidad
PDF
Estándares abiertos para Ciudades Inteligentes
PDF
Infraestructura de Información Espacial para Ciudades Inteligentes
PDF
Geo Package and OWS Context at FOSS4G PDX
PDF
Padrões Atuais e Futuros para Infraestrutura de Dados Espaciais
PDF
Normas para Infraestructura de Datos Espaciales, el Futuro y MundoGeo Connect...
PDF
WFS Tutorial OGC Interoperability Day - Toluca mexico - May 30 2013
Simple APIs for Health Tracking - COVID Case
Map store geosolutions
Plataforma de gestión de riesgos de código libre - GeoSolutions
Estándares tecnológicos para la interoperabilidad en la administración inteli...
Habilitando Toma de Decisiones a Través de Estándares Abiertos
OGC Innovation Program and Maritime Limits and Boundary Pilot
Using Blockchain in Geospatial Applications
Machine Learning in GeoHealth Applications
Interoperabilidad, Estándares e Innovación
Addressing Health Challenges Through Spatial Analytics using Geospatial Data ...
Bold GIS
Geospatial Data and Key Characteristics of Geospatial Data Analysis and Science
Open Geospatial Consortium and Smart Cities
Introducción al OGC y el Programa de Conformidad
Estándares abiertos para Ciudades Inteligentes
Infraestructura de Información Espacial para Ciudades Inteligentes
Geo Package and OWS Context at FOSS4G PDX
Padrões Atuais e Futuros para Infraestrutura de Dados Espaciais
Normas para Infraestructura de Datos Espaciales, el Futuro y MundoGeo Connect...
WFS Tutorial OGC Interoperability Day - Toluca mexico - May 30 2013

Recently uploaded (20)

PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
A Presentation on Artificial Intelligence
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
KodekX | Application Modernization Development
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Machine learning based COVID-19 study performance prediction
PDF
Approach and Philosophy of On baking technology
PDF
Chapter 3 Spatial Domain Image Processing.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Network Security Unit 5.pdf for BCA BBA.
Review of recent advances in non-invasive hemoglobin estimation
Advanced methodologies resolving dimensionality complications for autism neur...
Spectral efficient network and resource selection model in 5G networks
A Presentation on Artificial Intelligence
Encapsulation_ Review paper, used for researhc scholars
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
20250228 LYD VKU AI Blended-Learning.pptx
The AUB Centre for AI in Media Proposal.docx
The Rise and Fall of 3GPP – Time for a Sabbatical?
KodekX | Application Modernization Development
Digital-Transformation-Roadmap-for-Companies.pptx
Unlocking AI with Model Context Protocol (MCP)
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Machine learning based COVID-19 study performance prediction
Approach and Philosophy of On baking technology
Chapter 3 Spatial Domain Image Processing.pdf

Validation of services, data and metadata

Editor's Notes

  • #2: CONTROL ID: 1469340 TITLE: An Open Source Tool to Test Interoperability AUTHORS (FIRST NAME, LAST NAME): Luis E Bermudez1 INSTITUTIONS (ALL): 1. Open Geospatial Consortium, Rockville, MD, United States. ABSTRACT BODY: Scientists interact with information at various levels from gathering of the raw observed data to accessing portrayed processed quality control data. Geoinformatics tools help scientist on the acquisition, storage, processing, dissemination and presentation of geospatial information. Most of the interactions occur in a distributed environment between software components that take the role of either client or server. The communication between components includes protocols, encodings of messages and managing of errors. Testing of these communication components is important to guarantee proper implementation of standards. The communication between clients and servers can be adhoc or follow standards. By following standards interoperability between components increase while reducing the time of developing new software. The Open Geospatial Consortium (OGC), not only coordinates the development of standards but also, within the Compliance Testing Program (CITE), provides a testing infrastructure to test clients and servers. The OGC Web-based Test Engine Facility, based on TEAM Engine, allows developers to test Web services and clients for correct implementation of OGC standards. TEAM Engine is a JAVA open source facility, available at Sourceforge that can be run via command line, deployed in a web servlet container or integrated in developer’s environment via MAVEN. The TEAM Engine uses the Compliance Test Language (CTL) and TestNG to test HTTP requests, SOAP services and XML instances against Schemas and Schematron based assertions of any type of web service, not only OGC services. For example, the OGC Web Feature Service (WFS) 1.0.0 test has more than 400 test assertions. Some of these assertions includes conformance of HTTP responses, conformance of GML-encoded data; proper values for elements and attributes in the XML; and, correct error responses. This presentation will provide an overview of TEAM Engine, introduction of how to test via the OGC Testing web site and description of performing local tests. It will also provide information about how to participate in the open source code development of TEAM Engine. http://cite.opengeospatial.org/ KEYWORDS: [9300] GEOGRAPHIC LOCATION, [1976] INFORMATICS / Software tools and services, [1908] INFORMATICS / Cyberinfrastructure, [1982] INFORMATICS / Standards.
  • #5: Scientist interact with raw data that can be in different formats and shapes
  • #6: They can also publish data
  • #7: How good is there communication, Do they really interoperate (access, process, use). Is the interface that they are using well known?
  • #8: How good is there communication, Do they really interoperate (access, process, use). Is the interface that they are using well known?
  • #13: Global forum of developers and users to advance geospatial standards
  • #14: The Compliance Program deals with three main activities: Oversee Compliance Testing activities with SWG and software developers to improve the testing tools and the tests Manage the process for certification of software products Coordinate plugfest activities, where by via short term interoperability integration activities the test and the standards are advanced.
  • #15: Requirements = tests = passes predefined testable assertions
  • #16: Software implementations can get OGC certified. OGC certified implementations get a badge, that has the information of the organization, the software product and the standards that the product has implemented.
  • #17: Organization seeking to buy or use software they can search in the OGC database and check what implementations have been certified
  • #18: Implementers get more business and can easier promote their product
  • #19: Software companies that want to get certified need to follow the OGC compliance procedure. They go to the online testing engine facility. If the results are successful then they fill up a test result form that it gets process by OGC staff. Depending on the membership level, the company needs to pay a license fee to use the OGC certification branding in their marketing materials.
  • #20: Super passing = supervision– evalutaion + test
  • #22: OGC has released the Guide for Software Acquisition White paper, that will help those acquiring software to put the correct wording in their procurement documents.
  • #24: Open source in guthub
  • #26: When the user logins to TEAM Engine he can select the test that he wants to perform and provide a description for that testing session.
  • #27: TEAM engine will open various windows. One that can ask for more input. For example endpoint of the server and a console that gives realtime feedback on the progress of the test.
  • #28: Finally the user gets the summary of the results
  • #31: Use case
  • #34: Resources:datasets, catalogs, vocabularies, information models, services, process models, repositories, etc. Tupes: (resources, people/organizations, publications, models, workflows, software, activities, etc.)
  • #43: Data is a pan-european dataset of European Environment Agency – not yet publicly available - within a Framework Contract led by KU LEUVEN, where Epsilon Italia is a member of the team