OzNome - Interoperable data as an example of FAIR data principlesfair
Download as PPTX, PDF1 like537 views
Oznome is a CSIRO-led initiative aimed at enhancing environmental information infrastructures across Australia, specifically focusing on land and water data. The project emphasizes FAIR (Findable, Accessible, Interoperable, and Reusable) principles, with ongoing evaluations and updates to improve data connectivity and assessment standards. Key features include standard data formats, comprehensive metadata, and commitment to long-term data availability and usability.
OzNome - Interoperable data as an example of FAIR data principlesfair
- 1. OzNome – Interoperable data as an example of FAIR data principles LAND AND WATER Simon Cox, Jonathan Yu 13 September2017
- 2. OzNome – “A connected Australia” CSIRO-led initiative to enhance and connect information infrastructures across Australia. https://research.csiro.au/oznome/ FY 2016-17 focused on “OzNome for Land and Water” An OzNome project seeking to enhance and connect environmental information infrastructures in Australia, starting with CSIRO L&W. https://research.csiro.au/oznome/oznome-land-water/ OzNome for LW updates + Tools, products, services Methods, approaches, practices Infrastructure 2 |
- 3. 5-star assessment http://oznome.csiro.au/5star/ OzNome FAIR Interoperable | Cox & Yu3 |
- 4. 4 | Findable: ● Citeable via a stable, persistent web identifier ● Described with appropriate metadata ● Indexed in a well known system, e.g. google search, catalog search Accessible: ● Available on the web? Via standardised web service? ● Curated with a commitment that this data will be available long term ● Indexed in a well known system Interoperable/Reusable: ● Common formats ● Discoverable, community-endorsed schema or data model ● Unambiguous definitions for all elements (e.g. column definitions, units of measure) linked to accessible (standard) definitions ● Linked to other data using external identifiers (e.g. URIs) ● Licenced Trusted: ● Usage information available ● Part of a regular data collection program or series, with clear maintenance arrangements and update schedule ● Commitment that this data will be available long term
- 9. Interoperable? OzNome FAIR Interoperable | Cox & Yu9 |
- 10. Key word Levels loadable a. bespoke file format b. standard data-format, denoted by a MIME-type (CSV, JSON, XML, netCDF, etc) c. choice from multiple standard formats OzNome FAIR Interoperable | Cox & Yu10 | FAIR - Interoperable
- 11. Key word Levels loadable a. bespoke file format b. standard data-format, denoted by a MIME-type (CSV, JSON, XML, netCDF, etc) c. choice from multiple standard formats useable a. implicit schema, not formalized b. explicit schema, formalized in DDL, XSD, data-package, RDFS/OWL, JSON-Schema or similar c. community schema, available from a (standard) location OzNome FAIR Interoperable | Cox & Yu11 | FAIR - Interoperable
- 12. Key word Levels loadable a. bespoke file format b. standard data-format, denoted by a MIME-type (CSV, JSON, XML, netCDF, etc) c. choice from multiple standard formats useable a. implicit schema, not formalized b. explicit schema, formalized in DDL, XSD, data-package, RDFS/OWL, JSON-Schema or similar c. community schema, available from a (standard) location comprehensible a. local field labels b. field labels linked to text explanations c. standard labels (e.g. CF Conventions, UCUM units) d. some field names linked to standard, externally managed vocabularies e. all field names linked to standard, externally managed vocabularies OzNome FAIR Interoperable | Cox & Yu12 | FAIR - Interoperable
- 13. Key word Levels loadable a. bespoke file format b. standard data-format, denoted by a MIME-type (CSV, JSON, XML, netCDF, etc) c. choice from multiple standard formats useable a. implicit schema, not formalized b. explicit schema, formalized in DDL, XSD, data-package, RDFS/OWL, JSON-Schema or similar c. community schema, available from a (standard) location comprehensible a. local field labels b. field labels linked to text explanations c. standard labels (e.g. CF Conventions, UCUM units) d. some field names linked to standard, externally managed vocabularies e. all field names linked to standard, externally managed vocabularies connected, linked a. no links b. in-bound links from a catalogue or landing page c. out-bound links to related data OzNome FAIR Interoperable | Cox & Yu13 | FAIR - Interoperable
- 14. OzNome for LW updates14 | Geofabric features AWRA-L historical 1911-2016 AWRA definitions Web application Data Providers e.g Govt’ agencies, research groups Data users Policy Research General public File download 3rd parties or new researchers AWRA-L 2005- C ? Modelling environments Reports
- 15. OzNome maturity estimation OzNome for LW updates15 | Findable via Google search Accessible - publish limited set from 2005 Available as web service Interoperable/Reusable: web services, reference definitions as text. Data descriptions localised. Trusted: Reliable operationalised
- 16. 16 | netCDF metadata example
- 17. Presentation title | Presenter name17 | netCDF metadata example - interoperable
- 18. AWRA-L Draft Vocabularies Referenceable metadata for implicit observable properties Online AWRA vocabulary register (draft) http://registry.it.csiro.au/sandbox/csiro/ozno me/AWRA-L Mappings from AWRA data to online draft AWRA vocabularies https://confluence.csiro.au/display/OFW/AW RA-L+Vocabulary+mappings 18 |
- 19. AWRA Draft Vocabulary example http://registry.it.csiro.au/sandbox/csiro/ozno me/AWRA-L/potential-evapotranspiration 19 | Potential Evapotranspiration Evapotranspiration Critical Zone Water Millimeter has unit of measure feature of interest object of interest
- 20. OzNome maturity estimation OzNome for LW updates20 | Findable via Google search Accessible - publish limited set from 2005 Available as web service Interoperable/Reusable: some web services, reference definitions as text Trusted: Reliable operationalised updates of 2005 data Findable/Accessible: 1911-2016 dataset test deployments and aggregates via connected infrastructure (internal CSIRO) Enhanced connectivity via web services Interoperable/Reusable: web services, reference definitions as Linked Data and externally hosted observable properties vocabulary definitions Trusted: Not operational and no trusted repository
- 21. Key word Matching FAIR Principle published Implicitly FAIR hosted A1 - curated A2 updated, maintained More than FAIR licensed R1.1 citeable F1 described R1, F2, F3 findable R1, F2, F3 loadable I1 useable I2, R1.3 comprehensible I2 connected, linked I3 assessable R1.2 trusted More than FAIR OzNome FAIR Interoperable | Cox & Yu21 | Oznome data assessment criteria https://confluence.csiro.au/display /OZNOME/Data+ratings
- 22. Links and references • FAIR principles https://www.force11.org/group/fairgroup/fairprinciples • EC Expert Group on Turning FAIR Data into Reality https://github.com/FAIR-Data-EG/consultation • FAIR principles and metrics for evaluation https://www.slideshare.net/micheldumontier/fair-principles-and-metrics-for- evaluation • OzNome data assessment criteria - https://confluence.csiro.au/display/OZNOME/Data+ratings • 5-star tool - http://oznome.csiro.au/5star/ OzNome FAIR Interoperable | Cox & Yu22 |
- 23. Land and Water Simon J D Cox Research Scientist t +61 2 9545 2365 e simon.cox@csiro.au w people.csiro.au/Simon-Cox Land and Water Jonathan Yu Research Scientist t +61 3 9545 2457 e jonathan.yu@csiro.au w people.csiro.au/Jonathan-Yu Thank you LAND AND WATER
- 24. Fundamental Questions • In what ways can we assess the FAIRness of a digital resource? • To what degree can we automate this assessment? • Must we treat each type of digital resource differently? • Who will use the metrics? The producers, the funders, or the users? • Can one resource be more FAIR than another? • Will/should FAIRness assessments impact funding decisions? • Should only one organization define these metrics? Or can anybody make their own metrics? What happens if a digital resources scores well against one set of metrics, but not another? @micheldumontier::#DANSLOD:2017-05-0124
- 25. Key word Levels published a. No external access b. External access, non-web protocol (e.g. physical media distribution) c. Published via the web hosted a. not on web b. files on web-server c. repository with web interface d. web service - local API e. RESTful web service - OpenAPI/Swagger f. standard web API (SPARQL, OGC WMS/WFS/WCS/SOS/WPS, ...) curated a. once-off dump, no ongoing commitment b. best effort c. institutional repository d. certified repository updated, maintained a. one-time dataset b. part of data series, occasional/irregular update c. part of data series with regular updates OzNome FAIR Interoperable | Cox & Yu25 | FAIR - Accessible Implicitly FAIR? More than FAIR!
- 26. Key word Levels licensed a. no licence b. licence described in text c. standard licence (e.g. Creative Commons) citeable a. Not citeable b. Local identifier (may change) c. Web identifier (transient URL or query) d. Persistent web identifier (PURL, DOI, handle, ARK, etc) described a. no metadata b. text description (abstract) and keywords c. basic metadata (e.g. Dublin Core) d. specialized metadata (e.g. Darwin Core, ISO 19115, scientific data profile of schema.org) e. rich metadata using (standard) RDF vocabularies (e.g. DCAT, ADMS, PROV, GeoDCAT, OMV, VoID) findable a. not indexed b. indexed in a local, organizational catalogue c. metadata harvested or pushed into a community (e.g. Research Data Australia, Re3Data) or jurisdictional catalogue d. visible in general-purpose indexes (Google, Bing) e. highly ranked in general-purpose indexes OzNome FAIR Interoperable | Cox & Yu26 | FAIR – Findable, Reusable
- 27. OzNome FAIR Interoperable | Cox & Yu Nitrogen Newtons North Noon Neutral November Moles No! N One symbol, many meanings Unpacking data
- 28. Key word Levels assessable a. No quality or lineage information b. Lineage statement in text c. Formal provenance trace (W3C PROV-O or similar) trusted a. no information about usage b. usage statistics available. c. Clearly endorsed by reputable organization or framework OzNome FAIR Interoperable | Cox & Yu28 | FAIR – Reusable More than FAIR?
- 29. OzNome for LW updates29 | Geofabric features AWRA-L historical 1911-2016 AWRA definitions Web application Data Providers e.g Govt’ agencies, research groups Data users Policy Research General public File download 3rd parties or new researchers AWRA-L 2005- C ? Modelling environments Reports