SlideShare a Scribd company logo
SESIP_0716_AJ
Incorporating ISO Metadata
Using HDF Product
Designer
Aleksandar Jelenak, John Kozimor, Ted Habermann
The HDF Group
This work was supported by NASA/GSFC under
Raytheon Co. contract number NNG15HZ39C
SESIP_0716_AJ
2
The Problem
The need for more contextual data (metadata)
in HDF5 files is growing.
SESIP_0716_AJ
3
The Solution
Use the current conventions to the their
fullest extent.
Store the rest of metadata using the ISO
19115 standards.
SESIP_0716_AJ
4
HDF Product Designer Can Help
• Support for the most widely used Earth
science metadata conventions.
• The latest release (v1.4) allows import of
ISO metadata objects into user designs.
SESIP_0716_AJ
5
1. Use Case
2. Overview
3. Recommendations
4. Conceptual Model
(UML)
5. Implementation (XML)
6. Implementation
(NcML)
HPD Design Name
7. Usage (UMM)
8. Crosswalks
https://wiki.earthdata.nasa.gov/x/qorT
SESIP_0716_AJ
6
Convention Support
SESIP_0716_AJ
7
Convention Support
SESIP_0716_AJ
8
Importing ISO Objects
Separate project with pre-built
ISO metadata components.
SESIP_0716_AJ
9
Importing ISO Objects
All groups in the ISO design
have default role and type
attributes. Do not change
these!
Repeating roles have
"_<uniqueID>" added to their
names
SESIP_0716_AJ
10
Export As…
JSON
Export
Python,
MATLAB
,
IDL
code
HDF5
Templat
e
File
SESIP_0716_AJ
11
Sample of Python Code
# Group: /gmi:acquisitionInformation
grp_1 = f.create_group('gmi:acquisitionInformation')
# Creating attributes for /gmi:acquisitionInformation
grp_1.attrs['role'] = "gmi:acquisitionInformation"
grp_1.attrs['type'] = "gmi:MI_AcquisitionInformation"
# Group: /gmi:acquisitionInformation/gmi:instrument
grp_2 = grp_1.create_group('gmi:instrument')
# Creating attributes for /gmi:acquisitionInformation/gmi:instrument
grp_2.attrs['role'] = "gmi:instrument"
grp_2.attrs['type'] = "gmi:MI_Instrument"
grp_2.attrs['id'] = "instrument_1"
# Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation
grp_3 = grp_2.create_group('gmi:citation')
# Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation
grp_3.attrs['role'] = "gmi:citation"
grp_3.attrs['type'] = "gmd:CI_Citation"
grp_3.attrs['id'] = "fgdccitation_26722.114902.35002"
# Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date
grp_4 = grp_3.create_group('gmd:date')
# Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date
grp_4.attrs['role'] = "gmd:date"
grp_4.attrs['type'] = "gmd:CI_Date"
SESIP_0716_AJ
12
HDF5 Template File
Keyword values in
HDF5
SESIP_0716_AJ
13
This work was supported by
NASA/GSFC under Raytheon Co.
contract number NNG15HZ39C

More Related Content

PPTX
Geospatial Data Abstraction Library (GDAL) Enhancement for ESDIS (GEE)
PPTX
HDF Update for DAAC Managers (2017-02-27)
PPTX
Scientific Computing and Visualization using HDF
PPTX
Utilizing HDF4 File Content Maps for the Cloud Computing
PPTX
MATLAB and Scientific Data: New Features and Capabilities
PPTX
Open-source Scientific Computing and Data Analytics using HDF
Geospatial Data Abstraction Library (GDAL) Enhancement for ESDIS (GEE)
HDF Update for DAAC Managers (2017-02-27)
Scientific Computing and Visualization using HDF
Utilizing HDF4 File Content Maps for the Cloud Computing
MATLAB and Scientific Data: New Features and Capabilities
Open-source Scientific Computing and Data Analytics using HDF

What's hot (20)

PPTX
SPD and KEA: HDF5 based file formats for Earth Observation
PPT
PPTX
Moving form HDF4 to HDF5/netCDF-4
PPTX
Hierarchical Data Formats (HDF) Update
PPTX
Improved Methods for Accessing Scientific Data for the Masses
PPTX
Putting some Spark into HDF5
PPTX
Matlab, Big Data, and HDF Server
PDF
HDFCloud Workshop: HDF5 in the Cloud
PPTX
PPTX
Product Designer Hub - Taking HPD to the Web
PPTX
HDF Product Designer: Using Templates to Achieve Interoperability
PPTX
Data Analytics using MATLAB and HDF5
PPTX
Efficiently serving HDF5 via OPeNDAP
PPTX
ICESat-2 Metadata and Status
PPTX
Bridging ICESat and ICESat-2 Standard Data Products
PPSX
GDAL Enhancement for ESDIS Project
PPT
HDF5 Performance Enhancements with the Elimination of Unlimited Dimension
SPD and KEA: HDF5 based file formats for Earth Observation
Moving form HDF4 to HDF5/netCDF-4
Hierarchical Data Formats (HDF) Update
Improved Methods for Accessing Scientific Data for the Masses
Putting some Spark into HDF5
Matlab, Big Data, and HDF Server
HDFCloud Workshop: HDF5 in the Cloud
Product Designer Hub - Taking HPD to the Web
HDF Product Designer: Using Templates to Achieve Interoperability
Data Analytics using MATLAB and HDF5
Efficiently serving HDF5 via OPeNDAP
ICESat-2 Metadata and Status
Bridging ICESat and ICESat-2 Standard Data Products
GDAL Enhancement for ESDIS Project
HDF5 Performance Enhancements with the Elimination of Unlimited Dimension
Ad

Viewers also liked (19)

PPTX
Pilot Project for HDF5 Metadata Structures for SWOT
PPT
Role of Spatial Information in Response to Queensland's Natural Disasters
PPTX
Metadata presentation (mip)
PDF
Using Imagery in ArcGIS
PDF
Collection development and metadata quality. Presentation at the Europeana Ag...
PPTX
Metadata for Editorial and Sales Impact
KEY
Making metadata effective
PPT
Using visualization tools to access HDF data via OPeNDAP
PPT
PPTX
Hdf5 current future
PDF
Unidata's Approach to Community Broadening through Data and Technology Sharing
PDF
Marketing digital et données personnelles
PDF
Crossref webinar - Maintaining your metadata - latest
PPT
Planned Maintenance.
PPT
Metadata an overview
PPT
Preventive maintenance final
Pilot Project for HDF5 Metadata Structures for SWOT
Role of Spatial Information in Response to Queensland's Natural Disasters
Metadata presentation (mip)
Using Imagery in ArcGIS
Collection development and metadata quality. Presentation at the Europeana Ag...
Metadata for Editorial and Sales Impact
Making metadata effective
Using visualization tools to access HDF data via OPeNDAP
Hdf5 current future
Unidata's Approach to Community Broadening through Data and Technology Sharing
Marketing digital et données personnelles
Crossref webinar - Maintaining your metadata - latest
Planned Maintenance.
Metadata an overview
Preventive maintenance final
Ad

Similar to Incorporating ISO Metadata Using HDF Product Designer (20)

PDF
Geoscience Data Analysis and Visualization Tools from NCAR
PPTX
HDF Project Status and Plans
PPTX
HDF Group Support for NPP/NPOESS/JPSS
PPT
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
PPT
Status of HDF-EOS, Related Software, and Tools
PPTX
Interoperability with netCDF-4 - Experience with NPP and HDF-EOS5 products
PPTX
HDF - Current status and Future Directions
PPT
PPT
HDF Status and Development
PPTX
Support for NPP/NPOESS/JPSS by The HDF Group
PPSX
HDFEOS.org User Analsys, Updates, and Future
PPSX
NASA HDF/HDF-EOS Data Access Challenges
PPTX
Tools to improve the usability of NASA HDF Data
PPT
Hdf eos status-workshp_xi_nov_2007
PPTX
HDF5 OPeNDAP Handler Updates, and Performance Discussion
PPT
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
Geoscience Data Analysis and Visualization Tools from NCAR
HDF Project Status and Plans
HDF Group Support for NPP/NPOESS/JPSS
GES DISC Eexperiences with HDF Formats for MEaSUREs Projects
Status of HDF-EOS, Related Software, and Tools
Interoperability with netCDF-4 - Experience with NPP and HDF-EOS5 products
HDF - Current status and Future Directions
HDF Status and Development
Support for NPP/NPOESS/JPSS by The HDF Group
HDFEOS.org User Analsys, Updates, and Future
NASA HDF/HDF-EOS Data Access Challenges
Tools to improve the usability of NASA HDF Data
Hdf eos status-workshp_xi_nov_2007
HDF5 OPeNDAP Handler Updates, and Performance Discussion
Using HDF5 Archive Information Package to preserve HDF-EOS2 data

More from The HDF-EOS Tools and Information Center (20)

PDF
HDF5 2.0: Cloud Optimized from the Start
PDF
Using a Hierarchical Data Format v5 file as Zarr v3 Shard
PDF
Cloud-Optimized HDF5 Files - Current Status
PDF
Cloud Optimized HDF5 for the ICESat-2 mission
PPTX
Access HDF Data in the Cloud via OPeNDAP Web Service
PPTX
Upcoming New HDF5 Features: Multi-threading, sparse data storage, and encrypt...
PPTX
The State of HDF5 / Dana Robinson / The HDF Group
PDF
Cloud-Optimized HDF5 Files
PDF
Accessing HDF5 data in the cloud with HSDS
PPTX
Highly Scalable Data Service (HSDS) Performance Features
PDF
Creating Cloud-Optimized HDF5 Files
PPTX
Hyrax: Serving Data from S3
PPSX
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
PDF
HDF - Current status and Future Directions
PDF
H5Coro: The Cloud-Optimized Read-Only Library
PPTX
MATLAB Modernization on HDF5 1.10
PPTX
HDF for the Cloud - Serverless HDF
PPTX
HDF for the Cloud - New HDF Server Features
HDF5 2.0: Cloud Optimized from the Start
Using a Hierarchical Data Format v5 file as Zarr v3 Shard
Cloud-Optimized HDF5 Files - Current Status
Cloud Optimized HDF5 for the ICESat-2 mission
Access HDF Data in the Cloud via OPeNDAP Web Service
Upcoming New HDF5 Features: Multi-threading, sparse data storage, and encrypt...
The State of HDF5 / Dana Robinson / The HDF Group
Cloud-Optimized HDF5 Files
Accessing HDF5 data in the cloud with HSDS
Highly Scalable Data Service (HSDS) Performance Features
Creating Cloud-Optimized HDF5 Files
Hyrax: Serving Data from S3
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
HDF - Current status and Future Directions
H5Coro: The Cloud-Optimized Read-Only Library
MATLAB Modernization on HDF5 1.10
HDF for the Cloud - Serverless HDF
HDF for the Cloud - New HDF Server Features

Recently uploaded (20)

PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Approach and Philosophy of On baking technology
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
KodekX | Application Modernization Development
PDF
cuic standard and advanced reporting.pdf
PPTX
Cloud computing and distributed systems.
Dropbox Q2 2025 Financial Results & Investor Presentation
Programs and apps: productivity, graphics, security and other tools
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
The Rise and Fall of 3GPP – Time for a Sabbatical?
Mobile App Security Testing_ A Comprehensive Guide.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Chapter 3 Spatial Domain Image Processing.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm
MIND Revenue Release Quarter 2 2025 Press Release
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Digital-Transformation-Roadmap-for-Companies.pptx
Encapsulation_ Review paper, used for researhc scholars
Approach and Philosophy of On baking technology
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
KodekX | Application Modernization Development
cuic standard and advanced reporting.pdf
Cloud computing and distributed systems.

Incorporating ISO Metadata Using HDF Product Designer