Bathymetric Attributed Grid (BAG) format
1 like765 views
The Bathymetric Attributed Grid (BAG) file format was created to ensure interoperability of bathymetric data amongst vendors and agencies. It defines a standardized format for gridded bathymetric data with elevation, uncertainty, and metadata layers. The BAG format has undergone several revisions and is referenced in the International Hydrographic Organization (IHO) S-102 Bathymetric Surface Product Specification. It aims to provide a full-resolution database for various hydrographic and geospatial uses.
Bathymetric Attributed Grid (BAG) format
- 1. BAG format Brest, 20 June 2018
- 2. Origin • S.M. Smith, “The Navigation Surface: A Multipurpose Bathymetric Database”, MS thesis, University of New Hampshire, 2003.
- 3. Origin • The Navigation Surface concept. • A database of bathymetric grids at full resolution. • A set of rules to create: • Hydrographic products (e.g., ENCs). • Products for fields that require full-resolution data (e.g., habitat, geology). • A Bathymetric Attributed Grid (BAG) format to ensure interoperability amongst vendors and agencies.
- 4. History • 2004 – First workshop. • Initial specifications for the BAG format.
- 5. History • 2005 – US Hydro Conference:
- 6. History • 2005 – US Hydro Conference:
- 7. History • 2005 – Shallow Survey Conference. • Alpha library demonstrated with IVS Fledermaus, CARIS HIPS, SAIC SABER.
- 8. History • 2005 – Shallow Survey Conference in Plymouth, UK:
- 9. History • 2005 – Shallow Survey Conference in Plymouth, UK:
- 10. History • 2005 – Shallow Survey Conference in Plymouth, UK:
- 11. History • 2006-04-07 – v.1.0.1: First release. • 2009 – v.1.1: Expanded XML metadata and optional datasets. • 2009 – v.1.2: Nominal Depth as depth correction type (NAVOCEANO). • 2011 – v.1.4: Added compression. • 2012 – v.1.5: New XML Schema to follow current ISO standards. • 2013 – v.1.5.1: Added node and elevation solution groups (SAIC). • 2016-07-05 – v.1.6: Added support for variable resolution grids.
- 12. Present • Current Release: 1.6.4 (May 5, 2018)
- 13. Present • Version Control: git, hosted on BitBucket • Build system: CMake • Cross-platform: Windows, Linux (Red Hat), OSX • Dependencies: • HDF5 with Zlib • Libxml2 • BeeCrypt
- 14. Present • Chair of the ONSWG: Dr. Brian Calder • Mailing lists (to join them, write to: navsurf_join@ccom.unh.edu): • navsurf_dev@ccom.unh.edu • navsurf_general@ccom.unh.edu
- 16. Structure • Mandatory elements: • 2 co-located grid layers: elevation and uncertainty. • A metadata XML string. • A tracking list with changes applied to the ‘original’ grid.
- 17. Structure • Additional elements (as optional extensions): • A node group: • The hypothesis strength. • The number of hypotheses. • An elevation solution group: • The shoal elevation. • The standard deviation. • The number of soundings. • Variable resolution groups: • VR metadata group. • VR refinement group. • VR node group • VR tracking list. • Etc. • Optional signature.
- 18. Elevation layer • Each value defines elevation at an exactly specified geographic point. • The metadata provides the description of the depth correction type: • True depth, corrected for sound speed. • Nominal depth at assumed sound speed of 1,500 m/s. • Nominal depth at assumed sound speed of 4,800 ft/s. • Corrected depth using Carter’s tables. • Corrected depth using Matthew’s tables. • Unknown depth correction type of mixture of above types.
- 19. Uncertainty layer • Co-aligned with the elevation layer. • The metadata provides the description of the uncertainty type: • Unknown • Raw standard deviation of soundings that contributed to the node. • Standard deviation of soundings captured by a CUBE hypothesis. • NOAA standard product uncertainty V1.0 (a blend of CUBE uncertainty and other measures). • Estimated standard deviation based on historical/archive data. • Average of all of the contributing sounding TPEs within a node.
- 20. Metadata • ISO 19115 (geospatial metadata) and ISO 19139 (XML encoding). • Embedded in the BAG file to ensure that cannot be separated. • Validated using Libxml2.
- 21. Metadata Open issues: • Many of the fields are free-text, and therefore open to interpretation. • The current definition of S-102 has some changes to the metadata schema that require changes to the BAG file format to be compliant. However, by the defining document, S-102 should be compatible with BAG (rather than the other way round).
- 22. Metadata
- 23. Tracking List • Recording the original contents makes the base grid fail-safe. • 6 column: • Row and column location of the node (2 uint32_ts). • Original depth and uncertainty (2 floats). • A reason code indicating why the modification was made (uint8_t). • An index number indicating the item in the metadata lineage (uint16_t).
- 24. HDF5 Compression • Two variables control the compression: • The compression level (0-9). • The chunk size, the atomic object on which the compression is executed. • Variability between nearby nodes is typically low for hydrographic data sets. • Default values after testing: • Chunk size: 100x100. • Compression level: 1
- 25. Digital Signature (optional) • A section of fixed length at the end of a BAG file. • Implemented using BeeCrypt library for FIPS DSS 186-2.
- 26. Architecture Board • The board is composed of members of the ONSWG. • It coordinates bug-reports, change requests, and new features.
- 27. License The Open Navigation Surface is free software. There are no restrictions on use or adaptation of the source code, although we would prefer if you contributed modifications, extensions and bug-fixes back to the project rather than releasing a (potentially incompatible) version of your own. The software comes with no warranty, express or implied, as to fitness for any purpose. That is, the code is provided for your convenience, and you agree by downloading the code distribution that the Open Navigation Surface Working Group and its members are not responsible for any loss or damage, of whatever kind, that may be caused to you by the use of this software, or by you because of your use of this software.
- 28. GDAL Support
- 29. Tools • BAG Viewer, basic Qt OpenGL viewer. • BAG Explorer, a plugin of HDF Compass. • Any HDF5-aware tool (e.g., HDF Compass, HDF View).
- 30. Future • Fix issue with Product Uncertainty Description: • CARIS standard uncertainty. Larger of CUBE’s uncertainty output and the standard deviation of all soundings in a bin around the node, reported at 95% CI assuming Gaussian statistics. • Leidos standard uncertainty. Larger of CUBE’s uncertainty output and the average vertical uncertainty of all of the soundings that make up the primary hypothesis in CUBE, reported at 95% CI assuming Gaussian statistics. • Generalized standard uncertainty. Uncertainty derived from geostatistical estimation or other methods, described with a statement in the metadata.
- 31. Future • Fix issue with geo-referencing: • WKT geo-referencing convention: • EPSG 9606 (adopted solution). • EPSG 9607. • Conflicting metadata information: • South-west and northeast bounding corners. • Sample spacing. • Number of rows/columns.
- 33. Future • Revise C++ API. • Introduce Active Tiling to reduce size. • Add a Regression/Unit Testing Suite. • Deprecate the option of Nominal Depth in the elevation layer.
- 34. IHO S-102 Bathymetric Surface Product Specification
- 36. History • 2007 – IHO Technical Standards Maintenance and Development: • BAG proposed for adoption as part of the IHO S-100 suite of standards
- 37. History • 2012 – IHO S-102 1.0.0
- 41. History • 2012 – WG to upgrade S-102.
- 42. History • 2014 – CARIS document about metadata.
- 43. History • 2015 – Update Impact Study.
- 46. History • 2017 – IHO S-102 v.2.0.0 status update.
- 49. History • 2017 – Draft of IHO S-102 v.2.0.0.
- 50. History • 2018 – ESRI considerations against VR implementation.
- 51. Info Sources • The Open Navigation Surface website: http://www.opennavsurf.org/ • Git Repo: https://bitbucket.org/ccomjhc/openns (currently private) • The BAG File Specification Document • Wiki: https://en.wikipedia.org/wiki/Bathymetric_Attributed_Grid