DSD-INT 2015 - Data management with open earth datalabs - Gerben de Boer, van Oord & Kees den Heijer, Deltares
0 likes646 views
The document discusses different methods for accessing environmental data from servers using open standards. It focuses on OPeNDAP, WMS and WCS protocols. Examples are provided on how to access data from these servers using Python, Matlab and QGIS. The last section promotes using the OpenEarth server stack to serve your own data using open standards.
DSD-INT 2015 - Data management with open earth datalabs - Gerben de Boer, van Oord & Kees den Heijer, Deltares
- 1. 1 OpenEarth Delft Software Days 2015 27th oct 2015 Data management with OpenEarth DataLabs Dr.ir. Gerben J de Boer - Van Oord / TU Delft Dr.ir. Kees den Heijer - Deltares / TU Delft For code examples see: https://github.com/openearth/notebooks
- 2. 2 Different layers of standard inspired by Tim Berners- Lee: 5 ★ Open Data Repository: web-based standards
- 5. 5 Data discovery Meta-data portals (human readable) http://marine.copernicus.eu/ http://oceancolor.gsfc.nasa.gov/ https://www.ghrsst.org/ http://cci.esa.int/ .. Catalogue of THREDDS data server Catalogues (machine + human readable) http://opendap.deltares.nl THREDDS serves data in a variety of formats.
- 7. 7 THREDDS data server example http://thredds.jpl.nasa.gov/thredds/dodsC/ncml_aggregation/Chlorophyll/seawifs/aggregate__SEAWIFS_L3_CHLA_MONTHLY_9KM_R.ncml I did quite some SeaWifs analysis myself with SeaDas during my PhD, so it is my favorite example. Ref: Mechanisms controlling the intra-annual mesoscale variability of SST and SPM in the southern North Sea
- 9. 9 1. OPeNDAP: with servlet http://zandmotor.citg.tudelft.nl/netcdfreadersguide/
- 10. 10 1. OPeNDAP: with Matlab For netCDF_OPeNDAP you have to gethypercube indices from the geographical bbox yourselves. https://github.com/openearth/notebooks/tree/master/matlab
- 11. 11 1. OPeNDAP: with Python (1/3) For netCDF_OPeNDAP you have to gethypercube indices from the geograp https://github.com/openearth/notebooks/blob/master/EarthObservationWebServices.ipynb
- 12. 12 1. OPeNDAP: with Python (2/3)
- 13. 13 1. OPeNDAP: with Python (3/3)
- 14. 14 2. WMS: with Google Earth Hard-code non-OGC keywords like time, colorscalerange. Because Google preserves them. Do not hard-code bbox.
- 15. 15 2. WMS: with browser https://publicwiki.deltares.nl/display/OET/WMS+primer http://thredds.jpl.nasa.gov/thredds/wms/ncml_aggregation/Chlorophyll/seaw &service=WMS& version=1.3.0 &request=GetMap &bbox=50,-10,60,15 &layers=l3m_data &format=image/png &CRS=EPSG%3A4326 &width=800 &height=600 &transparent=true &styles=boxfill/sst_36 &colorscalerange=0,10 &time=1997-09-01T00:00:00.000Z You can paste this block into your browser incl. the end-of-line characters. non-OGC.
- 16. 16 2. WMS: with Matlab (OET)
- 17. 17 2. WMS: with Python
- 18. 18 2. WMS: with QGIS CANNOT add non OGC keywords like colorscalerange
- 19. 19 3. WCS: with Matlab WCS takesgeographical bbox, unlike netCDF-OPeNDAP
- 20. 20 3. WCS: with Python WCS takesgeographical bbox, unlike netCDF-OPeNDAP
- 21. 21 OpenEarth server stack: serve your own data too !