ORFEO ToolBox at CS-SI From research to operational applications
1 like987 views
1. CS-SI uses Orfeo ToolBox (OTB) as a development framework for image processing research and operational applications. OTB supports research projects for space agencies and customers in areas like pansharpening, automatic image analysis, and hyperspectral data analysis. 2. OTB is integrated into several operational Sentinel-2 ground segment processing systems developed by CS-SI, including the Level-0 and Level-1 Instrument Processing Facility and the Mission Performance Assessment system. 3. CS-SI also develops end-user applications for agriculture using OTB, including a composite product, LAI retrieval, and crop mask and type classification using Sentinel-2 and Landsat-8 data.
ORFEO ToolBox at CS-SI From research to operational applications
- 1. 1 CS Communication & Systèmes –Space Catalogue ORFEO ToolBox at CS-SI From research to operational applications 2/06/2015 Mickaël Savinaud CS Image Processing Toolbox manager Orfeo Toolbox is not a black box http://www.orfeo-toolbox.org
- 2. CS Communication & Systèmes –Space Catalogue2 CS-SI Image Geographic Application Department 75 people - Dual IT and Thematic skills 25% of PhD in the team 8 M€ turnover Consultant & study (Contract and project management, technical expertise, needs study, modeling, prototype…) services Research & Development (Internal study, work experiences and thesis) Training, Support and Maintenance (customer support, technical support, operational conditions support, and training) Prime contractor, Development & systems integration ( contract work, ready-made systems & COTS)
- 3. CS Communication & Systèmes –Space Catalogue3 CS-SI Image Geographic Application Department • Ground Segment Image Processing chain: IPF S2, MACCS, Kalideos • Ground Segment Image Quality: MPC S2, ICC Pleiades, VIQ, MPA S2 • Image Processing Tools Box: OTB, RUGGED, CNES Common Tools image processing expertise of earth observation ground station : acquisition, inventory, production, thematic and added-value image processing. • PAAS -Geospatial Platform Technology: Geostorm • Applications and Services activities Land, Environment, Energy, Defense: Saterre, S2Agri, PEPS Applications and Information Systems Design and Engineering
- 4. CS Communication & Systèmes –Space Catalogue4 Orfeo ToolBox – Address various R&D issues Different research works already done with OTB At CS-SI through internship or co-funded thesis. Some R&D studies for space agencies or end-users done with OTB at CS-SI CNES - Benchmark of various algorithm method (pansharpening, compression, …). CNES - Improve automatic image analysis with exogenous data (risk maps, DEM, OpenStreetMap). CNES - Hyperspectral data analysis. CNES - How to deal efficiently with large scale segmentation. EUMETSAT - Definition and prototyping of new methods of geometry quality assessment for MTG. XXX-Automatic detection of rust on utility pole from Unmanned aerial vehicle (UAV). ORFEO ToolBox as strong development framework for R&D studies
- 5. CS Communication & Systèmes –Space Catalogue5 Orfeo ToolBox - Sentinel-2 ground segment processing CNES - Multi-mission Atmospheric and Cloud Correction Software (MACCS) Processing multi-temporal and/or multi-spectral images to produce physical measurements Atmospheric corrections: AOT estimation, environment and slope correction Cloud, Cloud Shadow, Water and Snow detection Develop since end of 2009 with Venµs and Formosat (Landsat8, Spot4-5 and S2) TAS/ESA - Sentinel 2 Level-0 and Level-1 Instrument Processing Facility (IPF) Automatic production of large volume of Sentinel-2 L1c products. OTB in image processing module: cloud/water mask computing, resampling from location grid, radiometric corrections (deconvolution, image filtering, aberrant pixel interpolation). TAS/ESA - Sentinel-2 Mission Performance Assessment (MPA): Resampling of image data Correlation between bands to detect misalignment.
- 6. CS Communication & Systèmes –Space Catalogue6 Orfeo ToolBox - Sentinel-2 end-users tools Sentinel-2 ToolBox: set of visualization, analysis and processing tools for the exploitation of MSI data from Sentinel-2 mission. Re-use the components and the heritage of BEAM Toolbox Common framework and development with other Sx Toolbox -> SNAP First release last year in September Second release in few days with the first steps of OTB integration thanks to the standard tool adapter
- 7. CS Communication & Systèmes –Space Catalogue7 Orfeo ToolBox - Sentinel-2 end-users application Sentinel-2 For Agriculture: www.esa-sen2agri.iorg Support definition and production of 4 new products and the related algorithm Provide an open source system to end- user R&D and operational image processing chains done with OTB Use Sentinel-2 L1C and LandSat8 L1T data Composite product: BRDF correction and weighted average approach LAI retrieval: based on otb-bv code Dynamic crop mask and crop type: based on OTB classification framework Crop type result over Belgium site (S4-5 + L8 times series)
- 8. CS Communication & Systèmes –Space Catalogue8 Orfeo ToolBox - OTB and Web Services RTU Pleiades: Use OTB to extract information from Pleiades product used by ORFEO community Generate data for product database (ingestion, radiometric calibration, …) Online processing based on WPS and OTB functionalities (stereo, segmentation, …). SDI Processing server Client
- 9. CS Communication & Systèmes –Space Catalogue9 Orfeo ToolBox - OTB and Web Services PEPS web platform: Add interactive supervised classification Custom web interface and Spatial Data Infrastructure: GeoStorm
- 10. CS Communication & Systèmes –Space Catalogue10 OTB and QGIS at CS-SI Integration of OTB in QGIS RapidEye Time series / S2 catalog TerreImage plugin
- 11. CS Communication & Systèmes –Space Catalogue11 CONCLUSION: R&D to Operational context OTB is used at CS-SI as a development framework for image processing over large dataset Flexible: open source, bindings (python)… Completeness: many algorithms available Performance Maintainability: documentation, strong development rules, … OTB is used at CS-SI for operational development with strong constraints CS-SI proposes Training around OTB for developers or users CS-SI will submit its application to PSC CS-SI will contribute some developments to OTB according to the new governance policy and license CS-SI is sponsor of the first OTB hackfest