Item 6: Discussion on the Global Spectral Calibration Library
Download as PPTX, PDF0 likes139 views
- The document discusses proposals for establishing a global spectral calibration library and soil property estimation service. - The revised proposal of establishing a federated global spectral calibration library was agreed upon, with the work organized into two stages - the first focusing on the MIR library using KSSL instruments, and the second expanding to other spectral data. - Key aspects of the revised proposal include the library being hosted as a federated system with data ownership remaining with providers, and the development of a soil property estimation service based on the library and using standard measurement protocols.
Item 6: Discussion on the Global Spectral Calibration Library
- 1. Item 6 Discussion on the global spectral calibration library Moderator: Ms. Lucrezia Caon, FAO
- 2. Decision 1 What proposal shall we go for?
- 3. Global spectral calibration library hosted at USDA-NSSC Kellogg Soil Survey Laboratory (KSSL) Main characteristics: • Library developed under the GSP framework - the GSP will host a copy of the library • Partners will work together on the development of the initiative and its architecture • Countries contribute samples of their benchmark soils, which KSSL will characterize for a standard suite of soil properties together with MIR, at no cost, and then add the data into the global calibration library • The GSP and other regional bodies should assist countries in preparing and shipping the samples to the US Original Proposal Global Soil Information System (GLOSIS) The two systems will be linked Global Soil Property Estimation Service Main characteristics: • Based on MIR spectra and soil property data recorded at KSSL • Uses in country measured spectra of new samples according to standard protocol • Partners to work together on the development of the best calibration algorithms and serve them up through use friendly web-based interfaces • The service would provide alternative models including downloadable desktop versions, for countries with limited internet connectivity • All code will be open source and FAIR (findable, accessible, interoperable and re-usable)
- 4. Global spectral calibration library established as a federated system Main characteristics: • Data consultable at a central portal at FAO • Partners will work together on the development of the initiative and its architecture • The ownership of the data remains with the data provider • Possibility to include spectra other than MIR Areas of concern: • Calibration of data and instruments Revised Proposal Global Soil Information System (GLOSIS) The two systems will be linked Global Soil Property Estimation Service Main characteristics: • Based on the global spectral calibration library • Uses in country measured spectra of new samples according to standard protocol • Partners to work together on the development of the best calibration algorithms and serve them up through use friendly web-based interfaces • The service would provide alternative models including downloadable desktop versions, for countries with limited internet connectivity • All code will be open source and FAIR (findable, accessible, interoperable and re-usable)
- 5. What proposal shall we go for? Please vote for the proposal that aligns the most to your thinking, we will work on details little by little in the next slides POLL 3 Original proposal vs. Revised proposal
- 7. STAGE 1 Establishment of the MIR library and calibration service based on KSSL instruments (Estimated duration: 2 years) STAGE 2 Including other spectrometers and spectral data in the library and establishment of the necessary calibration Do you agree on organizing the work in the following two stages? If no, please write your suggestion in the chat AGREED
- 8. Global spectral calibration library established as a federated system Global Soil Information System (GLOSIS) Global Soil Property Estimation Service Countries (laboratories, individuals, etc.) Data Samples of benchmark soils Data (public available). Countries to decide when to make the data available to the library Developmentofalgorithmsand guidelinesformeasurement Partners & Regional Champion lab/institutes • Can use it as long as they have compatible instrument specifications and sample preparation procedures • Possibility to use their existing soil spectral libraries in conjunction with the estimation service Same as per the countries • Contribute to the development and architecture • Data Existinglibraries
- 9. Global spectral calibration library established as a federated system Countries (laboratories, individuals, etc.) Data Samples of benchmark soils Data (public available). Countries to decide when to make the data available to the library Points of attention: - Possibility to work with spectra other than MIR : Copyright : - Who will bear the costs for the shipment and analysis of the samples ? - Publishing of data - POLL 4 for those sending samples to the USDA X
- 10. Points of attention: - Possibility to work with spectra other than MIR : YES (MIR to start in Stage 1, NIR, Vis-NIR, SWIR, gamma and XRF, EDXRF, FTIR, ATR) - Copyright : FAO Global Soil Partnership for the global product. But the ones providing the data are the data owner. Reference to the GSP Soil Data Policy (http://www.fao.org/3/a-bs975e.pdf) - Who will bear the costs for the shipment and analysis of the samples ? GLOSOLAN will apply for projects to cover these costs. Countries and regional champions are invited to cover these costs by themselves as much as possible. - Publishing of data - POLL 4 for those sending samples to the USDA
- 11. PUBLISHING OF DATA FOR SAMPLES SENT TO THE USDA Data will be certified and made available as soon as the sample submitter says the data are ok. However, the review period cannot be unlimited Procedure in steps 1. Samples arrive at KSSL 2. Samples are analysed 3. Results are sent back to the sample provider for review 4. Results confirmed by the sample provider 5. Data are published online
- 12. Only for those of you that accepts the USDA policy and will likely send samples to the KSSL! POLL 4 : How much time would you need to review data generated by the USDA on your samples? Options: 1 month, 3 months, 6 months or 8 months? Note: What decided through this poll will be brought to attention of the USDA management for consideration. GLOSOLAN members will be informed on the decision of the USDA as soon as a decision is made. The sample submission form will be adjusted accordingly.
- 13. PUBLISHING OF DATA FOR SAMPLES SENT TO REGIONAL CHAMPION LABORATORIES/INSTITUTES Data will be certified and made available to GLOSOLAN…when?? As soon as quality is approved. Labs need to agree on standards for quality control. 1. Identify the regional champions 2. Ask them to provide info on methods and instruments, and soil samples preparation protocols 3. Harmonization of methods for wet chemistry (watch out not to duplicate, go against the work of GLOSOLAN on wet chemistry) and spectroscopy 4. Organization of a PT among KSSL and regional champions to assess the variability in the measurement 5. Work to reduce the variability through the organization of other PTs and capacity building 6. Approval process: establishment of a panel to do this work 7. Ask countries to send samples and start adding data to the library. Important to refer to the lab that did the analysis and where the samples come from
- 14. The champions can also check which soils are missing in the KSSL libraries, the focus then of the gold standard labs can be on those gaps, so that representatively and quality go together How can we ensure that data coming from different sources are comparable? As per previous slide
- 15. PUBLISHING OF DATA FOR OWN SAMPLES (self-analysis) Data will be certified and made available to GLOSOLAN…when?? Individuals should work with regional champions. Send some samples to the champions and then work on their own to build their own libraries 1. We provide countries with quality standards 2. Organize a PT so that they can check for the quality themselves 3. Help those in need to improve (capacity building) These data cannot be considered in the modelling system. The role of the regional champions should that of helping local labs getting good quality data (software development at the point of data capture). How can we ensure that data coming from different sources are comparable? As above
- 16. The GLOSOLAN coordinator will send to all participants and GLOSOLAN members an email asking to provide the following information : Can you send samples to the USDA? Y/N Can you send samples to a regional champion lab/institute? Y/N. If Y, to what champion? Would you analyse the samples yourself? Y/N. If Y, can you please provide info on the instruments you are using? Do you use MIR? Y/N. If N, what other spectral range do you measure? Do you have any spectral library already? Y/N. If Y, please describe it and inform us if you would like to have it as part of the global library
- 17. PUBLISHING OF DATA The USDA, the regional champion laboratories/institutes and FAO cannot take any responsibility over what the end users of the library will publish. We can just appeal to their professionalism and code- of-conduct of people.
- 18. Global spectral calibration library established as a federated system Countries (laboratories, individuals, etc.) Partners & Regional Champion lab/institutes • Contribute to the development and architecture • Data Points of attention: - How can partners contribute to the development and architecture of the library? - Who will bear the costs for training and remote support to laboratories in need?
- 19. Points of attention: - How can partners contribute to the development and architecture of the library? 1. All those interested in contributing should send an email to lucrezia.caon@fao.org 2. We will establish a dedicated working group to work on it 3. Fenny to provide the list of software pieces to develop …we will assign tasks to the members of the working We need to provide a better definition of the federated system (add a note on cloud and R) - Who will bear the costs for training and remote support to laboratories in need? We will apply for projects but in-kind contributions are welcome
- 20. Global spectral calibration library established as a federated system Global Soil Property Estimation Service Countries (laboratories, individuals, etc.) Developmentofalgorithmsand guidelinesformeasurement Partners & Regional Champion lab/institutes • Can use it as long as they have compatible instrument specifications and sample preparation procedures • Possibility to use their existing soil spectral libraries in conjunction with the estimation service Same as per the countries Points of attention: - How can partners contribute to the development of algorithms and guidelines for measurement? - Who defines compatible instrument specifications and sample preparation procedures? The KSSL? - How will the connection between the library and the estimation service be made? Where will the estimation service be hosted?
- 21. Points of attention: - How can partners contribute to the development of algorithms and guidelines for measurement? 1. All those interested to contribute should send an email to lucrezia.caon@fao.org 2. We will establish a dedicated working group Algorithms: link to the software system development / discussion on models Guidelines for measurement: to be discussed tomorrow - Who defines compatible instrument specifications and sample preparation procedures? The KSSL? To be discussed tomorrow - How will the connection between the library and the estimation service be made? To be addressed by the working group identified under question 1 Where will the estimation service be hosted? FAO
- 22. Global spectral calibration library established as a federated system Global Soil Information System (GLOSIS) Global Soil Property Estimation Service Countries (laboratories, individuals, etc.) Partners & Regional Champion lab/institutes Existinglibraries Points of attention: - How else can partners and countries contribute to GLOSIS? - How the connection between the library, GLOSIS and the estimation service be established? - Is it satisfactory to work with other existing libraries only in GLOSIS?
- 23. Points of attention: - How else can partners and countries contribute to GLOSIS? Through the development of the system (join INSII – additional information on it to be sent by email). You can become a GLOSIS node as a spectral library (additional information on it to be sent by email) – to be discussed as there might be technical issues related to it. Help develop others to contribute to GLOSIS (capacity building). - How the connection between the library, GLOSIS and the estimation service be established? Working groups for the library and estimation service - Is it satisfactory to work with other existing libraries only in GLOSIS? Yes, existing libraries to be considered through GLOSIS. But those that have existing libraries can send reference samples to the KSSL and the regional champion labs.
- 24. Global spectral calibration library established as a federated system Main characteristics: • Data consultable at a central portal at FAO • Partners will work together on the development of the initiative and its architecture • The ownership of the data remains with the data provider • Possibility to include spectra other than MIR Areas of concern: • Calibration of data and instruments Revised Proposal Global Soil Information System (GLOSIS) The two systems will be linked Global Soil Property Estimation Service Main characteristics: • Based on the global spectral calibration library • Uses in country measured spectra of new samples according to standard protocol • Partners to work together on the development of the best calibration algorithms and serve them up through use friendly web-based interfaces • The service would provide alternative models including downloadable desktop versions, for countries with limited internet connectivity • All code will be open source and FAIR (findable, accessible, interoperable and re-usable)
- 25. Distribution of work (To be prepared and revised tomorrow based on the discussion we had today) Activity Implemented by Deadline Development of the library Development of the calibration service Development of the soil property estimation service
- 26. Were all concerns address? If no, please write your pending concerns in the chat YES
- 27. This proposal suggest to identify and work with regional champion laboratories/institutes on soil spectroscopy …
- 28. Thanks for your attention The pictures in the covers and background of this presentation are a courtesy of Dr. Fenny van Egmond, ISCRI