FAO Approach to Data Exchange and Dissemination
Download as PPTX, PDF4 likes922 views
The Food and Agriculture Organization (FAO) of the United Nations presents its approach to data exchange and dissemination, focusing on overcoming challenges such as data availability, harmonization, and poor governance. The FAO promotes open data principles, ensuring that data is treated as a public good and emphasizing country ownership and user needs. Key components include establishing partnerships, adopting international standards, and utilizing the FENIX platform for improved data access and sharing.
FAO Approach to Data Exchange and Dissemination
- 1. Food and Agriculture Organization of the United Nations Statistics Division - ESS CGIAR Data Standard Summit, November 26-28, Rome, Italy FAO Approach to Data Exchange and Dissemination An introduction to a free, flexible and transferable platform Josef Schmidhuber Deputy Director FAO STATISTICS DIVISION
- 2. Food and Agriculture Organization of the United Nations Statistics Division - ESS CHALLENGES CLOSE THE GAP BETWEEN DATA AVAILABILITY AND DATA NEEDS
- 3. Food and Agriculture Organization of the United Nations Statistics Division - ESS 1 2 3 4 5 6 7 Lack of data and metadata description and harmonization Restrictive or unclear data policies Dispersed and uncoordinated data life cycle management Poor governance, ineffective or missing institutional frameworks (internal & external) Limited interoperability between systems Limited user orientation and focus on needs Poor data dissemination systems, limited communication and user awareness
- 4. Food and Agriculture Organization of the United Nations Statistics Division - ESS ESS APPROACH TO DATA MANAGEMENT Key principles
- 5. Food and Agriculture Organization of the United Nations Statistics Division - ESS 1 Data and tools provided as a “public good”; no licensing constraints; full redistribution rights 2 Open data are converted into accessible data (standards, classifications, formats) 3 Technical in-country assistance provided. Data collected and disseminated are the result of the collaborative effort between FAO, countries and regions.
- 6. Food and Agriculture Organization of the United Nations Statistics Division - ESS 4 Ensure country ownership of data, methodologies and IT systems 5 Ensure that data produced and formats used meet user needs 6 Data sharing strengthened by an open-source IT platform
- 7. Food and Agriculture Organization of the United Nations Statistics Division - ESS FAO APPROACH TO DATA KEY COMPONENTS
- 8. Food and Agriculture Organization of the United Nations Statistics Division - ESS Partnership & Institutional network (Committees of key stakeholders) Political dimension Technical dimension Data sharing Network (SDMX, DDI) Definition of standards and tools
- 9. Food and Agriculture Organization of the United Nations Statistics Division - ESS
- 10. Food and Agriculture Organization of the United Nations Statistics Division - ESS Partnership & Institutional network 1 Statistical Governance System: external and internal 2 CountrySTAT: Support to Multidisciplinary Technical Working Groups (TWG) already established in 23 countries and several regional organizations 3 Linking all data initiatives such as CountrySTAT, the Global Strategy, AMIS, Censuses, IHSN 4 Agency-to-agency collaboration: with international agencies (WB, IMF, OECD, CGIAR)
- 11. Food and Agriculture Organization of the United Nations Statistics Division - ESS
- 12. Food and Agriculture Organization of the United Nations Statistics Division - ESS Data management and harmonization 1 Adoption of international standards 2 Universal code-lists and common metadata templates 3 Use of international statistical classification systems, mapping systems and DB 4 Data collection and processing methodologies to ensure data compatibility / comparability
- 13. Food and Agriculture Organization of the United Nations Statistics Division - ESS
- 14. Food and Agriculture Organization of the United Nations Statistics Division - ESS Data access and sharing (FENIX platform) 1 Service-oriented architecture (SOA) based on opensource technology 2 Integrated metadata and implementation of wellknown data exchange protocols (e.g. SDMX, DDI) 3 Web services (APIs) to facilitate data sharing between countries, regions and international organizations 4 Widget approach to deliver functionalities and integrate tools with other systems/websites
- 15. Food and Agriculture Organization of the United Nations Statistics Division - ESS Data access and sharing (FENIX platform) 5 Different options for data collection: • Synchronization of data via APIs • Online data entry forms • Uploads from csv/xls files • Automated load of email attachments • Collection of data through smartphones 6 Ability to handle databases, geospatial data (e.g. remote sensing, GIS layers, etc.) and text 7 Advanced analytical capacities with the embedded “R” statistical package
- 16. Food and Agriculture Organization of the United Nations Statistics Division - ESS Technological Integration of other systems with FENIX CGIAR UNFCCC / IPCC Access and dissemination of the Agricultural Science & Technology Indicators (ASTI) through FAOSTAT Dissemination of Greenhouse Gases data in FAOSTAT using the UNFCCC methodology USDA IMF Integration of Production, Supply & Demand database in AMIS using web services and widgets Dissemination of Government Expenditure data in FAOSTAT IMF OECD Collaboration for a joint implementation of the SDMX standard specifications Integration of Official Development Assistance (ODA) data in from the Creditor Reporting System in ADAM IFPRI National Data Sharing of HarvestChoice GIS layers through Web Map Services (WMS) Lots of national data from different institutions in CountrySTAT
- 17. FAO challenge (t-5) Distributed data dissemination systems and platforms Limited adoption of international standards (metadata, classifications, data exchange formats, code lists) Limited institutional integration, weak FAO solution New FAOSTAT platform, integration of internal and external sources CGIAR challenge Disparate data dissemination? End of proprietary classifications, shift to International standards, CPC, HS, adoption of SDMX, DDI, classifications? DDI? MDM and universal code lists SCWG and SPSC, IDWG, Chief Statistician Global FAO Commission on Statistics, Integrated regional commissions User-oriented statistical products, e.g. Capital stock and investment data Cross-centre governance? Cooperation with IOs? Internal: Cross-cutting work on AMIS, ADAM, FAOSTAT, SDW External: UNSD, C-STAT, GS, AMIS Well integrated? Harvesting – Dissemination: New SWS, new FAOSTAT, CS, country focal points Common approach to data life cycle systems? within FAO and countries/regions FENIX platform for all data products (FAOSTAT, C-STAT, ADAM, Common standards, platforms? Data quality management Corporate QAF Any QAF? governance both internally and externally (CC and GPG) Limited user orientation Cooperation: Limited integration of statistical initiatives both in house and with external partners Data life cycle management: no integration of the data production cycle, upstream and downstream IT platforms: limited interoperability User needs known?
- 18. Food and Agriculture Organization of the United Nations Statistics Division - ESS Thanks
- 19. Food and Agriculture Organization of the United Nations Statistics Division - ESS Technological Integration of FAO Systems with FENIX The largest global database on agriculture Supports national/regional agencies on data preparation and publication. It feeds into FAOSTAT Early warning and monitoring tool for food market prices and balances for the 4 main food commodities (wheat, maize, rice and soybean) Helps mobilize resources and tracks official development assistance (ODA) data flows
- 20. Food and Agriculture Organization of the United Nations Statistics Division - ESS
- 21. Food and Agriculture Organization of the United Nations Statistics Division - ESS
- 22. Food and Agriculture Organization of the United Nations Statistics Division - ESS Open source technologies used by FENIX
Editor's Notes
- #3: And therefore, this is our challenge. What data is REALLY available and what data is needed. How can we make available essential data to everyone, and make sure that this availability is maintained in a sustainable manner?
- #4: The problems highlighted above can be broken down into these key areas- Lack of data and metadata.....
- #5: But in practical terms, what has FAO done so far? How do we face theOData challenge?We are working in parallel to the internal and external integration
- #8: ...we have established links with various agencies, with whom we have build a collaboration on data, methods, standards and information products. Some of the datasets produces by these agencies have also been integrated in FAOSTAT and are regularly updated.This network approach has proved to be fruitful and it is being extended involving other FAO partners
- #9: The Network, the IT and the Statistical component. Each one of these three aspects is essential. They work together and can be considered as one. In the following slides I will describe with more details how FAO implements these 3 pillars, in what contexts and on what basis.
- #14: It is important to highlight that the network of collaborators is built on a peer-to-peerapproach, where benefits, responsibilities and visibility is equally shared.