Near-real time monitoring of habitat change using a neural network and MODIS data:  the PARASID approach Andy Jarvis, Louis Reymondin, Jerry Touval
Contents The approach The implementation Some examples Comparison with other models Plans and timelines
Objectives of PARASID HUman Impact Monitoring And Natural Ecosystems Provide near-real time monitoring of habitat change (<3 month turn-around) Continental – global coverage (forests AND non-forests) Regularity in updates
The Approach The change in greenness of a given pixel is a function of: Climate Site (vegetation, soil, geology) Human impact
Machine learning We therefore try to learn how each pixel (site) responds to climate, and any anomoly corresponds to human impact Machine learning (or neural-network), is a bio-inspired technology which emulates the basic mechanism of a brain. It allows  To find a pattern  in noisy dataset To apply these patterns to new dataset
NDVI Evolution and novelty detection Novelty/Anomoly
NDVI Cleaning using HANTS Eliminate all short-term variations Uses NDVI quality information Iterative fitting of cleaned curve using Fourier analysis Least-square fitting to good quality values
Methodology As required by the ARD algorithm, each input and the hidden output is a weights class with its own  α   α 0 α c INPUTS :  Past NDVI (MODIS 3b42)   Previous rainfall (TRMM)   Temperature (WorldClim) OUTPUT : 16 day predicted NDVI NDVI t Precipitation  (t) Temperature (t) … … w 0 w 1 w 2 NDVI (t-1) NDVI (t-2) NDVI (t-n) w p1 w p2 w p3 w o1 w o2 w o3
Methodology – Bayesian NN To detect novelties, Bayesian Neural Networks provide us two indicators The predicted value The probability repartition of where the value should be The first one allows us to detect abnormal measurements The second one allows us to say how sure we are a measurement is abnormal.
The Processing For South America alone, first calculations approximated 10 years of processing for the NN to learn: A map of 30720 by 37440 pixels     1,150,156,800 vectors    23 vectors per year    26,453,606,400 NDVI values to manage per year    9.5 years of data    251,309,260,800 individual data points Through various processes, optimizations and hardware acquisitions reduced time to 3 months for NN learning Detection takes 2-3 days
Sample novelty analysis
The Bottom-Line 250m resolution Latin American coverage (currently) 3 week turnaround from data being made available (4 week delay in MODIS going to NASA ftp)  (3+4 = 7 weeks) Report every 16 days Measurement of scale of habitat change (0-1) and probability of event
An Example - Caquetá Training  From 2000 to end of 2003 Detections From 2004 to May of 2009
Detection results for Caquetá – Meta Analysis 25 May 2009 1.0 0.0 Novelty probabilities
Detection : See Caqueta-meta KML See  http://www.youtube.com/watch?v=exGmzc70PrQ   Pink : Too many clouds to analyse Red : 3 consecutive times detected with more than 95% confidence
Deforestation Rates on the Rise
Some statistics 75% of deforestation occurs in December and January 50,000 Ha deforested in Dec/Jan of 2008/2009 compared with 7,500 Ha in 2004/2005 During 16 days of Christmas in 2008 16,000 Ha lost, compared with 500 Ha in 2004 (3%)
 
Other Examples
Chile
Bolivia
Paraguay
Argentina
OTCA
Model comparison PARASID vs. FORMA PARASID detections First detection in 2004 FORMA probabilities First detection in 2000
PARASID vs DETER It seems Parasid model detects quite small and isolate events which Deter doesn’t detect. 2006 2004
Next Steps Fully functioning web interface January 2010 Continental validation and calibration (January 2010) Global extent (2011) Additional models to identify type of change (drivers) (2011)
Analysis of three images between the years 2000 and 2009. MATO-GROSSO – BRASIL LAT: - 10.1, LON: - 51.3 10/10/2000 LANDSAT 7 SLC ON 29/06/2009 LANDSAT 7 SLC OFF CLASSIFIED IMAGES IN ERDAS Forest Uncoverage Change 00-09 Unchanged CHANGE DETECTION IN ERDAS
SAMPLING POINTS IN LATIN-AMERICA 1.   Covering the whole Latin-America 2.   Sampling of different land use type Tropical forest Andes Savanna Desert 3.   Selection of areas with high risk of change Near to cities Near to road Near to rivers With crops already existing SELECTION CRITERIA
Conclusions Near-real time global monitoring  is  possible PARASID now functioning for Latin America Providing first approximations of deforestation rates in over a decade for some parts of Latin America
GRACIAS!

More Related Content

PPT
Andy Jarvis Parasid Near Real Time Monitoring Of Habitat Change Using A Neura...
PPTX
Andy Jarvis - Parasid Near Real Time Monitoring Of Habitat Change Tnc Slt
PPT
Andy Jarvis - Parasid Near Real Time Monitoring Of Habitat Change Using A Neu...
PPTX
TERN eMAST : Observations and terrestrial ecosystem models : Terrestrial Ecos...
PPTX
NOAA's Climate Data Record (CDR) Program
PPT
Constructing a long time series of soil moisture using SMOS data with statist...
PPTX
Classroom occupancy project
PPT
Poster Nov19 V1
Andy Jarvis Parasid Near Real Time Monitoring Of Habitat Change Using A Neura...
Andy Jarvis - Parasid Near Real Time Monitoring Of Habitat Change Tnc Slt
Andy Jarvis - Parasid Near Real Time Monitoring Of Habitat Change Using A Neu...
TERN eMAST : Observations and terrestrial ecosystem models : Terrestrial Ecos...
NOAA's Climate Data Record (CDR) Program
Constructing a long time series of soil moisture using SMOS data with statist...
Classroom occupancy project
Poster Nov19 V1

What's hot (15)

PPT
050405 Epa Satellite
PDF
Blue Waters Enabled Advances in the Fields of Atmospheric Science, Climate, a...
PDF
The Large Interferometer For Exoplanets (LIFE): the science of characterising...
PDF
Efficient data reduction and analysis of DECam images using multicore archite...
PPTX
kellndorfer_WE3.T05.4.pptx
PDF
Referal-Kevin-Grimes
PDF
Importing satellite imagery into R from NASA and the U.S. Geological Survey
PPTX
Linked Sensor Data
PPTX
Real Time Semantic Analysis of Streaming Sensor Data
DOCX
Metric Take Home Lab
PPTX
Provenance Aware Linked Sensor Data
PDF
CLEARMiner: Mining of Multitemporal Remote Sensing Images
PPT
14MCE1035
PDF
K venkata reddy
PPT
Poster Nov19
050405 Epa Satellite
Blue Waters Enabled Advances in the Fields of Atmospheric Science, Climate, a...
The Large Interferometer For Exoplanets (LIFE): the science of characterising...
Efficient data reduction and analysis of DECam images using multicore archite...
kellndorfer_WE3.T05.4.pptx
Referal-Kevin-Grimes
Importing satellite imagery into R from NASA and the U.S. Geological Survey
Linked Sensor Data
Real Time Semantic Analysis of Streaming Sensor Data
Metric Take Home Lab
Provenance Aware Linked Sensor Data
CLEARMiner: Mining of Multitemporal Remote Sensing Images
14MCE1035
K venkata reddy
Poster Nov19
Ad

Viewers also liked (6)

PPTX
Monitoring and Evaluation Open Discussion
PPT
Mainstreaming e-data collection in CIAT programs in Africa
PPT
Access and Availability of Research Results: Pathways to Accessibility
PPT
Scientific Publishing in a Changing World: An Update on Open Access and Copy...
PPT
Public Private Partnerships at CIAT
PPT
Andy Jarvis and Louis Reymondin - PARASID Near Real Time Monitoring Of Defo...
Monitoring and Evaluation Open Discussion
Mainstreaming e-data collection in CIAT programs in Africa
Access and Availability of Research Results: Pathways to Accessibility
Scientific Publishing in a Changing World: An Update on Open Access and Copy...
Public Private Partnerships at CIAT
Andy Jarvis and Louis Reymondin - PARASID Near Real Time Monitoring Of Defo...
Ad

Similar to Andy Jarvis Parasid Near Real Time Monitoring Of Habitat Change Using A Neural Netwrok And Modis Data Conida Sept 2009 (20)

PPT
Andy Jarvis PARASID Near Real Time Monitoring Of Habitat Change Using A Neur...
PPT
Andy J Humane Near Real Time Monitoring Of Deforestation Using A Neural Aug...
PPT
Andy J Humane Near Real Time Monitoring Of Deforestation Using A Neural Aug...
PPTX
Workshop usgs brasil_2015_01
PPTX
Terra-i, An eye on Habitat Change
PPTX
Emerging Hot Spot Analysis
PPTX
Terra-i, An eye on habitat change
PDF
Colin Prentice SPEDDEXES 2014
PPTX
NextGen environmental sensing at the National Arboretum
PPTX
GFW Partner Meeting 2017 - Parallel Discussions 3: Monitoring Beyond Forests
PPTX
HLEG thematic workshop on measuring economic, social and environmental resili...
PPT
Web-based GIS to support policy and program development for the Amazon
PPTX
Deforestation diagnostics
PPTX
Monitoring Biomass Dynamics at Scale: Emerging Trends and Recent Successes
PPTX
2015-08-13 ESA: NextGen tools for scaling from seeds to traits to ecosystems
PPTX
Highly Organised, Disruptive Big Data Science in CIAT
PDF
IMED 2018: Landcover/habitat
PDF
2018 ASPRS: Big Data: Utilizing Landsat to Detect Ephemeral Water Sources in ...
PDF
Data Intelligence and Governance: Earth Observation, Open Data, and Machine L...
PDF
Af33174179
Andy Jarvis PARASID Near Real Time Monitoring Of Habitat Change Using A Neur...
Andy J Humane Near Real Time Monitoring Of Deforestation Using A Neural Aug...
Andy J Humane Near Real Time Monitoring Of Deforestation Using A Neural Aug...
Workshop usgs brasil_2015_01
Terra-i, An eye on Habitat Change
Emerging Hot Spot Analysis
Terra-i, An eye on habitat change
Colin Prentice SPEDDEXES 2014
NextGen environmental sensing at the National Arboretum
GFW Partner Meeting 2017 - Parallel Discussions 3: Monitoring Beyond Forests
HLEG thematic workshop on measuring economic, social and environmental resili...
Web-based GIS to support policy and program development for the Amazon
Deforestation diagnostics
Monitoring Biomass Dynamics at Scale: Emerging Trends and Recent Successes
2015-08-13 ESA: NextGen tools for scaling from seeds to traits to ecosystems
Highly Organised, Disruptive Big Data Science in CIAT
IMED 2018: Landcover/habitat
2018 ASPRS: Big Data: Utilizing Landsat to Detect Ephemeral Water Sources in ...
Data Intelligence and Governance: Earth Observation, Open Data, and Machine L...
Af33174179

More from CIAT (20)

PPTX
Agricultura Sostenible y Cambio Climático
PDF
Resumen mesas trabajo
PDF
Impacto de las intervenciones agricolas y de salud para reducir la deficienci...
PDF
Agricultura sensible a la nutrición en el Altiplano. Explorando las perspecti...
PDF
El rol de los padres en la nutrición del hogar
PPTX
Scaling up soil carbon enhancement contributing to mitigate climate change
PPTX
Impacto del Cambio Climático en la Agricultura de República Dominicana
PDF
BioTerra: Nuevo sistema de monitoreo de la biodiversidad en desarrollo por el...
PPTX
Investigaciones sobre Cadmio en el Cacao Colombiano
PPTX
Cacao for Peace Activities for Tackling the Cadmium in Cacao Issue in Colo...
PPTX
Tackling cadmium in cacao and derived products – from farm to fork
PPTX
Cadmium bioaccumulation and gastric bioaccessibility in cacao: A field study ...
PPTX
Geographical Information System Mapping for Optimized Cacao Production in Col...
PDF
Contenido de cadmio en granos de cacao
PPTX
Técnicas para disminuir la disponibilidad de cadmio en suelos de cacaoteras
PPTX
Cacao and Cadmium Research at Penn State
PPTX
Aportes para el manejo de Cd en cacao
PPTX
CENTRO DE INNOVACIÓN DEL CACAO PERÚ
PPTX
Investigaciones sore Cadmio en el Cacao Colombiano
PPTX
Avances de investigación en cd en cacao
Agricultura Sostenible y Cambio Climático
Resumen mesas trabajo
Impacto de las intervenciones agricolas y de salud para reducir la deficienci...
Agricultura sensible a la nutrición en el Altiplano. Explorando las perspecti...
El rol de los padres en la nutrición del hogar
Scaling up soil carbon enhancement contributing to mitigate climate change
Impacto del Cambio Climático en la Agricultura de República Dominicana
BioTerra: Nuevo sistema de monitoreo de la biodiversidad en desarrollo por el...
Investigaciones sobre Cadmio en el Cacao Colombiano
Cacao for Peace Activities for Tackling the Cadmium in Cacao Issue in Colo...
Tackling cadmium in cacao and derived products – from farm to fork
Cadmium bioaccumulation and gastric bioaccessibility in cacao: A field study ...
Geographical Information System Mapping for Optimized Cacao Production in Col...
Contenido de cadmio en granos de cacao
Técnicas para disminuir la disponibilidad de cadmio en suelos de cacaoteras
Cacao and Cadmium Research at Penn State
Aportes para el manejo de Cd en cacao
CENTRO DE INNOVACIÓN DEL CACAO PERÚ
Investigaciones sore Cadmio en el Cacao Colombiano
Avances de investigación en cd en cacao

Recently uploaded (20)

PDF
CloudStack 4.21: First Look Webinar slides
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
Flame analysis and combustion estimation using large language and vision assi...
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
PDF
A proposed approach for plagiarism detection in Myanmar Unicode text
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PDF
Hindi spoken digit analysis for native and non-native speakers
PPT
What is a Computer? Input Devices /output devices
PDF
The influence of sentiment analysis in enhancing early warning system model f...
PPT
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
PDF
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
PPTX
Configure Apache Mutual Authentication
PDF
A comparative study of natural language inference in Swahili using monolingua...
DOCX
search engine optimization ppt fir known well about this
PDF
A review of recent deep learning applications in wood surface defect identifi...
PPT
Geologic Time for studying geology for geologist
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
Architecture types and enterprise applications.pdf
PDF
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
CloudStack 4.21: First Look Webinar slides
Final SEM Unit 1 for mit wpu at pune .pptx
Flame analysis and combustion estimation using large language and vision assi...
Taming the Chaos: How to Turn Unstructured Data into Decisions
Convolutional neural network based encoder-decoder for efficient real-time ob...
A proposed approach for plagiarism detection in Myanmar Unicode text
sbt 2.0: go big (Scala Days 2025 edition)
Hindi spoken digit analysis for native and non-native speakers
What is a Computer? Input Devices /output devices
The influence of sentiment analysis in enhancing early warning system model f...
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
Hybrid horned lizard optimization algorithm-aquila optimizer for DC motor
Configure Apache Mutual Authentication
A comparative study of natural language inference in Swahili using monolingua...
search engine optimization ppt fir known well about this
A review of recent deep learning applications in wood surface defect identifi...
Geologic Time for studying geology for geologist
Zenith AI: Advanced Artificial Intelligence
Architecture types and enterprise applications.pdf
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...

Andy Jarvis Parasid Near Real Time Monitoring Of Habitat Change Using A Neural Netwrok And Modis Data Conida Sept 2009

  • 1. Near-real time monitoring of habitat change using a neural network and MODIS data: the PARASID approach Andy Jarvis, Louis Reymondin, Jerry Touval
  • 2. Contents The approach The implementation Some examples Comparison with other models Plans and timelines
  • 3. Objectives of PARASID HUman Impact Monitoring And Natural Ecosystems Provide near-real time monitoring of habitat change (<3 month turn-around) Continental – global coverage (forests AND non-forests) Regularity in updates
  • 4. The Approach The change in greenness of a given pixel is a function of: Climate Site (vegetation, soil, geology) Human impact
  • 5. Machine learning We therefore try to learn how each pixel (site) responds to climate, and any anomoly corresponds to human impact Machine learning (or neural-network), is a bio-inspired technology which emulates the basic mechanism of a brain. It allows To find a pattern in noisy dataset To apply these patterns to new dataset
  • 6. NDVI Evolution and novelty detection Novelty/Anomoly
  • 7. NDVI Cleaning using HANTS Eliminate all short-term variations Uses NDVI quality information Iterative fitting of cleaned curve using Fourier analysis Least-square fitting to good quality values
  • 8. Methodology As required by the ARD algorithm, each input and the hidden output is a weights class with its own α α 0 α c INPUTS : Past NDVI (MODIS 3b42) Previous rainfall (TRMM) Temperature (WorldClim) OUTPUT : 16 day predicted NDVI NDVI t Precipitation (t) Temperature (t) … … w 0 w 1 w 2 NDVI (t-1) NDVI (t-2) NDVI (t-n) w p1 w p2 w p3 w o1 w o2 w o3
  • 9. Methodology – Bayesian NN To detect novelties, Bayesian Neural Networks provide us two indicators The predicted value The probability repartition of where the value should be The first one allows us to detect abnormal measurements The second one allows us to say how sure we are a measurement is abnormal.
  • 10. The Processing For South America alone, first calculations approximated 10 years of processing for the NN to learn: A map of 30720 by 37440 pixels  1,150,156,800 vectors  23 vectors per year  26,453,606,400 NDVI values to manage per year  9.5 years of data  251,309,260,800 individual data points Through various processes, optimizations and hardware acquisitions reduced time to 3 months for NN learning Detection takes 2-3 days
  • 12. The Bottom-Line 250m resolution Latin American coverage (currently) 3 week turnaround from data being made available (4 week delay in MODIS going to NASA ftp) (3+4 = 7 weeks) Report every 16 days Measurement of scale of habitat change (0-1) and probability of event
  • 13. An Example - Caquetá Training From 2000 to end of 2003 Detections From 2004 to May of 2009
  • 14. Detection results for Caquetá – Meta Analysis 25 May 2009 1.0 0.0 Novelty probabilities
  • 15. Detection : See Caqueta-meta KML See http://www.youtube.com/watch?v=exGmzc70PrQ Pink : Too many clouds to analyse Red : 3 consecutive times detected with more than 95% confidence
  • 17. Some statistics 75% of deforestation occurs in December and January 50,000 Ha deforested in Dec/Jan of 2008/2009 compared with 7,500 Ha in 2004/2005 During 16 days of Christmas in 2008 16,000 Ha lost, compared with 500 Ha in 2004 (3%)
  • 18.  
  • 20. Chile
  • 24. OTCA
  • 25. Model comparison PARASID vs. FORMA PARASID detections First detection in 2004 FORMA probabilities First detection in 2000
  • 26. PARASID vs DETER It seems Parasid model detects quite small and isolate events which Deter doesn’t detect. 2006 2004
  • 27. Next Steps Fully functioning web interface January 2010 Continental validation and calibration (January 2010) Global extent (2011) Additional models to identify type of change (drivers) (2011)
  • 28. Analysis of three images between the years 2000 and 2009. MATO-GROSSO – BRASIL LAT: - 10.1, LON: - 51.3 10/10/2000 LANDSAT 7 SLC ON 29/06/2009 LANDSAT 7 SLC OFF CLASSIFIED IMAGES IN ERDAS Forest Uncoverage Change 00-09 Unchanged CHANGE DETECTION IN ERDAS
  • 29. SAMPLING POINTS IN LATIN-AMERICA 1. Covering the whole Latin-America 2. Sampling of different land use type Tropical forest Andes Savanna Desert 3. Selection of areas with high risk of change Near to cities Near to road Near to rivers With crops already existing SELECTION CRITERIA
  • 30. Conclusions Near-real time global monitoring is possible PARASID now functioning for Latin America Providing first approximations of deforestation rates in over a decade for some parts of Latin America