SlideShare a Scribd company logo
Detecting Solar Farms
with Deep Learning
Jason Brown, Data Scientist
FOSS4GNA 2019, April 16
astraea.earth/careers
Project Motivation
• Fast growth in renewable energy industry
including photovoltaic (PV)
• More investment needed for 2°C Paris
target: $130B by 2030
• Solar farm location, capacity, and date
are not reliably recorded
• EO data archives contain verifiable,
spatially-correct, timestamped images of
PV
• Can we extract desired info from imagery
with deep learning?
2
Source: BloombergNEF
Take Home Message
3
August 2018
Yes we can! Our deep learning
solution can extract verifiable,
spatially-correct, timestamped
info about large PV arrays
from archives of Earth-
observation data.
Remote Sensing Imagery
Sentinel 2
– Free, publicly available
• Archive begins 2015
– Global coverage
– 5 day revisit
– Multispectral imagery
• 13 channels in visible, near
infrared (IR) & short wave IR
– Spatial resolution: 10m & 20m
– Top of atmosphere (L1C)
4
Sentinel-2 (10m)
Computer Vision Tasks
Image credit ataspinar.com
5
Annotating Imagery
2600 polygons
6
Creating Training Examples
• Lots of effort to create
images and masks from
annotated imagery
• Many small decisions can
impact model
performance
• 5,000 positive examples,
15,000 or more negative
Positive: Negative:
7
Deep Learning Ensemble
8
• Classification
– Inception v3 architecture
– Tune for high recall, with
minimum precision
• Segmentation
– U-net architecture
– Tune for F1 score (balance of
precision and recall)
positive predictions
𝐹1 =
2 𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒
2 𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 + 𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 + 𝐹𝑎𝑙𝑠𝑒𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒
Model Performance
Array ≤ 0.1 km2 Array > 0.1 m2
Recall 0.799 0.892
F1 score 0.822 0.908
9
0.1 km2 equivalent to 316 m square or 100 pixels
Model Performance
Array ≤ 0.1 km2 Array > 0.1 m2
Recall 0.799 0.892
F1 score 0.822 0.908
9
0.1 km2 equivalent to 316 m square or 100 pixels
Model Inference
• We conducted model
inference on conterminous
USA & China
• Approx 4GB per 120 km2
• We processed approx 13TB
– Access and prepare imagery
– Infer on model pipeline
– Process and write outputs
• Fast enough to do as scenes
are published
10
Demo
11
Roll Credits
12
Collaborators
Dr. Kimberly Scott, VP of Data Science
Courtney Whalen, Data Scientist
Eric Culbertson, Data Scientist
Earth on AWS
QGIS
SentinelHub
Folium
Dash
Keras
Scikit-learn
GeoPandas
rasterio
Open Source & Open Data Used
astraea.earth/careers

More Related Content

PDF
15 sengupta next_generation_satellite_modelling
PDF
Global Grid of Grapes
PDF
Co gps energy efficient gps sensing with cloud offloading
PDF
Q4 2016 GeoTrellis Presentation
PPTX
Internship
PPTX
NASA's Movement Towards Cloud Computing
PDF
Deep Learning in Deep Space
15 sengupta next_generation_satellite_modelling
Global Grid of Grapes
Co gps energy efficient gps sensing with cloud offloading
Q4 2016 GeoTrellis Presentation
Internship
NASA's Movement Towards Cloud Computing
Deep Learning in Deep Space

What's hot (20)

PPTX
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
PDF
Adaptive Methane Detection
PDF
RAYMAN: Interoperability use of meteorological observations Como-Italy 2010
PPTX
Classroom occupancy project
PDF
11 schroedter homscheidt_satellite_and_camera
PDF
Nasa HPC in the Cloud
PDF
Accelerating Science with Cloud Technologies in the ABoVE Science Cloud
PDF
FOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark
PPTX
Real-Time Analysis of Streaming Synchotron Data: SCinet SC19 Technology Chall...
PDF
Analyzing Larger RasterData in a Jupyter Notebook with GeoPySpark on AWS - FO...
PPTX
Globsnow (remote sensing swe product)
PDF
2014 PV Performance Modeling Workshop: Satellite Irradiance Models and Datase...
PPTX
finalDraftPoster
PDF
Autoencoding RNN for inference on unevenly sampled time-series data
PDF
Global illumination for PIXAR movie production
PPTX
a journey in making sense of big data (part 1: Big Bang)
PDF
1 1 kankiewicz_sandia_epri_pv_perf_wrk_shp_presentation_2016
PPT
Basal area from_photos___is_it_possible?
PDF
AI Research and OpenPOWER at the NASA Frontier Development Lab
Creating A Multi-wavelength Galactic Plane Atlas With Amazon Web Services
Adaptive Methane Detection
RAYMAN: Interoperability use of meteorological observations Como-Italy 2010
Classroom occupancy project
11 schroedter homscheidt_satellite_and_camera
Nasa HPC in the Cloud
Accelerating Science with Cloud Technologies in the ABoVE Science Cloud
FOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark
Real-Time Analysis of Streaming Synchotron Data: SCinet SC19 Technology Chall...
Analyzing Larger RasterData in a Jupyter Notebook with GeoPySpark on AWS - FO...
Globsnow (remote sensing swe product)
2014 PV Performance Modeling Workshop: Satellite Irradiance Models and Datase...
finalDraftPoster
Autoencoding RNN for inference on unevenly sampled time-series data
Global illumination for PIXAR movie production
a journey in making sense of big data (part 1: Big Bang)
1 1 kankiewicz_sandia_epri_pv_perf_wrk_shp_presentation_2016
Basal area from_photos___is_it_possible?
AI Research and OpenPOWER at the NASA Frontier Development Lab
Ad

Similar to Detecting solar farms with deep learning (20)

PDF
Detecting Solar Farms Using Deep Learning
PDF
Burst data retrieval after 50k GPU Cloud run
PDF
Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...
PPTX
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
PDF
Near Exascale Computing in the Cloud
PPTX
Scalable Deep Learning in ExtremeEarth-phiweek19
PDF
CLIM Program: Remote Sensing Workshop, Optimization Methods in Remote Sensing...
PDF
NASA Advanced Computing Environment for Science & Engineering
PDF
Bring Satellite and Drone Imagery into your Data Science Workflows
PPT
Data Intensive Applications at UCSD: Driving a Campus Research Cyberinfrastru...
PDF
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
PPTX
Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...
PPTX
From pixels to point clouds - Using drones,game engines and virtual reality t...
PDF
CLIM: Transition Workshop - Optimization Methods in Remote Sensing - Jessica...
PDF
Efficient data reduction and analysis of DECam images using multicore archite...
PPTX
Extend Your Journey: Considering Signal Strength and Fluctuation in Location-...
PPTX
Extend Your Journey: Introducing Signal Strength into Location-based Applicat...
PPTX
 Gigapixel resolution imaging for near-remote sensing and phenomics
PDF
Garuda Robotics x DataScience SG Meetup (Sep 2015)
PPTX
stuart_2015_v2.0
Detecting Solar Farms Using Deep Learning
Burst data retrieval after 50k GPU Cloud run
Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
Near Exascale Computing in the Cloud
Scalable Deep Learning in ExtremeEarth-phiweek19
CLIM Program: Remote Sensing Workshop, Optimization Methods in Remote Sensing...
NASA Advanced Computing Environment for Science & Engineering
Bring Satellite and Drone Imagery into your Data Science Workflows
Data Intensive Applications at UCSD: Driving a Campus Research Cyberinfrastru...
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...
From pixels to point clouds - Using drones,game engines and virtual reality t...
CLIM: Transition Workshop - Optimization Methods in Remote Sensing - Jessica...
Efficient data reduction and analysis of DECam images using multicore archite...
Extend Your Journey: Considering Signal Strength and Fluctuation in Location-...
Extend Your Journey: Introducing Signal Strength into Location-based Applicat...
 Gigapixel resolution imaging for near-remote sensing and phenomics
Garuda Robotics x DataScience SG Meetup (Sep 2015)
stuart_2015_v2.0
Ad

Recently uploaded (20)

PDF
Introduction to Business Data Analytics.
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
Global journeys: estimating international migration
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PPTX
STUDY DESIGN details- Lt Col Maksud (21).pptx
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PPTX
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
PDF
Mega Projects Data Mega Projects Data
PPTX
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
PPTX
Database Infoormation System (DBIS).pptx
PDF
Lecture1 pattern recognition............
PPTX
Business Ppt On Nestle.pptx huunnnhhgfvu
PPTX
Moving the Public Sector (Government) to a Digital Adoption
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PDF
Fluorescence-microscope_Botany_detailed content
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PDF
Galatica Smart Energy Infrastructure Startup Pitch Deck
Introduction to Business Data Analytics.
IB Computer Science - Internal Assessment.pptx
Global journeys: estimating international migration
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
STUDY DESIGN details- Lt Col Maksud (21).pptx
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
MODULE 8 - DISASTER risk PREPAREDNESS.pptx
Mega Projects Data Mega Projects Data
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
Database Infoormation System (DBIS).pptx
Lecture1 pattern recognition............
Business Ppt On Nestle.pptx huunnnhhgfvu
Moving the Public Sector (Government) to a Digital Adoption
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
Fluorescence-microscope_Botany_detailed content
oil_refinery_comprehensive_20250804084928 (1).pptx
Galatica Smart Energy Infrastructure Startup Pitch Deck

Detecting solar farms with deep learning

  • 1. Detecting Solar Farms with Deep Learning Jason Brown, Data Scientist FOSS4GNA 2019, April 16 astraea.earth/careers
  • 2. Project Motivation • Fast growth in renewable energy industry including photovoltaic (PV) • More investment needed for 2°C Paris target: $130B by 2030 • Solar farm location, capacity, and date are not reliably recorded • EO data archives contain verifiable, spatially-correct, timestamped images of PV • Can we extract desired info from imagery with deep learning? 2 Source: BloombergNEF
  • 3. Take Home Message 3 August 2018 Yes we can! Our deep learning solution can extract verifiable, spatially-correct, timestamped info about large PV arrays from archives of Earth- observation data.
  • 4. Remote Sensing Imagery Sentinel 2 – Free, publicly available • Archive begins 2015 – Global coverage – 5 day revisit – Multispectral imagery • 13 channels in visible, near infrared (IR) & short wave IR – Spatial resolution: 10m & 20m – Top of atmosphere (L1C) 4 Sentinel-2 (10m)
  • 5. Computer Vision Tasks Image credit ataspinar.com 5
  • 7. Creating Training Examples • Lots of effort to create images and masks from annotated imagery • Many small decisions can impact model performance • 5,000 positive examples, 15,000 or more negative Positive: Negative: 7
  • 8. Deep Learning Ensemble 8 • Classification – Inception v3 architecture – Tune for high recall, with minimum precision • Segmentation – U-net architecture – Tune for F1 score (balance of precision and recall) positive predictions 𝐹1 = 2 𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 2 𝑇𝑟𝑢𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 + 𝐹𝑎𝑙𝑠𝑒 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 + 𝐹𝑎𝑙𝑠𝑒𝑁𝑒𝑔𝑎𝑡𝑖𝑣𝑒
  • 9. Model Performance Array ≤ 0.1 km2 Array > 0.1 m2 Recall 0.799 0.892 F1 score 0.822 0.908 9 0.1 km2 equivalent to 316 m square or 100 pixels Model Performance Array ≤ 0.1 km2 Array > 0.1 m2 Recall 0.799 0.892 F1 score 0.822 0.908 9 0.1 km2 equivalent to 316 m square or 100 pixels
  • 10. Model Inference • We conducted model inference on conterminous USA & China • Approx 4GB per 120 km2 • We processed approx 13TB – Access and prepare imagery – Infer on model pipeline – Process and write outputs • Fast enough to do as scenes are published 10
  • 12. Roll Credits 12 Collaborators Dr. Kimberly Scott, VP of Data Science Courtney Whalen, Data Scientist Eric Culbertson, Data Scientist Earth on AWS QGIS SentinelHub Folium Dash Keras Scikit-learn GeoPandas rasterio Open Source & Open Data Used astraea.earth/careers