SlideShare a Scribd company logo
The Climateprediction.net
programme, big data climate
modelling
Computational challenge of climate
science
Citizen science:
from climate
change through to
extreme weather
attribution
Our laboratory: the world’s largest climate
modelling facility
13 years, >25 sub projects, >600,000 volunteers, >130M model-years
Unlimited ensemble size: exploring
uncertainties in climate predictions
Results of the BBC Climate Change Experiment:
Rowlands et al, Nature Geosci., 2012
Berkley Open Infrastructure for
Network Computing (BOINC)
• Developed at UCB Space Science Laboratory by the SETI@home group
• Public-resource rather than grid computing
• Goals of BOINC
– Reduce the barriers of entry to public-resource computing
– Share resources among autonomous projects
– Support diverse applications
– Reward participation
• Offers tools for
– Creating, starting, stopping and querying projects
– Adding new applications, new platforms, …
– Creating workunits/tasks
– Monitoring server performance
Project ScientistCitizen Scientist
Web server
DB server
Up/download
serverClimate models
Experiment
Results
Communication
Papers
Volunteer Distributed Computing
Very large ensembles of simulations can be generated by using this framework.
The Climateprediction.net programme, big data climate modelling
weather@home regional climate models
High impact weather
events are typically rare
and unpredictable.
They also involve small
scales.
Resolution provided by
nested regional model.
Creating work for CPDN/W@H
• External collaborators fully supported by CPDN team
• Work is sent out in batches
– Allows easier management and attribution of data usage
– A batch contains an arbitrary number of workunits
– A batch is defined within an XML file containing details on all contained workunits, final data
destination etc
• Application distributed seperatly outside of workunit structure to participating
volunteer systems
• An individual work unit is;
– Namelist & ancillary files
• Results
– Results returned on a predetermined sub-schedule (e.g. Monthly within an 1 year model.
– ‘Start dump’ also returned to allow restart from this time point
• Chain together short WU to create longer running model which wouldn’t be possible to run individually.
• New: investigating publishing results using Nature Scientific Data to make
unique resources openly available
Models
• All models part of Hadley CM3 family (currently)
• Climateprediction.net
– HadCM3
• Weather@Home
– HadAM3P
• Global Atmosphere only model with prescribed SST
• Mainly used as driver of regional model but capable of individual
operation
– HadRM3P
• Regional Climate Model with flexible user defined region of interest
• MOSES1 in W@H1, MOSES2 + TRIFFID in W@H2
Super-ensemble projects linked to
atmospheric dynamics
1. Strat-trop coupling to extremes
2. Mid-latitude dynamics (DOCILE)
1. Dynamics of extremes
3. The Paris Agreement on Climate Change
(HAPPI)
1. Strat-trop coupling to extremes
Caption: NAM signal in reanalysis
(Mitchell et al, Jclim. 2013).
1. Similar evolution is seen in
intermediate GCM
(O’Callaghan et al, GRL, 2015)
2. Similar evolution in full GCMs
(Seviour et al, JGR, 2015)
What sample sizes are
needed to study
extremes?
• Central theme: To understand how different
stratospheric variability leads to extreme
events at the surface.
2. Mid-latitude extremes (DOCILE)
• Central theme: To increase reliability of
attribution statements by considering more
realistic dynamics.
• 2003 case study
(Mitchell et al, ERL, 2016)
2. Mid-latitude
extremes
(DOCILE)
Wave resonance at
mid-latitudes?
Normal: July 1980 Extreme: May 2013
(Huntingford et al, in prep)
Data source: PIK/Stefan Rahmstorf; Illustration: Focus 2013,Nr. 28/13
“Holding the increase in the global average
temperature to well below 2 °C above pre-
industrial levels and to pursue efforts to limit
the temperature increase to 1.5 °C above pre-
industrial levels…”
3. The Paris Agreement on Climate
Change (HAPPI)
3. The Paris Agreement on Climate
Change (HAPPI)
(Mitchell et al, NCC, 2016)
If you are keen to get involved;
Websites:
www.happimip.org
www.climateprediction.net
Climateprediction.net/Weather@Home
Collaborations
Current status of HAPPI data
Model name Historical
decade
(ems)
1.5 decade
(ems)
2 decade
(ems)
Validation (for bias
correction)
CAM4 testing testing testing
CAM5.1-1d testing testing testing
CAM5.1-0.25d 2 2 N/A 1995-2005 (1 em)
CanAM4
HadAM3P 1000 200 2 1985-2015 (50 ems)
HadGEM3 15 testing N/A 1960-2015 (15 ems)
MIROC 100 100 testing 1950-2015 (10 ems)
NorESM_happi 100 testing testing
ems = ensemble members
Red = still running additional ems
Blue = not expecting to run any more

More Related Content

PDF
3.3 Climate data and projections
PPT
PPTX
Hong Liu CanWEA presentation
PPTX
EcoTas13 BradEvans e-MAST
PDF
Computer Modeling Capabilities + Challenges for Earth System Predictions
PPTX
The Seismic Hazard Modeller’s Toolkit: An Open-Source Library for the Const...
PPTX
EcoTas13 BradEvans e-MAST framework
PDF
Climate change scenarios in context of the less than 2C global temperature ta...
3.3 Climate data and projections
Hong Liu CanWEA presentation
EcoTas13 BradEvans e-MAST
Computer Modeling Capabilities + Challenges for Earth System Predictions
The Seismic Hazard Modeller’s Toolkit: An Open-Source Library for the Const...
EcoTas13 BradEvans e-MAST framework
Climate change scenarios in context of the less than 2C global temperature ta...

What's hot (20)

PPT
IPCC climate models - Unit 2 Part 4
PPTX
How Big Data Can Help Fight Climate Change
PDF
Expert judgment-based fragility functions to better characterize physical vu...
PDF
Sources of climate data ma
PPT
Team Lesson Plan4.08
PPT
Future Trend of Mongolian Permafrost Distribution
PDF
Forbes co2 and temperature presentation for earth day at cua april 22 2015 ...
PDF
Day 3 ben harrison, met office, arrcc-carissa workshop
PPTX
July 29-130-Curtis Talbot
PDF
UROP Poster
PDF
Resilience of decarbonized energy systems to climate change - a research ques...
PDF
DSD-INT 2019 - Global Data Services and Analysis Frameworks - Twigt
PDF
Research + Private Sector Partnerships - Climate information for social and e...
PDF
Implementation of RS-EBVs in Habitat Modelling
PPTX
TERN eMAST : Observations and terrestrial ecosystem models : Terrestrial Ecos...
PPTX
EcoTas13 BradEvans e-MAST data
PPTX
C3.01: The Global Ocean Forecasting Initiative GODAE OceanView - Andreas Schi...
PDF
Buckles_research
PPTX
The GEO Carbon and GHG Initiative: Toward policy-relevant global carbon cycle...
IPCC climate models - Unit 2 Part 4
How Big Data Can Help Fight Climate Change
Expert judgment-based fragility functions to better characterize physical vu...
Sources of climate data ma
Team Lesson Plan4.08
Future Trend of Mongolian Permafrost Distribution
Forbes co2 and temperature presentation for earth day at cua april 22 2015 ...
Day 3 ben harrison, met office, arrcc-carissa workshop
July 29-130-Curtis Talbot
UROP Poster
Resilience of decarbonized energy systems to climate change - a research ques...
DSD-INT 2019 - Global Data Services and Analysis Frameworks - Twigt
Research + Private Sector Partnerships - Climate information for social and e...
Implementation of RS-EBVs in Habitat Modelling
TERN eMAST : Observations and terrestrial ecosystem models : Terrestrial Ecos...
EcoTas13 BradEvans e-MAST data
C3.01: The Global Ocean Forecasting Initiative GODAE OceanView - Andreas Schi...
Buckles_research
The GEO Carbon and GHG Initiative: Toward policy-relevant global carbon cycle...
Ad

Viewers also liked (17)

PPT
Francisco J. Doblas-Big Data y cambio climático
PPTX
Big data and its applications
PDF
How to Create 80% of a Big Data Pilot Project
PPT
Big data and climate change: Big words or big opportunity? Innovative approac...
PPTX
BigDataEurope - Big Data & Climate Change
PPT
Cliff Mass: Big Data and Weather Prediction - Seattle Interactive 2015
PDF
Big Data in Banking (Data Science Thailand Meetup #2)
PDF
Big Data for Big Sports
PPTX
Big data retail_industry_by VivekChutke
PPTX
The Big Data Revolution in Retail
PPTX
Why use big data tools to do web analytics? And how to do it using Snowplow a...
PDF
How Big Data Is Revolutionizing Sports?
PDF
Big Data Analytics for Banking, a Point of View
PPTX
Weather forecasting
PDF
Big Data in Retail - Examples in Action
PDF
Big Data Analytics in Energy & Utilities
PPTX
What is Big Data?
Francisco J. Doblas-Big Data y cambio climático
Big data and its applications
How to Create 80% of a Big Data Pilot Project
Big data and climate change: Big words or big opportunity? Innovative approac...
BigDataEurope - Big Data & Climate Change
Cliff Mass: Big Data and Weather Prediction - Seattle Interactive 2015
Big Data in Banking (Data Science Thailand Meetup #2)
Big Data for Big Sports
Big data retail_industry_by VivekChutke
The Big Data Revolution in Retail
Why use big data tools to do web analytics? And how to do it using Snowplow a...
How Big Data Is Revolutionizing Sports?
Big Data Analytics for Banking, a Point of View
Weather forecasting
Big Data in Retail - Examples in Action
Big Data Analytics in Energy & Utilities
What is Big Data?
Ad

Similar to The Climateprediction.net programme, big data climate modelling (20)

PDF
The Interactive Atlas
PPT
Climate Modelling for Ireland -Dr Ray McGrath, Met Eireann
PPTX
PDF
Intro and brief demo of the Interactive Atlas
PDF
Interactive Atlas
PPTX
Climate Change Impacts And Adaptation - Science Meets Policy - Dr Margaret De...
PDF
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
PDF
Colin Prentice SPEDDEXES 2014
PDF
Andreas Hense: Climate data for our future – acquired, analysed, archived
PDF
Climate_Modelling_Saurabh.pdf
PDF
Climate scenarios
PPTX
Joint techs keynote january
PPTX
Spatial Patterns of Climate Change in India
PDF
From Weather Dwarfs to Kilometre-Scale Earth System Simulations
PDF
Analyzing climate change risks_constructing climate scenarios
PPT
CCSP_CVC_12_02
PPTX
Where is global warming in relation to the long-term temperature goal?
PDF
Lesson 7 Basis for projection of climate change
PDF
Tim Palmer, University of Oxford - OECD Workshop on “Climate change, Assumpti...
PDF
Edwards climate data detectives - yale 2-2015
The Interactive Atlas
Climate Modelling for Ireland -Dr Ray McGrath, Met Eireann
Intro and brief demo of the Interactive Atlas
Interactive Atlas
Climate Change Impacts And Adaptation - Science Meets Policy - Dr Margaret De...
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Colin Prentice SPEDDEXES 2014
Andreas Hense: Climate data for our future – acquired, analysed, archived
Climate_Modelling_Saurabh.pdf
Climate scenarios
Joint techs keynote january
Spatial Patterns of Climate Change in India
From Weather Dwarfs to Kilometre-Scale Earth System Simulations
Analyzing climate change risks_constructing climate scenarios
CCSP_CVC_12_02
Where is global warming in relation to the long-term temperature goal?
Lesson 7 Basis for projection of climate change
Tim Palmer, University of Oxford - OECD Workshop on “Climate change, Assumpti...
Edwards climate data detectives - yale 2-2015

More from David Wallom (20)

PPTX
Quantifying the impact of green leasing on energy use in a retail portfolio: ...
PPTX
Trust and Cloud computing, removing the need for the consumer to trust their ...
PPTX
Trust and Cloud computing, removing the need for the consumer to trust their ...
PPTX
The University of Oxford e-Research Centre
PPTX
Introduction to Cloud Computing
PPTX
Benefits of big data analytics in Smart Metering, ADEPT, WICKED and beyond
PPTX
Smarter Energy, Infrastruture service, consumtion analytics and applications
PPTX
1990-2050 sulphur dioxide emissions data from ECLIPSE v5a for use in Met Offi...
PPTX
Supporting Research through "Desktop as a Service" models of e-infrastructure...
PPTX
e-Research & the art of linking Astrophysics to Deforestation
PPTX
Privacy and Security policies in the cloud
PPTX
Working with Earth Observation Data, INFORM and the IEA
PPTX
WICKED - Working with the data rich
PPTX
Mapping Priorities and Future Collaborations for you Projects
PPTX
CloudWatch: Mapping priorities and future collaboration for your project
PPTX
Trust and Cloud Computing, removing the need to trust your cloud provider
PPTX
CloudWatch2 Adoption Deep Dive
PPTX
e-infrastructural needs to support informatics
PPTX
Generating Insight from Big Data
PPTX
International Forest Risk Model
Quantifying the impact of green leasing on energy use in a retail portfolio: ...
Trust and Cloud computing, removing the need for the consumer to trust their ...
Trust and Cloud computing, removing the need for the consumer to trust their ...
The University of Oxford e-Research Centre
Introduction to Cloud Computing
Benefits of big data analytics in Smart Metering, ADEPT, WICKED and beyond
Smarter Energy, Infrastruture service, consumtion analytics and applications
1990-2050 sulphur dioxide emissions data from ECLIPSE v5a for use in Met Offi...
Supporting Research through "Desktop as a Service" models of e-infrastructure...
e-Research & the art of linking Astrophysics to Deforestation
Privacy and Security policies in the cloud
Working with Earth Observation Data, INFORM and the IEA
WICKED - Working with the data rich
Mapping Priorities and Future Collaborations for you Projects
CloudWatch: Mapping priorities and future collaboration for your project
Trust and Cloud Computing, removing the need to trust your cloud provider
CloudWatch2 Adoption Deep Dive
e-infrastructural needs to support informatics
Generating Insight from Big Data
International Forest Risk Model

Recently uploaded (20)

PPTX
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
PPT
protein biochemistry.ppt for university classes
PPT
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
PPTX
SCIENCE10 Q1 5 WK8 Evidence Supporting Plate Movement.pptx
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
PPTX
7. General Toxicologyfor clinical phrmacy.pptx
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PPTX
Classification Systems_TAXONOMY_SCIENCE8.pptx
PDF
SEHH2274 Organic Chemistry Notes 1 Structure and Bonding.pdf
PDF
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
PDF
An interstellar mission to test astrophysical black holes
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PPTX
Introduction to Fisheries Biotechnology_Lesson 1.pptx
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PPTX
famous lake in india and its disturibution and importance
PPTX
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
PPTX
neck nodes and dissection types and lymph nodes levels
PPTX
ECG_Course_Presentation د.محمد صقران ppt
PDF
The scientific heritage No 166 (166) (2025)
PPTX
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
cpcsea ppt.pptxssssssssssssssjjdjdndndddd
protein biochemistry.ppt for university classes
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
SCIENCE10 Q1 5 WK8 Evidence Supporting Plate Movement.pptx
AlphaEarth Foundations and the Satellite Embedding dataset
7. General Toxicologyfor clinical phrmacy.pptx
Biophysics 2.pdffffffffffffffffffffffffff
Classification Systems_TAXONOMY_SCIENCE8.pptx
SEHH2274 Organic Chemistry Notes 1 Structure and Bonding.pdf
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
An interstellar mission to test astrophysical black holes
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
Introduction to Fisheries Biotechnology_Lesson 1.pptx
bbec55_b34400a7914c42429908233dbd381773.pdf
famous lake in india and its disturibution and importance
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
neck nodes and dissection types and lymph nodes levels
ECG_Course_Presentation د.محمد صقران ppt
The scientific heritage No 166 (166) (2025)
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...

The Climateprediction.net programme, big data climate modelling

  • 2. Computational challenge of climate science
  • 3. Citizen science: from climate change through to extreme weather attribution
  • 4. Our laboratory: the world’s largest climate modelling facility 13 years, >25 sub projects, >600,000 volunteers, >130M model-years
  • 5. Unlimited ensemble size: exploring uncertainties in climate predictions Results of the BBC Climate Change Experiment: Rowlands et al, Nature Geosci., 2012
  • 6. Berkley Open Infrastructure for Network Computing (BOINC) • Developed at UCB Space Science Laboratory by the SETI@home group • Public-resource rather than grid computing • Goals of BOINC – Reduce the barriers of entry to public-resource computing – Share resources among autonomous projects – Support diverse applications – Reward participation • Offers tools for – Creating, starting, stopping and querying projects – Adding new applications, new platforms, … – Creating workunits/tasks – Monitoring server performance
  • 7. Project ScientistCitizen Scientist Web server DB server Up/download serverClimate models Experiment Results Communication Papers Volunteer Distributed Computing Very large ensembles of simulations can be generated by using this framework.
  • 9. weather@home regional climate models High impact weather events are typically rare and unpredictable. They also involve small scales. Resolution provided by nested regional model.
  • 10. Creating work for CPDN/W@H • External collaborators fully supported by CPDN team • Work is sent out in batches – Allows easier management and attribution of data usage – A batch contains an arbitrary number of workunits – A batch is defined within an XML file containing details on all contained workunits, final data destination etc • Application distributed seperatly outside of workunit structure to participating volunteer systems • An individual work unit is; – Namelist & ancillary files • Results – Results returned on a predetermined sub-schedule (e.g. Monthly within an 1 year model. – ‘Start dump’ also returned to allow restart from this time point • Chain together short WU to create longer running model which wouldn’t be possible to run individually. • New: investigating publishing results using Nature Scientific Data to make unique resources openly available
  • 11. Models • All models part of Hadley CM3 family (currently) • Climateprediction.net – HadCM3 • Weather@Home – HadAM3P • Global Atmosphere only model with prescribed SST • Mainly used as driver of regional model but capable of individual operation – HadRM3P • Regional Climate Model with flexible user defined region of interest • MOSES1 in W@H1, MOSES2 + TRIFFID in W@H2
  • 12. Super-ensemble projects linked to atmospheric dynamics 1. Strat-trop coupling to extremes 2. Mid-latitude dynamics (DOCILE) 1. Dynamics of extremes 3. The Paris Agreement on Climate Change (HAPPI)
  • 13. 1. Strat-trop coupling to extremes Caption: NAM signal in reanalysis (Mitchell et al, Jclim. 2013). 1. Similar evolution is seen in intermediate GCM (O’Callaghan et al, GRL, 2015) 2. Similar evolution in full GCMs (Seviour et al, JGR, 2015) What sample sizes are needed to study extremes? • Central theme: To understand how different stratospheric variability leads to extreme events at the surface.
  • 14. 2. Mid-latitude extremes (DOCILE) • Central theme: To increase reliability of attribution statements by considering more realistic dynamics. • 2003 case study (Mitchell et al, ERL, 2016)
  • 15. 2. Mid-latitude extremes (DOCILE) Wave resonance at mid-latitudes? Normal: July 1980 Extreme: May 2013 (Huntingford et al, in prep) Data source: PIK/Stefan Rahmstorf; Illustration: Focus 2013,Nr. 28/13
  • 16. “Holding the increase in the global average temperature to well below 2 °C above pre- industrial levels and to pursue efforts to limit the temperature increase to 1.5 °C above pre- industrial levels…” 3. The Paris Agreement on Climate Change (HAPPI)
  • 17. 3. The Paris Agreement on Climate Change (HAPPI) (Mitchell et al, NCC, 2016)
  • 18. If you are keen to get involved; Websites: www.happimip.org www.climateprediction.net
  • 20. Current status of HAPPI data Model name Historical decade (ems) 1.5 decade (ems) 2 decade (ems) Validation (for bias correction) CAM4 testing testing testing CAM5.1-1d testing testing testing CAM5.1-0.25d 2 2 N/A 1995-2005 (1 em) CanAM4 HadAM3P 1000 200 2 1985-2015 (50 ems) HadGEM3 15 testing N/A 1960-2015 (15 ems) MIROC 100 100 testing 1950-2015 (10 ems) NorESM_happi 100 testing testing ems = ensemble members Red = still running additional ems Blue = not expecting to run any more

Editor's Notes

  • #7: Combines the resources of personal computers and game consoles belonging to the general public to perform scientific computations started in 1999 and still runs today Currently supporting ~40 projects in 7 areas
  • #10: 12 regions [3@ 25km, 9 @ 50km resolution] Flooding – UK, central Europe Drought California Heatwave – Australia Health – UK Biosphere – Bark Beetle forest destruction – USA/Canada
  • #11: Largest ever single batch had ~196k members for schaller et al Of recent submissions ~ 43k for NERC MaRIUS project
  • #12: HadCM3 Atmosphere: 2.5 x 3.75 degrees lat-lon resolution, 19 vertical levels (known as N48; comparable resolution to ~T42)., 30 mins timestep for dynamics, 3 hours for radiative transfer. Ocean: 1.25 x 1.25 degrees lat-lon resolution, 20 vertical levels, 1 hour timestep. Sulphur and carbon cycles, dynamic vegetation etc. are optional. HadAM3P N96 resolution (1.25 x 1.875 degrees resolution, 19 levels) with 15 minutes timestep for dynamics and improved physics. HadRM3P Either 50km or 25km horizontal resolution
  • #13: Common issue is sample sizes