SlideShare a Scribd company logo
The	
  LHC	
  Grid	
  
High Performance Computing in
High Energy Particle Physics
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   1	
  
$	
  whoami	
  
•  Lukasz	
  Kreczko	
  –	
  ParGcle	
  Physicist	
  
•  Graduated	
  in	
  Physics	
  from	
  University	
  of	
  
Hamburg	
  in	
  2009	
  
•  2009	
  –	
  2013	
  PhD	
  in	
  ParGcle	
  Physics	
  at	
  the	
  
University	
  of	
  Bristol	
  
•  Currently	
  CompuGng	
  Research	
  Assistant	
  at	
  the	
  
University	
  of	
  Bristol	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   2	
  
The	
  experiment:	
  a	
  big	
  digital	
  camera	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   3	
  
The	
  experiment:	
  a	
  big	
  digital	
  camera	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   4	
  
40	
  million	
  “pictures”	
  
per	
  second	
  
Each	
  “picture”	
  around	
  
1	
  MB!	
  
The	
  data:	
  a	
  structured	
  mess	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   5	
  
The	
  data:	
  a	
  much	
  nicer	
  picture	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   6	
  
Muon:

pT
=
71.5
GeV/c

η
=
‐0.82

Missing
ET:

22.3
GeV

Jet:

pT
=
89.0
GeV/c

η
=
2.14

Jet:

pT
=
85.3
GeV/c

η
=
2.02

Jet:

pT
=
90.5
GeV/c

η
=
‐1.40

Run:









163583

Event:
 
26579562

Jet:

pT
=
84.1
GeV/c

η
=
‐2.24

m(F)=1.2
TeV/c2

_
The	
  goal:	
  extend	
  our	
  knowledge	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   7	
  
Muon:

pT
=
71.5
GeV/c

η
=
‐0.82

Missing
ET:

22.3
GeV

Jet:

pT
=
89.0
GeV/c

η
=
2.14

Jet:

pT
=
85.3
GeV/c

η
=
2.02

Jet:

pT
=
90.5
GeV/c

η
=
‐1.40

Run:









163583

Event:
 
26579562

Jet:

pT
=
84.1
GeV/c

η
=
‐2.24

m(F)=1.2
TeV/c2

_
Billions	
  of	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  +	
  simulaGon	
  
	
  
(GeV)γγm
110 120 130 140 150
S/(S+B)WeightedEvents/1.5GeV
0
500
1000
1500
Data
S+B Fit
B Fit Component
σ1±
σ2±
-1
= 8 TeV, L = 5.3 fbs-1
= 7 TeV, L = 5.1 fbsCMS
(GeV)γγm
120 130
Events/1.5GeV
1000
1500
Unweighted
The	
  goal:	
  extend	
  our	
  knowledge	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   8	
  
Muon:

pT
=
71.5
GeV/c

η
=
‐0.82

Missing
ET:

22.3
GeV

Jet:

pT
=
89.0
GeV/c

η
=
2.14

Jet:

pT
=
85.3
GeV/c

η
=
2.02

Jet:

pT
=
90.5
GeV/c

η
=
‐1.40

Run:









163583

Event:
 
26579562

Jet:

pT
=
84.1
GeV/c

η
=
‐2.24

m(F)=1.2
TeV/c2

_
Billions	
  of	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  +	
  simulaGon	
  
	
  
(GeV)γγm
110 120 130 140 150
S/(S+B)WeightedEvents/1.5GeV
0
500
1000
1500
Data
S+B Fit
B Fit Component
σ1±
σ2±
-1
= 8 TeV, L = 5.3 fbs-1
= 7 TeV, L = 5.1 fbsCMS
(GeV)γγm
120 130
Events/1.5GeV
1000
1500
Unweighted
That’s	
  the	
  famous	
  Higgs	
  boson	
  
Analysing	
  all	
  data	
  
•  CMS	
  records	
  10	
  000	
  Terabytes	
  of	
  data	
  every	
  
year	
  (around	
  70	
  years	
  of	
  full	
  HD	
  movies)	
  
•  +	
  same	
  amount	
  of	
  simulaGon	
  
•  To	
  analyse	
  this	
  on	
  a	
  single	
  computer	
  would	
  
take	
   	
   	
   	
  64,000	
  years!	
  
9	
  
Analysing	
  all	
  data	
  
•  CMS	
  records	
  10	
  000	
  Terabytes	
  of	
  data	
  every	
  
year	
  (around	
  70	
  years	
  of	
  full	
  HD	
  movies)	
  
•  +	
  same	
  amount	
  of	
  simulaGon	
  
•  To	
  analyse	
  this	
  on	
  a	
  single	
  computer	
  would	
  
take	
   	
   	
   	
  64,000	
  years!	
  
10	
  
The	
  compuGng	
  model:	
  the	
  decision	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   11	
  
The	
  compuGng	
  model	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   12	
  
The	
  compuGng	
  model	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   13	
  
Bristol	
  is	
  one	
  
of	
  the	
  T2	
  
centres	
  
The	
  computer	
  centres	
  
All	
  over	
  the	
  world	
  
All	
  over	
  the	
  world	
  
On	
  a	
  normal	
  day,	
  the	
  grid	
  provides	
  100,000	
  CPU	
  days	
  execuGng	
  	
  
1	
  million	
  jobs	
  
PhEDEx:	
  A	
  Bristol	
  invenGon	
  
•  short	
  for	
  “Physics	
  Experiment	
  Data	
  Export”	
  
•  Sodware	
  for	
  data	
  placement	
  and	
  the	
  file	
  
transfer	
  system	
  
•  Development	
  started	
  in	
  Bristol	
  
•  One	
  of	
  the	
  main	
  developers	
  (now	
  at	
  Cloudant)	
  
is	
  giving	
  a	
  talk	
  later	
  today	
  “Your	
  Database	
  to	
  
the	
  Cloud,	
  an	
  Intro	
  to	
  Cloudant	
  NoSQL”	
  	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   17	
  
PhEDEx:	
  The	
  components	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   18	
  
Transfer	
  agent	
  
Transfer	
  
management	
  
database	
  
Management	
  agent	
  
Tools	
  to	
  manage	
  
transfers	
  
Local	
  agents	
  
Web	
  monitoring	
  
PhEDEx:	
  data	
  monitoring	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   19	
  
150	
  PB	
  
70	
  PB	
  
hjp://www.flickr.com/photos/paulrossman/6555010435/sizes/l/in/photostream/	
  
Current	
  and	
  future	
  topics	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   20	
  
Things	
  changed:	
  
Network	
  is	
  genng	
  cheaper	
  as	
  well	
  
Current	
  and	
  future	
  topics	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   21	
  
Things	
  changed:	
  
Network	
  is	
  genng	
  cheaper	
  as	
  well	
  
We	
  are	
  moving	
  into	
  the	
  
cloud	
  
Current	
  and	
  future	
  topics	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   22	
  
Things	
  changed:	
  
Network	
  is	
  genng	
  cheaper	
  as	
  well	
  
We	
  are	
  moving	
  into	
  the	
  
cloud	
  
Any	
  data	
  anywhere!	
  
Other	
  current	
  and	
  future	
  topics	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   23	
  
Protocol	
  
buffers	
   CouchDB	
  
Hadoop	
   Provisioning	
  of	
  
compuGng	
  
Summary	
  &	
  Outlook	
  
•  The	
  LHC	
  grid	
  is	
  a	
  world-­‐wide	
  distributed	
  
compuGng	
  network	
  that	
  makes	
  discoveries	
  
possible	
  
•  The	
  grid	
  is	
  changing	
  to	
  adopt	
  to	
  current	
  
technologies	
  
•  In	
  two	
  years	
  Gme	
  the	
  LHC	
  will	
  increase	
  its	
  
energy	
  to	
  14	
  TeV	
  –	
  more	
  data,	
  more	
  
discoveries	
  to	
  come!	
  
Saturday,	
  1	
  June	
  13	
   Lukasz	
  Kreczko	
  -­‐	
  Bristol	
  IT	
  MegaMeet	
   24	
  

More Related Content

PDF
No one listens to my podcast (a kibana story)
PDF
PDF
The Inner Secrets of Compilers
PDF
Dynamic Data Center concept
PPTX
The Pacific Research Platform: Leading Up to the National Research Platform
PPTX
Toward a National Research Platform
PPT
The OptIPlanet Collaboratory Supporting Researchers Worldwide
PPT
The OptIPlanet Collaboratory Supporting Researchers Worldwide
No one listens to my podcast (a kibana story)
The Inner Secrets of Compilers
Dynamic Data Center concept
The Pacific Research Platform: Leading Up to the National Research Platform
Toward a National Research Platform
The OptIPlanet Collaboratory Supporting Researchers Worldwide
The OptIPlanet Collaboratory Supporting Researchers Worldwide

Similar to The LCH Grid - High Performance Computing in High Energy Particle Physics (20)

PDF
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
PPT
Terabit Applications: What Are They, What is Needed to Enable Them?
PPTX
Benchmarking
PDF
Messing with JavaScript and the DOM to measure network characteristics
PDF
Burst data retrieval after 50k GPU Cloud run
PPT
Set My Data Free: High-Performance CI for Data-Intensive Research
PPTX
Better Information Faster: Programming the Continuum
PPT
Coupling Australia’s Researchers to the Global Innovation Economy
PPT
S B Goyal
PDF
Near Exascale Computing in the Cloud
PPT
Cloud Computing,雲端運算-中研院網格計畫主持人林誠謙
PPT
Abundant Bandwidth and how it affects us
PPTX
Workstreams intro.pptx
PPTX
PRP, NRP, GRP & the Path Forward
PDF
Kafka Summit SF 2017 - Accelerating Particles to Explore the Mysteries of the...
PPTX
Creating a Science-Driven Big Data Superhighway
PPT
Agents In An Exponential World Foster
PDF
E Science As A Lens On The World Lazowska
PDF
E Science As A Lens On The World Lazowska
PDF
Totten presidio presentation feb 20 2015 pdf
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
Terabit Applications: What Are They, What is Needed to Enable Them?
Benchmarking
Messing with JavaScript and the DOM to measure network characteristics
Burst data retrieval after 50k GPU Cloud run
Set My Data Free: High-Performance CI for Data-Intensive Research
Better Information Faster: Programming the Continuum
Coupling Australia’s Researchers to the Global Innovation Economy
S B Goyal
Near Exascale Computing in the Cloud
Cloud Computing,雲端運算-中研院網格計畫主持人林誠謙
Abundant Bandwidth and how it affects us
Workstreams intro.pptx
PRP, NRP, GRP & the Path Forward
Kafka Summit SF 2017 - Accelerating Particles to Explore the Mysteries of the...
Creating a Science-Driven Big Data Superhighway
Agents In An Exponential World Foster
E Science As A Lens On The World Lazowska
E Science As A Lens On The World Lazowska
Totten presidio presentation feb 20 2015 pdf
Ad

Recently uploaded (20)

PPTX
Cloud computing and distributed systems.
PDF
Empathic Computing: Creating Shared Understanding
PPTX
A Presentation on Artificial Intelligence
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
MYSQL Presentation for SQL database connectivity
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
Machine Learning_overview_presentation.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Encapsulation_ Review paper, used for researhc scholars
PPTX
sap open course for s4hana steps from ECC to s4
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
Big Data Technologies - Introduction.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Chapter 3 Spatial Domain Image Processing.pdf
Cloud computing and distributed systems.
Empathic Computing: Creating Shared Understanding
A Presentation on Artificial Intelligence
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
A comparative analysis of optical character recognition models for extracting...
Mobile App Security Testing_ A Comprehensive Guide.pdf
20250228 LYD VKU AI Blended-Learning.pptx
Network Security Unit 5.pdf for BCA BBA.
MYSQL Presentation for SQL database connectivity
The Rise and Fall of 3GPP – Time for a Sabbatical?
Machine Learning_overview_presentation.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Encapsulation_ Review paper, used for researhc scholars
sap open course for s4hana steps from ECC to s4
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Big Data Technologies - Introduction.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
NewMind AI Weekly Chronicles - August'25-Week II
Unlocking AI with Model Context Protocol (MCP)
Chapter 3 Spatial Domain Image Processing.pdf
Ad

The LCH Grid - High Performance Computing in High Energy Particle Physics

  • 1. The  LHC  Grid   High Performance Computing in High Energy Particle Physics Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   1  
  • 2. $  whoami   •  Lukasz  Kreczko  –  ParGcle  Physicist   •  Graduated  in  Physics  from  University  of   Hamburg  in  2009   •  2009  –  2013  PhD  in  ParGcle  Physics  at  the   University  of  Bristol   •  Currently  CompuGng  Research  Assistant  at  the   University  of  Bristol   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   2  
  • 3. The  experiment:  a  big  digital  camera   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   3  
  • 4. The  experiment:  a  big  digital  camera   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   4   40  million  “pictures”   per  second   Each  “picture”  around   1  MB!  
  • 5. The  data:  a  structured  mess   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   5  
  • 6. The  data:  a  much  nicer  picture   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   6   Muon:
 pT
=
71.5
GeV/c
 η
=
‐0.82
 Missing
ET:
 22.3
GeV
 Jet:
 pT
=
89.0
GeV/c
 η
=
2.14
 Jet:
 pT
=
85.3
GeV/c
 η
=
2.02
 Jet:
 pT
=
90.5
GeV/c
 η
=
‐1.40
 Run:









163583
 Event:
 
26579562
 Jet:
 pT
=
84.1
GeV/c
 η
=
‐2.24
 m(F)=1.2
TeV/c2
 _
  • 7. The  goal:  extend  our  knowledge   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   7   Muon:
 pT
=
71.5
GeV/c
 η
=
‐0.82
 Missing
ET:
 22.3
GeV
 Jet:
 pT
=
89.0
GeV/c
 η
=
2.14
 Jet:
 pT
=
85.3
GeV/c
 η
=
2.02
 Jet:
 pT
=
90.5
GeV/c
 η
=
‐1.40
 Run:









163583
 Event:
 
26579562
 Jet:
 pT
=
84.1
GeV/c
 η
=
‐2.24
 m(F)=1.2
TeV/c2
 _ Billions  of                        +  simulaGon     (GeV)γγm 110 120 130 140 150 S/(S+B)WeightedEvents/1.5GeV 0 500 1000 1500 Data S+B Fit B Fit Component σ1± σ2± -1 = 8 TeV, L = 5.3 fbs-1 = 7 TeV, L = 5.1 fbsCMS (GeV)γγm 120 130 Events/1.5GeV 1000 1500 Unweighted
  • 8. The  goal:  extend  our  knowledge   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   8   Muon:
 pT
=
71.5
GeV/c
 η
=
‐0.82
 Missing
ET:
 22.3
GeV
 Jet:
 pT
=
89.0
GeV/c
 η
=
2.14
 Jet:
 pT
=
85.3
GeV/c
 η
=
2.02
 Jet:
 pT
=
90.5
GeV/c
 η
=
‐1.40
 Run:









163583
 Event:
 
26579562
 Jet:
 pT
=
84.1
GeV/c
 η
=
‐2.24
 m(F)=1.2
TeV/c2
 _ Billions  of                        +  simulaGon     (GeV)γγm 110 120 130 140 150 S/(S+B)WeightedEvents/1.5GeV 0 500 1000 1500 Data S+B Fit B Fit Component σ1± σ2± -1 = 8 TeV, L = 5.3 fbs-1 = 7 TeV, L = 5.1 fbsCMS (GeV)γγm 120 130 Events/1.5GeV 1000 1500 Unweighted That’s  the  famous  Higgs  boson  
  • 9. Analysing  all  data   •  CMS  records  10  000  Terabytes  of  data  every   year  (around  70  years  of  full  HD  movies)   •  +  same  amount  of  simulaGon   •  To  analyse  this  on  a  single  computer  would   take        64,000  years!   9  
  • 10. Analysing  all  data   •  CMS  records  10  000  Terabytes  of  data  every   year  (around  70  years  of  full  HD  movies)   •  +  same  amount  of  simulaGon   •  To  analyse  this  on  a  single  computer  would   take        64,000  years!   10  
  • 11. The  compuGng  model:  the  decision   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   11  
  • 12. The  compuGng  model   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   12  
  • 13. The  compuGng  model   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   13   Bristol  is  one   of  the  T2   centres  
  • 15. All  over  the  world  
  • 16. All  over  the  world   On  a  normal  day,  the  grid  provides  100,000  CPU  days  execuGng     1  million  jobs  
  • 17. PhEDEx:  A  Bristol  invenGon   •  short  for  “Physics  Experiment  Data  Export”   •  Sodware  for  data  placement  and  the  file   transfer  system   •  Development  started  in  Bristol   •  One  of  the  main  developers  (now  at  Cloudant)   is  giving  a  talk  later  today  “Your  Database  to   the  Cloud,  an  Intro  to  Cloudant  NoSQL”     Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   17  
  • 18. PhEDEx:  The  components   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   18   Transfer  agent   Transfer   management   database   Management  agent   Tools  to  manage   transfers   Local  agents   Web  monitoring  
  • 19. PhEDEx:  data  monitoring   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   19   150  PB   70  PB   hjp://www.flickr.com/photos/paulrossman/6555010435/sizes/l/in/photostream/  
  • 20. Current  and  future  topics   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   20   Things  changed:   Network  is  genng  cheaper  as  well  
  • 21. Current  and  future  topics   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   21   Things  changed:   Network  is  genng  cheaper  as  well   We  are  moving  into  the   cloud  
  • 22. Current  and  future  topics   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   22   Things  changed:   Network  is  genng  cheaper  as  well   We  are  moving  into  the   cloud   Any  data  anywhere!  
  • 23. Other  current  and  future  topics   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   23   Protocol   buffers   CouchDB   Hadoop   Provisioning  of   compuGng  
  • 24. Summary  &  Outlook   •  The  LHC  grid  is  a  world-­‐wide  distributed   compuGng  network  that  makes  discoveries   possible   •  The  grid  is  changing  to  adopt  to  current   technologies   •  In  two  years  Gme  the  LHC  will  increase  its   energy  to  14  TeV  –  more  data,  more   discoveries  to  come!   Saturday,  1  June  13   Lukasz  Kreczko  -­‐  Bristol  IT  MegaMeet   24