SlideShare a Scribd company logo
Scale Fail
or, how I learned to stop worrying
      and love the downtime
Scale Fail: How I Learned to Love the Downtime
Scale Fail: How I Learned to Love the Downtime
Downtime
   is
  Sexy
1. Be Trendy
Scale Fail: How I Learned to Love the Downtime
Scale Fail: How I Learned to Love the Downtime
NO
 Resource Monitoring
 Performance Testing
 Traffic Monitoring
 Load Testing
 Tuning Analysis
Let History Be Your Guide
●   Was database to slow last time?
    ●   The database is too slow this time.
●   Did the network cards fry last time?
    ●   They're frying this time.
●   Did Apache choke on memory leaks last time?
    ●   It's Apache this time.
●   Fixed things by using queues at your last job?
    ●   Then fix them with queues at this job!
Barn Door Troubleshooting
Parallel Programming




                  XY
               SE
          OT
         N
Don't
 Worry
 About
   It
Program-
             X Y
  ming
           SE
How to Single-Thread
           Your Code
●   Locks, Locks, Locks!
●   Ignore scope and memory address space
●   Frequently-updated single-row table
●   Master Control Server process
●   Single Master Queue
●   Blocking threads which wait while checking on
    a remote data source
The Old Way: Caching

     Connection Caching Pool                 App                     Web
                                            Server                  Server




                                             App                     Web




                                                     Object Cache
DB




                                                                             HTTP Cache
                               Data Cache


                                            Server                  Server




                                             App                     Web
                                            Server                  Server
The New Way: Direct2DB

               Web
              Server




               Web
DB




                       HTTP Cache
              Server




               Web
              Server
Easy to Scale

● Web servers
● Caches


● Shared-nothing hosts


● Simple App Servers




     For Wimps!
Hard to Scale

  ● Databases
  ● Queues


  ● Shared Filesystems


  ● Web Frameworks




For Real Developers!
SPoF
Single Point of Failure

                    App                 Web
                   Server              Server


UserDB
          Task      App      Load       Web      Load
         Manager   Server   Balancer   Server   Balancer


PageDB

                    App                 Web
                   Server              Server
Cascading Failure

                                        Web
                                       Server


UserDB
          Task      App      Load       Web      Load
         Manager   Server   Balancer   Server   Balancer


PageDB

                    App                 Web
                   Server              Server
Be Sexy:




Go Down!

More Related Content

PDF
Scaling a Web Service
ZIP
Rails in the Cloud
PPT
Amazon.com's Web Services Opportunity
PDF
Next.js in production by Jasdeep Lalli
PPTX
How NOT to get lost in the current JavaScript landscape
KEY
SOA on Rails
PDF
Padrino - the Godfather of Sinatra
PPTX
Scaling with swagger
Scaling a Web Service
Rails in the Cloud
Amazon.com's Web Services Opportunity
Next.js in production by Jasdeep Lalli
How NOT to get lost in the current JavaScript landscape
SOA on Rails
Padrino - the Godfather of Sinatra
Scaling with swagger

What's hot (20)

PDF
Project Fedena and Why Ruby on Rails - ArvindArvind G S
PDF
Server modeling with mysql
ZIP
App engine beats pony.key
PDF
Deploying and Scaling using AWS
PPT
Intro to Ruby on Rails
PPTX
Challenges of angular in production (Tasos Bekos) - GreeceJS #17
PDF
React.js for Rails Developers
PDF
DrupalCamp LA 2012: COOK UP SOME STACKS OF DRUPAL GOODNESS WITH CHEF
PDF
Webcomponents are your frameworks best friend
PDF
React on rails v6.1 at LA Ruby, November 2016
PDF
Meanstack Introduction by Kishore Chandra
PDF
Frameworks and webcomponents
PPTX
Webinar: Adobe Experience Manager Clustering Made Easy on MongoDB
PPTX
Introduction to Coffeescript
PDF
Translation
PDF
4 JVM Web Frameworks
PDF
Modern javascript
PPTX
Scalable Text File Service with MongoDB (Intuit)
PDF
Addictomatic
DOCX
Rails Concept
Project Fedena and Why Ruby on Rails - ArvindArvind G S
Server modeling with mysql
App engine beats pony.key
Deploying and Scaling using AWS
Intro to Ruby on Rails
Challenges of angular in production (Tasos Bekos) - GreeceJS #17
React.js for Rails Developers
DrupalCamp LA 2012: COOK UP SOME STACKS OF DRUPAL GOODNESS WITH CHEF
Webcomponents are your frameworks best friend
React on rails v6.1 at LA Ruby, November 2016
Meanstack Introduction by Kishore Chandra
Frameworks and webcomponents
Webinar: Adobe Experience Manager Clustering Made Easy on MongoDB
Introduction to Coffeescript
Translation
4 JVM Web Frameworks
Modern javascript
Scalable Text File Service with MongoDB (Intuit)
Addictomatic
Rails Concept
Ad

Similar to Scale Fail: How I Learned to Love the Downtime (20)

PDF
Evolving Archetecture
KEY
Web frameworks don't matter
KEY
Profiling php applications
PPTX
The Hybrid Windows Azure Application
KEY
Gearman
PDF
Bottlenecks exposed web app db servers
PDF
Improving The Performance of Your Web App
PDF
Load Balancing und Beschleunigung mit Citrix Net Scaler
PPTX
Scaling Systems: Architectures that Grow
PPTX
Scalable Resilient Web Services In .Net
PDF
Dealing with Enterprise Level Data
ZIP
Memcached, presented to LCA2010
PDF
ITPro's taking the SharePoint 2013 Red Pill
PPS
Scalable Web Arch
PPS
Scalable Web Architectures - Common Patterns & Approaches
PPTX
[DSBW Spring 2009] Unit 05: Web Architectures
PDF
Top ten-list
PPT
Large-scale projects development (scaling LAMP)
PDF
Memcached and the Rise of the Dynamic Web
PPTX
PHP Apps on the Move - Migrating from In-House to Cloud
Evolving Archetecture
Web frameworks don't matter
Profiling php applications
The Hybrid Windows Azure Application
Gearman
Bottlenecks exposed web app db servers
Improving The Performance of Your Web App
Load Balancing und Beschleunigung mit Citrix Net Scaler
Scaling Systems: Architectures that Grow
Scalable Resilient Web Services In .Net
Dealing with Enterprise Level Data
Memcached, presented to LCA2010
ITPro's taking the SharePoint 2013 Red Pill
Scalable Web Arch
Scalable Web Architectures - Common Patterns & Approaches
[DSBW Spring 2009] Unit 05: Web Architectures
Top ten-list
Large-scale projects development (scaling LAMP)
Memcached and the Rise of the Dynamic Web
PHP Apps on the Move - Migrating from In-House to Cloud
Ad

More from PostgreSQL Experts, Inc. (20)

ODP
Shootout at the PAAS Corral
ODP
Shootout at the AWS Corral
ODP
Fail over fail_back
ODP
PostgreSQL Replication in 10 Minutes - SCALE
ODP
Give A Great Tech Talk 2013
PDF
Pg py-and-squid-pypgday
PDF
92 grand prix_2013
PDF
Five steps perform_2013
PDF
7 Ways To Crash Postgres
PDF
PWNage: Producing a newsletter with Perl
PDF
10 Ways to Destroy Your Community
PDF
Open Source Press Relations
PDF
5 (more) Ways To Destroy Your Community
PDF
Preventing Community (from Linux Collab)
PDF
Development of 8.3 In India
PDF
PostgreSQL and MySQL
PDF
50 Ways To Love Your Project
PDF
8.4 Upcoming Features
PDF
Elephant Roads: PostgreSQL Patches and Variants
Shootout at the PAAS Corral
Shootout at the AWS Corral
Fail over fail_back
PostgreSQL Replication in 10 Minutes - SCALE
Give A Great Tech Talk 2013
Pg py-and-squid-pypgday
92 grand prix_2013
Five steps perform_2013
7 Ways To Crash Postgres
PWNage: Producing a newsletter with Perl
10 Ways to Destroy Your Community
Open Source Press Relations
5 (more) Ways To Destroy Your Community
Preventing Community (from Linux Collab)
Development of 8.3 In India
PostgreSQL and MySQL
50 Ways To Love Your Project
8.4 Upcoming Features
Elephant Roads: PostgreSQL Patches and Variants

Recently uploaded (20)

PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Machine learning based COVID-19 study performance prediction
PDF
Approach and Philosophy of On baking technology
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
cuic standard and advanced reporting.pdf
PDF
Empathic Computing: Creating Shared Understanding
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Cloud computing and distributed systems.
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Spectral efficient network and resource selection model in 5G networks
NewMind AI Monthly Chronicles - July 2025
Network Security Unit 5.pdf for BCA BBA.
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Encapsulation_ Review paper, used for researhc scholars
Machine learning based COVID-19 study performance prediction
Approach and Philosophy of On baking technology
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
cuic standard and advanced reporting.pdf
Empathic Computing: Creating Shared Understanding
Per capita expenditure prediction using model stacking based on satellite ima...
20250228 LYD VKU AI Blended-Learning.pptx
Unlocking AI with Model Context Protocol (MCP)
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Big Data Technologies - Introduction.pptx
Cloud computing and distributed systems.

Scale Fail: How I Learned to Love the Downtime

  • 1. Scale Fail or, how I learned to stop worrying and love the downtime
  • 4. Downtime is Sexy
  • 8. NO Resource Monitoring Performance Testing Traffic Monitoring Load Testing Tuning Analysis
  • 9. Let History Be Your Guide ● Was database to slow last time? ● The database is too slow this time. ● Did the network cards fry last time? ● They're frying this time. ● Did Apache choke on memory leaks last time? ● It's Apache this time. ● Fixed things by using queues at your last job? ● Then fix them with queues at this job!
  • 11. Parallel Programming XY SE OT N
  • 12. Don't Worry About It Program- X Y ming SE
  • 13. How to Single-Thread Your Code ● Locks, Locks, Locks! ● Ignore scope and memory address space ● Frequently-updated single-row table ● Master Control Server process ● Single Master Queue ● Blocking threads which wait while checking on a remote data source
  • 14. The Old Way: Caching Connection Caching Pool App Web Server Server App Web Object Cache DB HTTP Cache Data Cache Server Server App Web Server Server
  • 15. The New Way: Direct2DB Web Server Web DB HTTP Cache Server Web Server
  • 16. Easy to Scale ● Web servers ● Caches ● Shared-nothing hosts ● Simple App Servers For Wimps!
  • 17. Hard to Scale ● Databases ● Queues ● Shared Filesystems ● Web Frameworks For Real Developers!
  • 18. SPoF
  • 19. Single Point of Failure App Web Server Server UserDB Task App Load Web Load Manager Server Balancer Server Balancer PageDB App Web Server Server
  • 20. Cascading Failure Web Server UserDB Task App Load Web Load Manager Server Balancer Server Balancer PageDB App Web Server Server