SlideShare a Scribd company logo
Excellence in Cloud
Performance




           One Millions Users vs. Your Web
           Application.
           - Mega Testing Cloud
            Applications
           sven.hammar@apicasystem.com
Apica

   Performance       Monitoring
as a Cloud Service
                                     Complete range

                                  Project , Self Service,
                                     Pay as you Go

                                   Partner integration

                                      Real Browser

                                      Tool & Portal




    LoadTest         InSide APM


                                                      2
Why LoadTest




         Break things                            Find the limit


       Find the problem                        Solve the problem


                        Make the site faster


                                                                   3
Type of Tests




   Functional Test      Load Test




                                         Launch Test


    Stress Test      Capacity Planning



                                                       4
LoadTest 1-1

                                                            Point of collapse
 Load Maximum                          Throughput


   – How many users can we handle ?                                             Complete
                                                                                failure
   – What is a good result ?

 Behavior in  the  ”Danger  Zone”                                              Number
                                                                                of users
   – Does the application become
      unstable above maximum load ?
 Problem Analysis
                                                1X    2X   4X     8X
                                                                         ∞
                                      Response time

   – Where are the bottlenecks
   – How to fix them ?

                                                                          Number
                                                                          of users




                                                                                           5
Why Load Test a Cloud




                        6
Validate your design




                       7
Testing cloud applications

 Isolate problems before launch
   –   Optimize performance based on
       robust metrics
 Actual capacity of adding new
  servers
   –   Time to scale
   –   Added capacity
 Planning proactive cloud scaling
   –   Proactively spin up additional servers
       before performance is degraded
 Test failover procedures
   –   Validate startup schemas and timing




                                                8
1,000,000 users vs your Web Site !




                                     9
10
Delivery Model LoadTest
           API Access                    Self Service Network
Access to test platform ( WS) or   Test capacity by the Hour
exec agents                        Self service Script
                                   ProxySniffer




   Custom Managed Project             Apica Full Service project
Custom managed / LoadTest Portal   Apica PS team
Different project members          Full Service LoadTest &
                                   Capacity planning / APM




                                                                   11
12
SOME NUMBERS

               13
Some numbers




                               Run         Load-
                 AWS         unlimited   Generators
    AWS                        week        100 *
    AMI       Run test for                10,000
 100-10,000    $6-$420       $2,999 +    1,000,000
 Users /AMI    per hour      AWS cost


                                                 14
DEMO

       15
Test your limit..

 www.apicasystem.com
 ProxySniffer
 Free 20 user ProxySniffer license




 Sven.hammar@apicasystem.com
 @svenhammar
 @apicasystems




                                      16
Excellence in Cloud
Performance




                  Thank You!

More Related Content

PPTX
How to Cover All Your Backend Testing Needs with API and UI Tests
PPTX
Continuous Testing in the Agile Age
PDF
Lessons Learned from building a serverless API
PPTX
Building Scalable Websites for the Cloud
PPTX
Gluecon keynote
PPT
Get Virtualized
PDF
How To Combine Back-End 
 & Front-End Testing with BlazeMeter & Sauce Labs
PDF
Adopting Java for the Serverless world at IT Tage
How to Cover All Your Backend Testing Needs with API and UI Tests
Continuous Testing in the Agile Age
Lessons Learned from building a serverless API
Building Scalable Websites for the Cloud
Gluecon keynote
Get Virtualized
How To Combine Back-End 
 & Front-End Testing with BlazeMeter & Sauce Labs
Adopting Java for the Serverless world at IT Tage

What's hot (16)

PPTX
Performance Monitoring with AOP and Amazon CloudWatch
PPTX
Ten^H^H^H Many Cloud App Design Patterns
PDF
FaaS or not to FaaS. Visible and invisible benefits of the Serverless paradig...
PDF
Adopting Java for the Serverless world at Serverless Meetup New York and Boston
PPTX
How to Build Scalable Websites in the Cloud
PPT
AWS Simple Work Flow
PDF
Scaling Gilt: from monolith ruby app to micro service scala service architecture
PDF
Revolutionize DevOps with ML capabilities. Introduction to Amazon CodeGuru an...
PDF
Event driven infrastructure
PDF
Adopting Java for the Serverless world at JUG Hamburg
PDF
Performance Testing for Mobile Apps & Sites using Apache JMeter
PDF
Revolutionize DevOps with ML capabilities. Introduction to Amazon CodeGuru an...
PPTX
Refactoring Organizations - A Netflix Study (QCon NYC 2017)
PPTX
Capacity Planning with Free Tools
PDF
Whizlabs webinar - Deploying Portfolio Site with AWS Serverless
PPT
Devops at Netflix (re:Invent)
Performance Monitoring with AOP and Amazon CloudWatch
Ten^H^H^H Many Cloud App Design Patterns
FaaS or not to FaaS. Visible and invisible benefits of the Serverless paradig...
Adopting Java for the Serverless world at Serverless Meetup New York and Boston
How to Build Scalable Websites in the Cloud
AWS Simple Work Flow
Scaling Gilt: from monolith ruby app to micro service scala service architecture
Revolutionize DevOps with ML capabilities. Introduction to Amazon CodeGuru an...
Event driven infrastructure
Adopting Java for the Serverless world at JUG Hamburg
Performance Testing for Mobile Apps & Sites using Apache JMeter
Revolutionize DevOps with ML capabilities. Introduction to Amazon CodeGuru an...
Refactoring Organizations - A Netflix Study (QCon NYC 2017)
Capacity Planning with Free Tools
Whizlabs webinar - Deploying Portfolio Site with AWS Serverless
Devops at Netflix (re:Invent)
Ad

Viewers also liked (13)

PPTX
Open Source CDNs | LAWebSpeed April 29th 2014
PPTX
Q2 poster
PDF
Predicting user activity to make the web fast presentation
PPTX
Akamai internet insights
PPTX
Solving the hard problems of user experience management presentation
PPTX
Preview toward agile APM at Intel presentation
PDF
Wisdom of the crowd gathering insights from real user monitoring presentation
PPTX
Apica presentation, Cloud & Hosting Theatre
PPTX
RapidMiner: Important Elements
PPTX
RapidMiner: Modelling Data
PPTX
Rapid Miner: Data Transformation
PPTX
Security & protection in operating system
PPTX
Facebook Powerpoint
Open Source CDNs | LAWebSpeed April 29th 2014
Q2 poster
Predicting user activity to make the web fast presentation
Akamai internet insights
Solving the hard problems of user experience management presentation
Preview toward agile APM at Intel presentation
Wisdom of the crowd gathering insights from real user monitoring presentation
Apica presentation, Cloud & Hosting Theatre
RapidMiner: Important Elements
RapidMiner: Modelling Data
Rapid Miner: Data Transformation
Security & protection in operating system
Facebook Powerpoint
Ad

Similar to One millions users vs your web application mega testing cloud applications presentation (20)

PPTX
Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud
PDF
SOASTA CloudTest Lite
PDF
An Introduction To Space Based Architecture
PPTX
Hewlett Packard Entreprise | Stormrunner load | Game Changer
PPTX
Performance and Success: Key Elements to Consider in the Cloud
PDF
5 keys to holiday web performance readiness
PDF
Agile Open Source Performance Test Workshop for Developers, Testers, IT Ops
PPTX
Load Testing and JMeter Presentation
PPTX
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
PPTX
Application Performance Management in the Clouds - Lessons Learned
PDF
Web Performance Acceleration with Strangeloop AS1000
PDF
Performance Engineering Case Study V1.0
PDF
Nonfunctional Testing: Examine the Other Side of the Coin
PPTX
Transform Software Testing and Quality with the Neotys-Inflectra Platform
PPTX
Tools of the Trade: Load Testing - Ignite session at WebPerfDays NY 14
PDF
V fabric overview
PPSX
Agileload - load testing tool for better web performance
PPTX
Test Strategy For Future Cloud Architecture
PPTX
Cloud-based performance testing
PPTX
Cloud Performance Testing with LoadRunner
Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud
SOASTA CloudTest Lite
An Introduction To Space Based Architecture
Hewlett Packard Entreprise | Stormrunner load | Game Changer
Performance and Success: Key Elements to Consider in the Cloud
5 keys to holiday web performance readiness
Agile Open Source Performance Test Workshop for Developers, Testers, IT Ops
Load Testing and JMeter Presentation
CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...
Application Performance Management in the Clouds - Lessons Learned
Web Performance Acceleration with Strangeloop AS1000
Performance Engineering Case Study V1.0
Nonfunctional Testing: Examine the Other Side of the Coin
Transform Software Testing and Quality with the Neotys-Inflectra Platform
Tools of the Trade: Load Testing - Ignite session at WebPerfDays NY 14
V fabric overview
Agileload - load testing tool for better web performance
Test Strategy For Future Cloud Architecture
Cloud-based performance testing
Cloud Performance Testing with LoadRunner

More from Justin Dorfman (10)

PPT
Develop, deploy and manage tomorrow’s applications…today presentation 1
PDF
Broadening the user perspective – from network latency to user experience tim...
PDF
A new era at GoDaddy.com presentation
PDF
Understanding hardware acceleration on mobile browsers presentation
PDF
Michelin starred cooking with chef presentation
PDF
Benchmarks, performance, scalability, and capacity what's behind the numbers
PDF
Abuse prevention in the globally distributed economy presentation
PDF
Stability patterns presentation
PPT
A web perf dashboard up & running in 90 minutes presentation
PDF
WordPress Optimization - WordCampLA 09-10-11
Develop, deploy and manage tomorrow’s applications…today presentation 1
Broadening the user perspective – from network latency to user experience tim...
A new era at GoDaddy.com presentation
Understanding hardware acceleration on mobile browsers presentation
Michelin starred cooking with chef presentation
Benchmarks, performance, scalability, and capacity what's behind the numbers
Abuse prevention in the globally distributed economy presentation
Stability patterns presentation
A web perf dashboard up & running in 90 minutes presentation
WordPress Optimization - WordCampLA 09-10-11

Recently uploaded (20)

PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Empathic Computing: Creating Shared Understanding
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
cuic standard and advanced reporting.pdf
PPTX
sap open course for s4hana steps from ECC to s4
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
Programs and apps: productivity, graphics, security and other tools
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Big Data Technologies - Introduction.pptx
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Electronic commerce courselecture one. Pdf
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Empathic Computing: Creating Shared Understanding
Understanding_Digital_Forensics_Presentation.pptx
Diabetes mellitus diagnosis method based random forest with bat algorithm
Unlocking AI with Model Context Protocol (MCP)
cuic standard and advanced reporting.pdf
sap open course for s4hana steps from ECC to s4
NewMind AI Weekly Chronicles - August'25 Week I
Programs and apps: productivity, graphics, security and other tools
“AI and Expert System Decision Support & Business Intelligence Systems”
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Digital-Transformation-Roadmap-for-Companies.pptx
Reach Out and Touch Someone: Haptics and Empathic Computing
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Big Data Technologies - Introduction.pptx
Building Integrated photovoltaic BIPV_UPV.pdf
Electronic commerce courselecture one. Pdf
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Agricultural_Statistics_at_a_Glance_2022_0.pdf

One millions users vs your web application mega testing cloud applications presentation

  • 1. Excellence in Cloud Performance One Millions Users vs. Your Web Application. - Mega Testing Cloud Applications sven.hammar@apicasystem.com
  • 2. Apica Performance Monitoring as a Cloud Service Complete range Project , Self Service, Pay as you Go Partner integration Real Browser Tool & Portal LoadTest InSide APM 2
  • 3. Why LoadTest Break things Find the limit Find the problem Solve the problem Make the site faster 3
  • 4. Type of Tests Functional Test Load Test Launch Test Stress Test Capacity Planning 4
  • 5. LoadTest 1-1 Point of collapse  Load Maximum Throughput – How many users can we handle ? Complete failure – What is a good result ?  Behavior in  the  ”Danger  Zone” Number of users – Does the application become unstable above maximum load ?  Problem Analysis 1X 2X 4X 8X ∞ Response time – Where are the bottlenecks – How to fix them ? Number of users 5
  • 6. Why Load Test a Cloud 6
  • 8. Testing cloud applications  Isolate problems before launch – Optimize performance based on robust metrics  Actual capacity of adding new servers – Time to scale – Added capacity  Planning proactive cloud scaling – Proactively spin up additional servers before performance is degraded  Test failover procedures – Validate startup schemas and timing 8
  • 9. 1,000,000 users vs your Web Site ! 9
  • 10. 10
  • 11. Delivery Model LoadTest API Access Self Service Network Access to test platform ( WS) or Test capacity by the Hour exec agents Self service Script ProxySniffer Custom Managed Project Apica Full Service project Custom managed / LoadTest Portal Apica PS team Different project members Full Service LoadTest & Capacity planning / APM 11
  • 12. 12
  • 14. Some numbers Run Load- AWS unlimited Generators AWS week 100 * AMI Run test for 10,000 100-10,000 $6-$420 $2,999 + 1,000,000 Users /AMI per hour AWS cost 14
  • 15. DEMO 15
  • 16. Test your limit..  www.apicasystem.com  ProxySniffer  Free 20 user ProxySniffer license  Sven.hammar@apicasystem.com  @svenhammar  @apicasystems 16