Secrets to Realistic Load Testing
Download as PPTX, PDF1 like1,443 views
The document outlines key strategies for realistic load testing, emphasizing the importance of modeling real user behavior and linking website performance to business metrics. It discusses the need for accurate workload determination, leveraging real user data, and using analytics to troubleshoot performance bottlenecks. Additionally, it suggests involving customer insights to set performance goals and maximize return on investment (ROI).
Secrets to Realistic Load Testing
- 1. Secrets to Realistic Load Testing
- 2. © 2015 SOASTA. All rights reserved. January 21, 2015 2CONFIDENTIAL – Not for Distribution 1. Build performance tests which will model real user behavior on your site 2. Tie business metrics (ROI) to website performance metrics and real user data 3. Correlate data analytics so you can troubleshoot bottlenecks and improve performance. In this webinar you will learn to:
- 3. © 2015 SOASTA. All rights reserved. January 21, 2015 3CONFIDENTIAL – Not for Distribution Presenters Craig Combs Technical Director, Performance Engineering Mike Ostenberg Solution Engineer Moderator: Kathy Lam Product Marketing
- 4. © 2015 SOASTA. All rights reserved. January 21, 2015 4CONFIDENTIAL – Not for Distribution How fast should your site be?
- 5. © 2015 SOASTA. All rights reserved. January 21, 2015 5CONFIDENTIAL – Not for Distribution Speed costs money…
- 6. © 2015 SOASTA. All rights reserved. January 21, 2015 6CONFIDENTIAL – Not for Distribution …and how much load should it handle?
- 7. © 2015 SOASTA. All rights reserved. January 21, 2015 7CONFIDENTIAL – Not for Distribution Your customers will be your guide…
- 8. Survey
- 9. © 2015 SOASTA. All rights reserved. January 21, 2015 9CONFIDENTIAL – Not for Distribution mPulse How fast is my site? What locations? From where? Which pages? Which flows? CloudTest Full scale load From any location Going through real user flows With real-time analytics Real-Time Analytics with Real User Measurement
- 10. © 2015 SOASTA. All rights reserved. January 21, 2015 10CONFIDENTIAL – Not for Distribution • Tying Business Metrics to (ROI) with website performance metrics and real user data
- 11. CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015 Building performance tests that model user behavior on your site First you need to determine the workload for the test. How are companies doing that today? • Guessing. • Logs. • 3rd Party tools. What if I have a new system?
- 12. © 2015 SOASTA. All rights reserved. January 21, 2015 12CONFIDENTIAL – Not for Distribution o What information I need? ● When is your peak second/minute/hour/day? ● What is your peak volume? (active sessions, unique users, page visits, orders, ...) ● What is the median session length? ● What is the distribution of user paths? ● What is the distribution of devices? ● What is the distribution of locations? o Good Test Data ● Search Terms ● Product Distribution ● Browse Distribution ● Cart Size ● Order Size How to get a realistic load test Factors to consider
- 13. © 2015 SOASTA. All rights reserved. January 21, 2015 13CONFIDENTIAL – Not for Distribution Use real user data to model real user tests
- 15. Focus on the ROI of Performance
- 16. CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015 “What If” : Why we test Predict the future with mPulse!
- 17. CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015 Sunburst charts shows the most common session paths of real users
- 18. CONFIDENTIAL – Not for Distribution © 2015 SOASTA. All rights reserved. January 13, 2015 Data Science Workbench Analyze mPulse beacons to build the RIGHT performance and load tests!
- 19. © 2015 SOASTA. All rights reserved. January 21, 2015 19CONFIDENTIAL – Not for Distribution Now you are ready to test
- 20. © 2015 SOASTA. All rights reserved. January 21, 2015 20CONFIDENTIAL – Not for Distribution Test how you want, when you want, where you want
- 21. © 2015 SOASTA. All rights reserved. January 21, 2015 21CONFIDENTIAL – Not for Distribution 1. Let your users help you determine your performance goals 2. Tie business metrics, (conversion rates, length of engagement, etc) to calculate costs of performance vs revenue gain 3. Use data analytics to review site performance data to isolate bottlenecks, which can guide your performance investments Summary
- 22. © 2015 SOASTA. All rights reserved. January 21, 2015 22CONFIDENTIAL – Not for Distribution
- 23. © 2015 SOASTA. All rights reserved. January 21, 2015 23CONFIDENTIAL – Not for Distribution Mike Ostenberg Director Solutions Engineering Email: mostenberg@soasta.com Craig Combs Technical Director, PE Email: ccombs@soasta.com Twitter: CCdiddy