SlideShare a Scribd company logo
The Process of
PerformanceTesting
FromThe Art of PerformanceTesting, Chapter 4
Presentation by Sebastián Lagoueyte
Last-Minute Exercise
Limited time to test.You have to deploy at a certain date.
PerformanceTesting Approach
So you don’t fall to the same pitfall
Non-functional Requirements Capture
(NRC)
Step One
“A Scoping Exercise”
Gather performance NFRs from all relevant stakeholders.
At the very least
Deadlines
Resources (internal or external)
Test environment
Key use cases
Performance targets
Deliverables
Procedures
Allow enough time to
capture all of the Non-
Functional Requirements
This usually takes a couple of days
PerformanceTest Environment Build
StepTwo
Test environments
should be a close
approximation of the
production
environment.
To build:
1. Allow enough time to configure
2. Take into account all deployment models or environments
3. Also take into account links to external systems
4. Provide enough load injection capacity
5. Ensure that the application is correctly deployed
6. Provide software licenses
7. Deploy performance testing tool
8. Deploy Key Performance Indicator (KPI) monitoring
Use-Case Scripting
StepThree
Some use cases require more time to script
than others. Allow half a day per use-case.
Ideally, most of the work is done for you before testing.
For each
case, you
should…
Identify the session data requirements.
Usually happens after you begin.
Confirm and apply input data
requirements.
Decide how you will checkpoint the use
case.
Indentify and apply any scripting
changes required.
Ensure that the use case replays
correctly.
PerformanceTest Scenario Build
Step Four
This should be simple, since you should have defined
each performance test as part of your NRC.
Consider
What kind of test will this represent? (Pipe-clean, volume, soak, stress)
Decide how many load injectors and virtual users you require
Decide on each load injector profile (Big-Bang, Ramp-up, Ramp-
up/Ramp-down, delayed start)
How long will the test run for?
Do you need to spoof IP addresses?
Do you need to simulate different baud rates?
What runtime monitoring needs to be set up?
Any effects that the application technology will have on your test
PerformanceTest Execution
Step Five
Run and monitor your tests. Carry out a dress
rehearsal of each performance scenario.
This should be straightforward. It should be a matter of validating
your application’s performance targets.
The only unknown is how many test cycles will be
required.
Execution process order:
1. Execute dress-rehearsals or pipe-clean tests as a final
check
2. Execute volume tests
3. Execute isolation tests to explore revealed problems
4. Execute stress tests
5. Execute soak tests to reveal memory leaks
6. Execute any other tests that are not performance related
Allow a minimum of five days.
Reruns of the testing cycle will be required, since any problems that surface
during execution have to be dealt with
Post-Test Analysis and Reporting
Step Six
The final step consists of collecting and analyzing data
from all tests run
You also create reports, a performance baseline and possibly retest
Carry out final data collection
Uninstall software
Determine success or failure (following performance targets)
Document the results
QuestionsTime
Why should you ensure that the application is
correctly deployed? (in the test environment)
What’s the most common problem with
PerformanceTesting?
Thank

More Related Content

PPTX
Automated visual-regression-testing (1)
PPT
4.4.2013 Software Quality - Regression Testing Automated and Manual - RFT/RQM
PPT
Understand regression testing
PDF
Risk based regression testing approach
PDF
Smoke Testing
PPTX
Software Testing, Everyone's responsibility
PPTX
Agile Engineering Sparker GLASScon 2015
PPT
Functional testing
Automated visual-regression-testing (1)
4.4.2013 Software Quality - Regression Testing Automated and Manual - RFT/RQM
Understand regression testing
Risk based regression testing approach
Smoke Testing
Software Testing, Everyone's responsibility
Agile Engineering Sparker GLASScon 2015
Functional testing

What's hot (20)

PDF
AfterTest Madrid March 2016 - DevOps and Testing Introduction
PPT
Testing introduction
PPTX
The best day for qa
PPTX
Sanity testing and smoke testing
PPTX
How google-tests-software
PPTX
Testing Best Practices
PPTX
Embedded Testing 2015
PDF
What is Regression Testing? | Edureka
PPTX
Software testing
PPT
Test automation in agile ecosystem
PPTX
What is sanity testing
PPTX
Regression testing
PPT
Testing Attributes
PPTX
What is component testing | David Tzemach
PPT
Testing 3: Types Of Tests That May Be Required
PPTX
PPTX
Automation in the Bug Flow - Machine Learning for Triaging and Tracing
PDF
Types of Non Functional Testing
PPTX
User acceptance testing checklist (uat)
PPT
01 software testing_introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
Testing introduction
The best day for qa
Sanity testing and smoke testing
How google-tests-software
Testing Best Practices
Embedded Testing 2015
What is Regression Testing? | Edureka
Software testing
Test automation in agile ecosystem
What is sanity testing
Regression testing
Testing Attributes
What is component testing | David Tzemach
Testing 3: Types Of Tests That May Be Required
Automation in the Bug Flow - Machine Learning for Triaging and Tracing
Types of Non Functional Testing
User acceptance testing checklist (uat)
01 software testing_introduction
Ad

Similar to The process of performance testing (20)

POTX
The process of performance testing
PPTX
Performance testing reference model
PPTX
Manual Testing Module 4-STLC.pptx sdlc cycle most important
PPT
Test automation principles, terminologies and implementations
PDF
03 test specification and execution
PPT
ISTQB / ISEB Foundation Exam Practice - 2
PDF
Door to perfomance testing
PPT
ISTQB, ISEB Lecture Notes- 2
PDF
What Is Unit Testing A Complete Guide With Examples.pdf
PPTX
Perofrmance testing and apache jmeter
PDF
What Is Unit Testing_ A Complete Guide With Examples.pdf
PDF
Software testing interview Q&A – Part 2
PPT
Test planning.ppt
PDF
Fundamentals Performance Testing
PPTX
11 steps of testing process - By Harshil Barot
PPT
ISTQBCH foundation level chapter 01 fundamentals of testing
PPTX
Qa documentation pp
PPTX
Qtp training session I
PPT
ISTQB / ISEB Foundation Exam Practice -1
PPTX
Incorporating Performance Testing in Agile Development Process
The process of performance testing
Performance testing reference model
Manual Testing Module 4-STLC.pptx sdlc cycle most important
Test automation principles, terminologies and implementations
03 test specification and execution
ISTQB / ISEB Foundation Exam Practice - 2
Door to perfomance testing
ISTQB, ISEB Lecture Notes- 2
What Is Unit Testing A Complete Guide With Examples.pdf
Perofrmance testing and apache jmeter
What Is Unit Testing_ A Complete Guide With Examples.pdf
Software testing interview Q&A – Part 2
Test planning.ppt
Fundamentals Performance Testing
11 steps of testing process - By Harshil Barot
ISTQBCH foundation level chapter 01 fundamentals of testing
Qa documentation pp
Qtp training session I
ISTQB / ISEB Foundation Exam Practice -1
Incorporating Performance Testing in Agile Development Process
Ad

Recently uploaded (20)

PPTX
ai tools demonstartion for schools and inter college
PDF
PTS Company Brochure 2025 (1).pdf.......
PDF
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
PDF
Upgrade and Innovation Strategies for SAP ERP Customers
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PDF
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PDF
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
PPTX
L1 - Introduction to python Backend.pptx
PDF
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
PDF
wealthsignaloriginal-com-DS-text-... (1).pdf
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PDF
How to Choose the Right IT Partner for Your Business in Malaysia
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PPTX
history of c programming in notes for students .pptx
PDF
top salesforce developer skills in 2025.pdf
PDF
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
PDF
AI in Product Development-omnex systems
ai tools demonstartion for schools and inter college
PTS Company Brochure 2025 (1).pdf.......
Why TechBuilder is the Future of Pickup and Delivery App Development (1).pdf
Upgrade and Innovation Strategies for SAP ERP Customers
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
Audit Checklist Design Aligning with ISO, IATF, and Industry Standards — Omne...
Operating system designcfffgfgggggggvggggggggg
Odoo Companies in India – Driving Business Transformation.pdf
SAP S4 Hana Brochure 3 (PTS SYSTEMS AND SOLUTIONS)
L1 - Introduction to python Backend.pptx
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
wealthsignaloriginal-com-DS-text-... (1).pdf
Internet Downloader Manager (IDM) Crack 6.42 Build 41
How to Choose the Right IT Partner for Your Business in Malaysia
Adobe Illustrator 28.6 Crack My Vision of Vector Design
history of c programming in notes for students .pptx
top salesforce developer skills in 2025.pdf
Flood Susceptibility Mapping Using Image-Based 2D-CNN Deep Learnin. Overview ...
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
AI in Product Development-omnex systems

The process of performance testing

  • 1. The Process of PerformanceTesting FromThe Art of PerformanceTesting, Chapter 4 Presentation by Sebastián Lagoueyte
  • 2. Last-Minute Exercise Limited time to test.You have to deploy at a certain date.
  • 3. PerformanceTesting Approach So you don’t fall to the same pitfall
  • 5. “A Scoping Exercise” Gather performance NFRs from all relevant stakeholders.
  • 6. At the very least Deadlines Resources (internal or external) Test environment Key use cases Performance targets Deliverables Procedures
  • 7. Allow enough time to capture all of the Non- Functional Requirements This usually takes a couple of days
  • 9. Test environments should be a close approximation of the production environment.
  • 10. To build: 1. Allow enough time to configure 2. Take into account all deployment models or environments 3. Also take into account links to external systems 4. Provide enough load injection capacity 5. Ensure that the application is correctly deployed 6. Provide software licenses 7. Deploy performance testing tool 8. Deploy Key Performance Indicator (KPI) monitoring
  • 12. Some use cases require more time to script than others. Allow half a day per use-case. Ideally, most of the work is done for you before testing.
  • 13. For each case, you should… Identify the session data requirements. Usually happens after you begin. Confirm and apply input data requirements. Decide how you will checkpoint the use case. Indentify and apply any scripting changes required. Ensure that the use case replays correctly.
  • 15. This should be simple, since you should have defined each performance test as part of your NRC.
  • 16. Consider What kind of test will this represent? (Pipe-clean, volume, soak, stress) Decide how many load injectors and virtual users you require Decide on each load injector profile (Big-Bang, Ramp-up, Ramp- up/Ramp-down, delayed start) How long will the test run for? Do you need to spoof IP addresses? Do you need to simulate different baud rates? What runtime monitoring needs to be set up? Any effects that the application technology will have on your test
  • 18. Run and monitor your tests. Carry out a dress rehearsal of each performance scenario. This should be straightforward. It should be a matter of validating your application’s performance targets. The only unknown is how many test cycles will be required.
  • 19. Execution process order: 1. Execute dress-rehearsals or pipe-clean tests as a final check 2. Execute volume tests 3. Execute isolation tests to explore revealed problems 4. Execute stress tests 5. Execute soak tests to reveal memory leaks 6. Execute any other tests that are not performance related
  • 20. Allow a minimum of five days. Reruns of the testing cycle will be required, since any problems that surface during execution have to be dealt with
  • 21. Post-Test Analysis and Reporting Step Six
  • 22. The final step consists of collecting and analyzing data from all tests run You also create reports, a performance baseline and possibly retest
  • 23. Carry out final data collection Uninstall software Determine success or failure (following performance targets) Document the results
  • 25. Why should you ensure that the application is correctly deployed? (in the test environment) What’s the most common problem with PerformanceTesting?
  • 26. Thank