SlideShare a Scribd company logo
#ATAGTR2017
16th - 17th March
Performance Testing in DEV OPs
Sandeep Patil
Gorakshnath Dorge
Agile Testing Alliance Global Testing Retreat 2017
Agenda
 Automated Performance Testing
 Approach to automate Performance Testing
 Performance Testing using Jenkins
 Advantages
 Limitations
 Q&A
Agile Testing Alliance Global Testing Retreat 2017
• Reduces efforts in Testing.
• Adoption of Agile Methodology.
• Regression can be easily spotted.
• Decision on Production Deployment.
 Automated Performance Testing
Agile Testing Alliance Global Testing Retreat 2017
• Use Plugins for Jenkins.
• Plugins for Jmeter/Silk Performer/Load
Runner.
• Develop your own programs to work with
Jenkins.
• Java/Node js/Python Code
 Approaches
Agile Testing Alliance Global Testing Retreat 2017
• Identify Critical Use Cases.
• Automate business critical use cases using SP.
• Run automation in Pre-Prod / QA environments.
• Invoke automations through Jenkins
• Results
• Parse the results using java/python program.
• Send the results to stake holders.
• Decide go / no - go to Prod.
 Performance Testing In Pipeline
Agile Testing Alliance Global Testing Retreat 2017
 Deployment In Jenkins
Agile Testing Alliance Global Testing Retreat 2017
• Run automation in Pre-Prod / QA
environments.
• Invoke automations through Jenkins
 Performance Testing In Pipeline
Agile Testing Alliance Global Testing Retreat 2017
• Run automation in Pre-Prod / QA
environments.
• Invoke automations through Jenkins
 Performance Testing In Pipeline
Agile Testing Alliance Global Testing Retreat 2017
• Results
• Parse the results using java program.
• Send the results to stake holders.
• Decide go / no - go to Prod.
 Performance Testing In Pipeline
Agile Testing Alliance Global Testing Retreat 2017
• Offhand warning before push to production.
• Regression can be caught easily.
• Advantages of automation
• No manual efforts
• Production push can be done anytime
• For application adopting agile methodology .
Automated performance testing helps developer to optimize
performance issues arising by addition of new features during
sprints.
 Advantages
Agile Testing Alliance Global Testing Retreat 2017
• Creating and editing SP scripts manually.
• Validating scripts manually in case of code/call
changes.
• Silk Performer Plugin Limitations.
• Monitoring required
• Automation Server is down.
• Automation Stuck then kill manually.
 Limitations
Agile Testing Alliance Global Testing Retreat 2017
• Shift Left
• Push results into database so that the
historical data can be obtained anytime
required.
• Automating the resources utilization stats.
 Future Plans
Agile Testing Alliance Global Testing Retreat 2017
Q & A
Thank You!

More Related Content

PPTX
ATAGTR2017 Wearable App Testing
PPTX
ATAGTR2017 Upgrading a mobile tester's weapons with advanced debugging
PPTX
ATAGTR2017 Performance Testing of Big Data Application
PPTX
ATAGTR2017 Keeping pace with Product Evolution: UI Automation Framework Guide...
PPTX
ATAGTR2017 Cost-effective Security Testing Approaches for Web, Mobile & Enter...
PPTX
ATAGTR2017 Protractor Cucumber BDD Approach
PPTX
ATAGTR2017 The way to recover the issue faced in IoT regression Testing
PPTX
ATAGTR2017 Artificial Intelligence in Software Testing – Demystified
ATAGTR2017 Wearable App Testing
ATAGTR2017 Upgrading a mobile tester's weapons with advanced debugging
ATAGTR2017 Performance Testing of Big Data Application
ATAGTR2017 Keeping pace with Product Evolution: UI Automation Framework Guide...
ATAGTR2017 Cost-effective Security Testing Approaches for Web, Mobile & Enter...
ATAGTR2017 Protractor Cucumber BDD Approach
ATAGTR2017 The way to recover the issue faced in IoT regression Testing
ATAGTR2017 Artificial Intelligence in Software Testing – Demystified

What's hot (20)

ODP
API Testing With Katalon Studio
PPTX
ATAGTR2017 Batch Workload Modelling and Performance Optimization
PPTX
Be a User first; then a Tester
PPTX
ATAGTR2017 Detect Layout Bugs by Simulating Human Eye
PPTX
Use Automation to Assist -Not Replace- Manual Testing
PDF
Modern Functional Test Automation Through Visual AI - webinar w/ Raja Rao
PPTX
From One Test To Test Framework With Rapise
PDF
Overview the Challenges and Limitations of Android App Automation with Espres...
PDF
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
PDF
How Vanguard Got to a CD-CD World by Craig Schwarzwald
PDF
Managers, Future Proof Your Automation
PDF
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
PPTX
Kloia Quality Assurance
PDF
Test Automation Architecture
PPTX
WiKi Based Automation Testing: Fitness & DevOps
PDF
Wrong Tool, Wrong Time: Re-Thinking Test Automation -- w/ State of Visual Tes...
PDF
How to Introduce Continuous Delivery
PDF
Test Automation Trends and Beyond
PDF
Measuring your way_to_successful_automation_webinar
PDF
Your Framework for Success: introduction to JavaScript Testing at Scale
API Testing With Katalon Studio
ATAGTR2017 Batch Workload Modelling and Performance Optimization
Be a User first; then a Tester
ATAGTR2017 Detect Layout Bugs by Simulating Human Eye
Use Automation to Assist -Not Replace- Manual Testing
Modern Functional Test Automation Through Visual AI - webinar w/ Raja Rao
From One Test To Test Framework With Rapise
Overview the Challenges and Limitations of Android App Automation with Espres...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How Vanguard Got to a CD-CD World by Craig Schwarzwald
Managers, Future Proof Your Automation
Automated Testing at The Speed of Headless by Alissa Lydon and Samantha Coffman
Kloia Quality Assurance
Test Automation Architecture
WiKi Based Automation Testing: Fitness & DevOps
Wrong Tool, Wrong Time: Re-Thinking Test Automation -- w/ State of Visual Tes...
How to Introduce Continuous Delivery
Test Automation Trends and Beyond
Measuring your way_to_successful_automation_webinar
Your Framework for Success: introduction to JavaScript Testing at Scale
Ad

Viewers also liked (17)

PPTX
ATAGTR2017 Test the REST
PPTX
ATAGTR2017 Testing in DevOps Culture
PPTX
ATAGTR2017 Be a User first, then a tester!
PPTX
ATAGTR2017 Analytics Testing
PPTX
ATAGTR2017 Static and dynamic code analysis for mobile applications - Act ear...
PPTX
ATAGTR2017 Estimation in Agile Testing - Not a big deal rather it's Fun
PPTX
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
PPT
ATAGTR2017 Bee-Hive approach for Big Data Testing [End to End Continuous Test...
PPTX
ATAGTR2017 Security Test Driven Development (STDD)
PPTX
ATAGTR2017 An Innovative Take on Versa Test
PPTX
ATAGTR2017 Differentiation using Testing Tools and Automation in the BFS COTS...
PPTX
ATAGTR2017 Machine Learning telepathy for Shift Right approach of testing
PPTX
ATAGTR2017 Blockchain Based Testing
PPTX
ATAGTR2017 Security Testing / IoT Testing in Real World
PPTX
ATAGTR2017 Performance Testing and Non-Functional Testing Strategy for Big Da...
PPT
BDD along with Continuous Integration
PPTX
Test Engagement - Vishal Prasad
ATAGTR2017 Test the REST
ATAGTR2017 Testing in DevOps Culture
ATAGTR2017 Be a User first, then a tester!
ATAGTR2017 Analytics Testing
ATAGTR2017 Static and dynamic code analysis for mobile applications - Act ear...
ATAGTR2017 Estimation in Agile Testing - Not a big deal rather it's Fun
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
ATAGTR2017 Bee-Hive approach for Big Data Testing [End to End Continuous Test...
ATAGTR2017 Security Test Driven Development (STDD)
ATAGTR2017 An Innovative Take on Versa Test
ATAGTR2017 Differentiation using Testing Tools and Automation in the BFS COTS...
ATAGTR2017 Machine Learning telepathy for Shift Right approach of testing
ATAGTR2017 Blockchain Based Testing
ATAGTR2017 Security Testing / IoT Testing in Real World
ATAGTR2017 Performance Testing and Non-Functional Testing Strategy for Big Da...
BDD along with Continuous Integration
Test Engagement - Vishal Prasad
Ad

Similar to ATAGTR2017 Performance Automation in Dev-Ops (20)

PPTX
Best Practices for a Repeatable Shift-Left Commitment
PDF
Agile Testing 2020
PDF
End-end tests as first class citizens - SeleniumConf 2020
PPTX
QASymphony Atlanta Customer User Group Fall 2017
PDF
Innovation in Action - #MFSummit2017
PPT
Test automation lessons from WebSphere Application Server
PDF
QA Role in Agile Teams
PPTX
Streamlining Testing with Visual Studio 2012
PPTX
Agile testing MyBTEC
PPTX
Neev Independent Testing Services
PPTX
Change management in hybrid landscapes
PDF
Continuous Testing of Cloud Applications
PPT
QA Role In Agile Teams - by Michael Hall
PDF
AgileTesting_Ver1.0
PDF
Continuous Delivery for Front-End Engineers
PPTX
Salesforce Continuous Integration with AutoRABIT
PPTX
Performance engineering10042915
PPT
SOASTA Webinar: Process Compression For Mobile App Dev 120612
PPTX
Zero touch QA automation platform for DevOps
PDF
Enterprise QA and Application Testing Services
Best Practices for a Repeatable Shift-Left Commitment
Agile Testing 2020
End-end tests as first class citizens - SeleniumConf 2020
QASymphony Atlanta Customer User Group Fall 2017
Innovation in Action - #MFSummit2017
Test automation lessons from WebSphere Application Server
QA Role in Agile Teams
Streamlining Testing with Visual Studio 2012
Agile testing MyBTEC
Neev Independent Testing Services
Change management in hybrid landscapes
Continuous Testing of Cloud Applications
QA Role In Agile Teams - by Michael Hall
AgileTesting_Ver1.0
Continuous Delivery for Front-End Engineers
Salesforce Continuous Integration with AutoRABIT
Performance engineering10042915
SOASTA Webinar: Process Compression For Mobile App Dev 120612
Zero touch QA automation platform for DevOps
Enterprise QA and Application Testing Services

More from Agile Testing Alliance (20)

PPTX
#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...
PDF
#Interactive Session by Ajay Balamurugadas, "Where Are The Real Testers In T...
PPTX
#Interactive Session by Jishnu Nambiar and Mayur Ovhal, "Monitoring Web Per...
PDF
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...
PDF
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...
PPTX
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.
PPTX
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...
PPTX
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...
PDF
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...
PPTX
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...
PPTX
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...
PPTX
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
PPTX
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...
PDF
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...
PPTX
#Interactive Session by Saby Saurabh Bhardwaj, "Redefine Quality Assurance –...
PDF
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...
PDF
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.
PPTX
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...
PDF
#Interactive Session by Aniket Diwakar Kadukar and Padimiti Vaidik Eswar Dat...
PPTX
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...
#Interactive Session by Anindita Rath and Mahathee Dandibhotla, "From Good to...
#Interactive Session by Ajay Balamurugadas, "Where Are The Real Testers In T...
#Interactive Session by Jishnu Nambiar and Mayur Ovhal, "Monitoring Web Per...
#Interactive Session by Pradipta Biswas and Sucheta Saurabh Chitale, "Navigat...
#Interactive Session by Apoorva Ram, "The Art of Storytelling for Testers" at...
#Interactive Session by Nikhil Jain, "Catch All Mail With Graph" at #ATAGTR2023.
#Interactive Session by Ashok Kumar S, "Test Data the key to robust test cove...
#Interactive Session by Seema Kohli, "Test Leadership in the Era of Artificia...
#Interactive Session by Ashwini Lalit, RRR of Test Automation Maintenance" at...
#Interactive Session by Srithanga Aishvarya T, "Machine Learning Model to aut...
#Interactive Session by Kirti Ranjan Satapathy and Nandini K, "Elements of Qu...
#Interactive Session by Sudhir Upadhyay and Ashish Kumar, "Strengthening Test...
#Interactive Session by Sayan Deb Kundu, "Testing Gen AI Applications" at #AT...
#Interactive Session by Dinesh Boravke, "Zero Defects – Myth or Reality" at #...
#Interactive Session by Saby Saurabh Bhardwaj, "Redefine Quality Assurance –...
#Keynote Session by Sanjay Kumar, "Innovation Inspired Testing!!" at #ATAGTR2...
#Keynote Session by Schalk Cronje, "Don’t Containerize me" at #ATAGTR2023.
#Interactive Session by Chidambaram Vetrivel and Venkatesh Belde, "Revolution...
#Interactive Session by Aniket Diwakar Kadukar and Padimiti Vaidik Eswar Dat...
#Interactive Session by Vivek Patle and Jahnavi Umarji, "Empowering Functiona...

Recently uploaded (20)

PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Approach and Philosophy of On baking technology
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Encapsulation theory and applications.pdf
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PPTX
Big Data Technologies - Introduction.pptx
PDF
Empathic Computing: Creating Shared Understanding
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PPTX
Cloud computing and distributed systems.
PDF
cuic standard and advanced reporting.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Machine learning based COVID-19 study performance prediction
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Modernizing your data center with Dell and AMD
Review of recent advances in non-invasive hemoglobin estimation
Mobile App Security Testing_ A Comprehensive Guide.pdf
Approach and Philosophy of On baking technology
The Rise and Fall of 3GPP – Time for a Sabbatical?
Encapsulation theory and applications.pdf
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Big Data Technologies - Introduction.pptx
Empathic Computing: Creating Shared Understanding
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Cloud computing and distributed systems.
cuic standard and advanced reporting.pdf
Encapsulation_ Review paper, used for researhc scholars
Per capita expenditure prediction using model stacking based on satellite ima...
Machine learning based COVID-19 study performance prediction
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Reach Out and Touch Someone: Haptics and Empathic Computing
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
Modernizing your data center with Dell and AMD

ATAGTR2017 Performance Automation in Dev-Ops

  • 1. #ATAGTR2017 16th - 17th March Performance Testing in DEV OPs Sandeep Patil Gorakshnath Dorge
  • 2. Agile Testing Alliance Global Testing Retreat 2017 Agenda  Automated Performance Testing  Approach to automate Performance Testing  Performance Testing using Jenkins  Advantages  Limitations  Q&A
  • 3. Agile Testing Alliance Global Testing Retreat 2017 • Reduces efforts in Testing. • Adoption of Agile Methodology. • Regression can be easily spotted. • Decision on Production Deployment.  Automated Performance Testing
  • 4. Agile Testing Alliance Global Testing Retreat 2017 • Use Plugins for Jenkins. • Plugins for Jmeter/Silk Performer/Load Runner. • Develop your own programs to work with Jenkins. • Java/Node js/Python Code  Approaches
  • 5. Agile Testing Alliance Global Testing Retreat 2017 • Identify Critical Use Cases. • Automate business critical use cases using SP. • Run automation in Pre-Prod / QA environments. • Invoke automations through Jenkins • Results • Parse the results using java/python program. • Send the results to stake holders. • Decide go / no - go to Prod.  Performance Testing In Pipeline
  • 6. Agile Testing Alliance Global Testing Retreat 2017  Deployment In Jenkins
  • 7. Agile Testing Alliance Global Testing Retreat 2017 • Run automation in Pre-Prod / QA environments. • Invoke automations through Jenkins  Performance Testing In Pipeline
  • 8. Agile Testing Alliance Global Testing Retreat 2017 • Run automation in Pre-Prod / QA environments. • Invoke automations through Jenkins  Performance Testing In Pipeline
  • 9. Agile Testing Alliance Global Testing Retreat 2017 • Results • Parse the results using java program. • Send the results to stake holders. • Decide go / no - go to Prod.  Performance Testing In Pipeline
  • 10. Agile Testing Alliance Global Testing Retreat 2017 • Offhand warning before push to production. • Regression can be caught easily. • Advantages of automation • No manual efforts • Production push can be done anytime • For application adopting agile methodology . Automated performance testing helps developer to optimize performance issues arising by addition of new features during sprints.  Advantages
  • 11. Agile Testing Alliance Global Testing Retreat 2017 • Creating and editing SP scripts manually. • Validating scripts manually in case of code/call changes. • Silk Performer Plugin Limitations. • Monitoring required • Automation Server is down. • Automation Stuck then kill manually.  Limitations
  • 12. Agile Testing Alliance Global Testing Retreat 2017 • Shift Left • Push results into database so that the historical data can be obtained anytime required. • Automating the resources utilization stats.  Future Plans
  • 13. Agile Testing Alliance Global Testing Retreat 2017 Q & A Thank You!