SlideShare a Scribd company logo
Achieving Environment Stability  with  Performance On Demand V-Ness http://web.ness.com/forms/contact
Understanding the Stability of Your Environment How confident are you during environment transitions and releases? How often do changes (e.g. releases, upgrades, maintenance, issue handling) put your environment stability at risk? How important is environment stability to you? Have you ever suffered from unplanned downtime?   How difficult is it for you to investigate  accurately  the root cause of   instability of your environment?
Agenda Ness’ Testing Line of Business  Performance on Demand Performance Testing Environment Comparison Why Performance on Demand? Summary
Ness’ Testing Line Of Business
Our Advantages >15 years of experience 100s of successful projects Global backbone / local presence >2,000 testing engineers Broad technical know-how (e.g. databases, telecom networks, operating systems)
Our Expertise Managed   Services Test   Strategy Development SAP   Testing  Leader Test   Automation Aviation   &   Embedded   Systems Retail Banking Insurance Business segment expertise QA methodology expertise
Selected Customers
Performance on Demand
Testing on Demand Family of Services Performance On Demand Security Testing on Demand ELM and Environment Comparison on Demand Test Automation on Demand Functional Testing on Demand Daily Site Sanity Testing on Demand
Impact of Environment on Performance and Stability Development QA / UAT Pre-Production Production
Send Order Generate Load Collect Results Technical Infrastructure Based on Ness Global Spread Performance Testing and Application Monitoring  of Production Environments in Real-World Conditions  Internet Tested   Application NESS HQ - Performance COE
Scope of Services and Packages 5 Performance “dream team” 4 Ongoing (24/7) availability monitoring 3 Results analysis (end-to-end view) 1 Performance testing (load creation) 2 End-user view analysis
Benefits Technical Benefits Improved testing, monitoring and analysis Enhanced performance and uptime Worry-free testing and monitoring environment Increased confidence in application launch/adjustment  Business Benefits Significantly reduced TCO (~55%) Greater focus on core business area Increased customer loyalty Faster time to market
Performance Testing
Performance Testing Methods Load Test Stress Test Stability & MTBF Test Interactive Test Sessions Failover Test Targeted Infrastructure Test Performance Test Network Sensitivity Test Volume Test
Load Test End-to-end performance test based on anticipated production load in order to: determine response times for various time-critical transactions and business processes to ensure they meet service level agreement (SLA) measure the ability of Internet applications to function correctly under load by measuring transaction pass/fail/error rates Users Real World Load Test Elapsed Time
Stress Test Evaluate system’s behavior at or beyond the limits of its specified load and volume requirements, tracking the system until it either crashes or delivers abnormal response times Users Transaction Response Time Users Transaction Response Times Stress Test Test Elapsed Time Abnormal Response time Normal Response time Knee Point
Stability & MTBF Test System is run at high load levels for prolonged periods until it reaches failure so as to determine the mean time between failures (MTBF) Users Throughput Users Stability Test Test Elapsed Time(days:hours:minutes) Throughput 1:0:0 2:0:0 3:0:0 MTBF MTBF = 3days, 12h and 20m
Interactive Test Sessions A range of test sessions in which multiple test runs and re-runs are managed interactively with the customer: Failover Test Verification of redundancy mechanisms while the system is under load Targeted Infrastructure Test Isolation of each layer and/or component in an end-to-end application configuration Performance Test End-to-end timing (benchmarking) of various time-critical business processes and transactions while the system is under load with a production-sized database Network Sensitivity Test Set-up of various network activity scenarios (e.g. traffic, error rates), and measurement of their impact on a range of bandwidth-dependent applications Volume Test Measurement of batch processing under load
Environment Comparison
Environment Comparison Solution Overview Helps to achieve and maintain environment stability Identifies and analyzes changes and differences that put environment stability at risk by: comparing different environments comparing current environment with a historical snapshot or its golden baseline
End-to-End Environment Comparison Integrative, top-down comparison Compares entire environment – applications and their underlying software infrastructure stack Applications Front-end servers Middleware Databases Messaging layer  Operating systems Hardware Applies environment perspective rather than particular server or point technology Compares logical environment architecture (i.e. independent of physical topology)
In-Depth Comparison  “ The devil is in the details” Compares all facets of the environment Architecture  Configuration  Bill-of-materials Drills down to most granular level of configuration parameter in any configuration source Configuration files Registry Database schema / stored procedures Reference data in database Compares content of each environment component Version  Size Last modification
Comparison Analytics Application Focus only on the “important stuff” Applies comparison analytics in order to: Classify changes and differences by impact  Prioritize and highlight critical changes  Ignore insignificant changes  Compare inherently different environments (test vs. production) Visualizes comparison results for faster analysis Leverages customizable comparison logic to ensure meaningful comparison
Common Compression Scenarios  How companies use EVOLVEN Comparison Cut Release Deployment and Stabilization Time Compare  production  with  pre-production  environment after deployment to verify accurate transition of key release configurations  Cut Incident Investigation Time Compare  production  environment with a  golden baseline  to identify changes that might be causing the incident Cut Incident Investigation Time Compare a  non-working  environment with a  working  environment to identify configuration differences that might be causing the incident Avoid Risk of Negative Impact of Changes Compare  current  environment with its  historical snapshot  before a change in order to identify and review all granular impact points caused by the change Test/ Staging Production LIVE TEST Production Production LIVE Test/ Production Test/ Production   Test/ Production Test/ Production  
Why Performance on Demand?
Why Performance on Demand? Our experts  have   performed 100s of successful  on-site load tests  over the last 12 years
Why Performance on Demand? We provide load injectors worldwide, which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
Why Performance on Demand? We are committed to your performance improvement We provide load injectors worldwide,  which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
Why Performance on Demand? We provide external web load testing outside the firewall through the cloud We are committed to your performance improvement We provide load injectors worldwide,  which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
Why Performance on Demand? We provide internal load testing behind your firewall We provide external web load testing outside the firewall through the cloud We are committed to your performance improvement We provide load injectors worldwide,  which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
Holistic and Synergistic Offering Performance Testing Environment Comparison Holistic Performance Testing & Monitoring Solution
Summary Proven Testing Experience and Expertise Holistic Performance Testing & Application Monitoring Solution Performance Testing Environment Comparison Technical Benefits Improved testing, monitoring and analysis Enhanced performance and uptime Business Benefits Significantly reduced TCO (~55%) Greater focus on core business area
Thank You www.ness.com http://web.ness.com/forms/contact

More Related Content

PPTX
Performance Testing Principles
PPT
Graham Bath - SOA: Whats in it for Testers?
PPT
Performance Engineering Basics
PDF
Industrialization of testing
PPTX
Software Testing Services
PPTX
Rational Quality Manager
PPTX
An Introduction to Software Performance Engineering
PDF
Test factory approach to automated testing
Performance Testing Principles
Graham Bath - SOA: Whats in it for Testers?
Performance Engineering Basics
Industrialization of testing
Software Testing Services
Rational Quality Manager
An Introduction to Software Performance Engineering
Test factory approach to automated testing

What's hot (20)

PPTX
Performance & Automation Testing
PDF
Performance Testing - Keytorc Approach
PPTX
How to Fit Performance Testing into a DevOps Environment
PPTX
Software Testing Services | Best software testing consulting companies
PPT
Collaborative Quality Management
PPT
Rational Quality Manager
PDF
Automate virtualize and smart test the new testing realities
PPTX
Healthcare IT testing | QualiTest
PPT
6.11.2013 - 2013 - Continuous Delivery - Testing for Agile Through Continuo...
PDF
Reducing the complexity of your Enterprise Packaged Application Automation Te...
PDF
Top 8 Trends in Performance Engineering
PDF
Prolifics Level 2 Test Lifecycle Automation Services Star West
PPT
Edwin Van Loon - Exploitation Testing revised
PPTX
Brave New World - A wider perspective of our opportunities
PPTX
T19 performance testing effort - estimation or guesstimation revised
PPTX
Achieve Performance Testing Excellence for Your SAP Apps
PPTX
Software Testing Competencies - Rishabh Software
PPT
Nuevosoft Test Manager Overview
PDF
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
PPTX
qTest 7.4: New Features
Performance & Automation Testing
Performance Testing - Keytorc Approach
How to Fit Performance Testing into a DevOps Environment
Software Testing Services | Best software testing consulting companies
Collaborative Quality Management
Rational Quality Manager
Automate virtualize and smart test the new testing realities
Healthcare IT testing | QualiTest
6.11.2013 - 2013 - Continuous Delivery - Testing for Agile Through Continuo...
Reducing the complexity of your Enterprise Packaged Application Automation Te...
Top 8 Trends in Performance Engineering
Prolifics Level 2 Test Lifecycle Automation Services Star West
Edwin Van Loon - Exploitation Testing revised
Brave New World - A wider perspective of our opportunities
T19 performance testing effort - estimation or guesstimation revised
Achieve Performance Testing Excellence for Your SAP Apps
Software Testing Competencies - Rishabh Software
Nuevosoft Test Manager Overview
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
qTest 7.4: New Features
Ad

Viewers also liked (13)

PDF
Avatarsoftdd 090918055018 Phpapp02
PPS
Positive Attitude
PPT
Welcome To Valgu
PPS
Technology & innovation human ingenuity teacher guided visit pre or post-vis...
PDF
Auditoria Informatica
PPT
An Abundant Retirement
PDF
Mynewsdesk Multichannel Storytelling
PDF
Innovate or Die
PPTX
Innovative vs Status Quo Brands
PDF
Innovation imperative a battle for survival.ppt
PDF
NNOVATE FAST OR DIE SLOWLY: KoKo Vortrag gemeinsam mit unserem Kunden PRIMACOM
PDF
Quality is a Mindset
PPTX
Organizational Culture
Avatarsoftdd 090918055018 Phpapp02
Positive Attitude
Welcome To Valgu
Technology & innovation human ingenuity teacher guided visit pre or post-vis...
Auditoria Informatica
An Abundant Retirement
Mynewsdesk Multichannel Storytelling
Innovate or Die
Innovative vs Status Quo Brands
Innovation imperative a battle for survival.ppt
NNOVATE FAST OR DIE SLOWLY: KoKo Vortrag gemeinsam mit unserem Kunden PRIMACOM
Quality is a Mindset
Organizational Culture
Ad

Similar to Performance On Demand (20)

PPT
T3 Consortium's Performance Center of Excellence
PDF
Performance testing methodologies and tools
PDF
11.performance testing methodologies and tools
PPS
Performance Test Slideshow R E C E N T
PPS
Performance Test Slideshow Recent
PPT
Performance testing : An Overview
PPT
Performance Testing Overview
PPTX
Performance testing
PPTX
Performance testing basics
PPT
Best Practices In Load And Stress Testing Cmg Seminar[1]
PPT
Performance and load testing
PDF
Door to perfomance testing
PPT
PPT
Less11 3 e_loadmodule_1
PDF
Performance testing methodologies
PPTX
Testing ppts 20 march
PPTX
05. performance-concepts
PPTX
Introduction to performance testing
PPT
Are You Ready For More Visitors Cognizant Gomez Jan20
PPT
Magical Performance tuning with Gomez
T3 Consortium's Performance Center of Excellence
Performance testing methodologies and tools
11.performance testing methodologies and tools
Performance Test Slideshow R E C E N T
Performance Test Slideshow Recent
Performance testing : An Overview
Performance Testing Overview
Performance testing
Performance testing basics
Best Practices In Load And Stress Testing Cmg Seminar[1]
Performance and load testing
Door to perfomance testing
Less11 3 e_loadmodule_1
Performance testing methodologies
Testing ppts 20 march
05. performance-concepts
Introduction to performance testing
Are You Ready For More Visitors Cognizant Gomez Jan20
Magical Performance tuning with Gomez

Performance On Demand

  • 1. Achieving Environment Stability with Performance On Demand V-Ness http://web.ness.com/forms/contact
  • 2. Understanding the Stability of Your Environment How confident are you during environment transitions and releases? How often do changes (e.g. releases, upgrades, maintenance, issue handling) put your environment stability at risk? How important is environment stability to you? Have you ever suffered from unplanned downtime? How difficult is it for you to investigate accurately the root cause of instability of your environment?
  • 3. Agenda Ness’ Testing Line of Business Performance on Demand Performance Testing Environment Comparison Why Performance on Demand? Summary
  • 4. Ness’ Testing Line Of Business
  • 5. Our Advantages >15 years of experience 100s of successful projects Global backbone / local presence >2,000 testing engineers Broad technical know-how (e.g. databases, telecom networks, operating systems)
  • 6. Our Expertise Managed Services Test Strategy Development SAP Testing Leader Test Automation Aviation & Embedded Systems Retail Banking Insurance Business segment expertise QA methodology expertise
  • 9. Testing on Demand Family of Services Performance On Demand Security Testing on Demand ELM and Environment Comparison on Demand Test Automation on Demand Functional Testing on Demand Daily Site Sanity Testing on Demand
  • 10. Impact of Environment on Performance and Stability Development QA / UAT Pre-Production Production
  • 11. Send Order Generate Load Collect Results Technical Infrastructure Based on Ness Global Spread Performance Testing and Application Monitoring of Production Environments in Real-World Conditions Internet Tested Application NESS HQ - Performance COE
  • 12. Scope of Services and Packages 5 Performance “dream team” 4 Ongoing (24/7) availability monitoring 3 Results analysis (end-to-end view) 1 Performance testing (load creation) 2 End-user view analysis
  • 13. Benefits Technical Benefits Improved testing, monitoring and analysis Enhanced performance and uptime Worry-free testing and monitoring environment Increased confidence in application launch/adjustment Business Benefits Significantly reduced TCO (~55%) Greater focus on core business area Increased customer loyalty Faster time to market
  • 15. Performance Testing Methods Load Test Stress Test Stability & MTBF Test Interactive Test Sessions Failover Test Targeted Infrastructure Test Performance Test Network Sensitivity Test Volume Test
  • 16. Load Test End-to-end performance test based on anticipated production load in order to: determine response times for various time-critical transactions and business processes to ensure they meet service level agreement (SLA) measure the ability of Internet applications to function correctly under load by measuring transaction pass/fail/error rates Users Real World Load Test Elapsed Time
  • 17. Stress Test Evaluate system’s behavior at or beyond the limits of its specified load and volume requirements, tracking the system until it either crashes or delivers abnormal response times Users Transaction Response Time Users Transaction Response Times Stress Test Test Elapsed Time Abnormal Response time Normal Response time Knee Point
  • 18. Stability & MTBF Test System is run at high load levels for prolonged periods until it reaches failure so as to determine the mean time between failures (MTBF) Users Throughput Users Stability Test Test Elapsed Time(days:hours:minutes) Throughput 1:0:0 2:0:0 3:0:0 MTBF MTBF = 3days, 12h and 20m
  • 19. Interactive Test Sessions A range of test sessions in which multiple test runs and re-runs are managed interactively with the customer: Failover Test Verification of redundancy mechanisms while the system is under load Targeted Infrastructure Test Isolation of each layer and/or component in an end-to-end application configuration Performance Test End-to-end timing (benchmarking) of various time-critical business processes and transactions while the system is under load with a production-sized database Network Sensitivity Test Set-up of various network activity scenarios (e.g. traffic, error rates), and measurement of their impact on a range of bandwidth-dependent applications Volume Test Measurement of batch processing under load
  • 21. Environment Comparison Solution Overview Helps to achieve and maintain environment stability Identifies and analyzes changes and differences that put environment stability at risk by: comparing different environments comparing current environment with a historical snapshot or its golden baseline
  • 22. End-to-End Environment Comparison Integrative, top-down comparison Compares entire environment – applications and their underlying software infrastructure stack Applications Front-end servers Middleware Databases Messaging layer Operating systems Hardware Applies environment perspective rather than particular server or point technology Compares logical environment architecture (i.e. independent of physical topology)
  • 23. In-Depth Comparison “ The devil is in the details” Compares all facets of the environment Architecture Configuration Bill-of-materials Drills down to most granular level of configuration parameter in any configuration source Configuration files Registry Database schema / stored procedures Reference data in database Compares content of each environment component Version Size Last modification
  • 24. Comparison Analytics Application Focus only on the “important stuff” Applies comparison analytics in order to: Classify changes and differences by impact Prioritize and highlight critical changes Ignore insignificant changes Compare inherently different environments (test vs. production) Visualizes comparison results for faster analysis Leverages customizable comparison logic to ensure meaningful comparison
  • 25. Common Compression Scenarios How companies use EVOLVEN Comparison Cut Release Deployment and Stabilization Time Compare production with pre-production environment after deployment to verify accurate transition of key release configurations Cut Incident Investigation Time Compare production environment with a golden baseline to identify changes that might be causing the incident Cut Incident Investigation Time Compare a non-working environment with a working environment to identify configuration differences that might be causing the incident Avoid Risk of Negative Impact of Changes Compare current environment with its historical snapshot before a change in order to identify and review all granular impact points caused by the change Test/ Staging Production LIVE TEST Production Production LIVE Test/ Production Test/ Production   Test/ Production Test/ Production  
  • 27. Why Performance on Demand? Our experts have performed 100s of successful on-site load tests over the last 12 years
  • 28. Why Performance on Demand? We provide load injectors worldwide, which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
  • 29. Why Performance on Demand? We are committed to your performance improvement We provide load injectors worldwide, which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
  • 30. Why Performance on Demand? We provide external web load testing outside the firewall through the cloud We are committed to your performance improvement We provide load injectors worldwide, which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
  • 31. Why Performance on Demand? We provide internal load testing behind your firewall We provide external web load testing outside the firewall through the cloud We are committed to your performance improvement We provide load injectors worldwide, which you can use immediately Our experts have performed 100s of successful on-site load tests over the last 12 years
  • 32. Holistic and Synergistic Offering Performance Testing Environment Comparison Holistic Performance Testing & Monitoring Solution
  • 33. Summary Proven Testing Experience and Expertise Holistic Performance Testing & Application Monitoring Solution Performance Testing Environment Comparison Technical Benefits Improved testing, monitoring and analysis Enhanced performance and uptime Business Benefits Significantly reduced TCO (~55%) Greater focus on core business area
  • 34. Thank You www.ness.com http://web.ness.com/forms/contact