Transform Software Testing and Quality with the Neotys-Inflectra Platform

Editor's Notes

• #15: Our mission at Neotys is to help organizations accelerate Agile/DevOps with more performance testing, in less time – which means testing, and improving performance at every stage of the application development lifecycle, and doing this sooner and more frequently We deliver this value with our load testing platform NeoLoad available for testers, developers and every person involved in performance engineering through a all channel required to fit with their development processes: web/SaaS/On premise platform, cloud and/or on premise load generation, integration with other systems with the NeoLoad API Headquartered in France, we have offices around the globe – US east coast, India, UK, and Germany. We back-up our performance testing platform with a range of professional services: Performance testing as a service Consulting Neotys Academy – In-person/online training, certification Migration from legacy tools
• #16: The NeoLoad platform for performance feedback consists of three distinct arenas. Our core load testing components: controllers and load generators, provided as java installers and Docker containers NeoLoad Web, a browser-based solution to visualize load and performance testing trends and results in real-time and stream to other dashboards Our SaaS offerings: a hosted version of NeoLoad Web and a global network of always-ready load generators in data centers around the world Both NeoLoad Web and our core components are programmatically addressable via RESTful APIs as well as through CLI execution
• #18: NeoLoad is not just a cheaper alternative to HP LoadRunner – NeoLoad is a justifiably better load and performance testing tool for web, mobile, and other digital applications. This is especially true for applications developed in fast-paced environments practicing DevOps or Agile methodologies. Faster Test Design Most testing tools (including LoadRunner) have a GUI with record and playback capabilities that require some coding to further customize scripts, but NeoLoad is different because there’s no coding required at all. Correlation can be run automatically at the end of each recording, parameterization and randomization of variables takes just a few clicks, and logical actions are all drag and drop. Customers tell us they’re 5-10 times faster at designing tests than they were with LoadRunner. Script Maintenance Automation Any regular LoadRunner user knows just how long it takes to maintain scripts that break any time their applications change. What good is running automated performance tests if your scripts break and it takes forever to fix them? That’s why NeoLoad has a user path update feature that allows you to update a designed script with a quick recording and automatically keep variable extractors, think times, SLAs, logical actions, javascript, validations and more from the original user path design. This makes the script maintenance process 20 times faster so that performance testing can actually keep pace in Continuous Integration/Continuous Deployment environments. Cheaper License, Much Higher ROI Even if HP throws a fairly significant discount at you, the cost of a NeoLoad license is typically around one quarter the cost of a LoadRunner license. When you combine this with the huge efficiency gains you get with NeoLoad, the return on investment is massive. For example: if you’re able to run 20 tests with NeoLoad in the same amount of time that it takes to run 4 tests with LoadRunner when the license cost is 4 times more with LoadRunner, your cost per test is 20 times more expensive with LoadRunner than it would be with NeoLoad.
• #19: Load testing is becoming more critical in todays SDLC, and also more complex because Test cycles are becoming shorter with Agile and the requirement to release faster Competion requires accelerated pace of digital innovation, for both customer facing and internal applications. Organizations adopt Agile and Devops as an answer to release faster and more regularly • QA needs to be able to ensure quality at the pace of development • This trend means you need to TEST FASTER 2) Testing is more complex as applications become more complex. 3) Speed and reliability of the application is critical to the user – so you need to test more as user expectations are raising. • User expectations re: application performance are extremely high – seamless across devices • Delivering applications which fail to meet user expectations can have crippling impact on the business: - Loss of revenue - User attrition/defection to competitor apps - Brand degradation Lost productivity for internal apps When performance testing is done late in the SDLC (Pre-production) and defects are found, 100% of performance defects needed to be resolved in the production environment. In companies that implement a “Shift left, continuous testing approach, where performance considerations are taken into account at every stage of the life cycle, about 5% of performance defects need to be resolved in the production environment post-deployment. Relative Cost of Fixing Defects A study was performed by the IBM System Science Institute in order determine the relative cost in order to fix defects within the SDLC. The study concluded that defects found in testing were 15 times more costly than if they were found during the design phase and 2 times more than if found during implementation. (Source: IBM System Science Institute) https://www.researchgate.net/publication/255965523_Integrating_Software_Assurance_into_the_Software_Development_Life_Cycle_SDLC It is commonly believed that the earlier a defect is found the cheaper it is to fix it. For example, if a problem in the requirements is found only post-release, then it would cost 10–100 times more to fix than if it had already been found by the requirements review.” – (Source: Code Complete 2nd Edition, Steve McConnell) Key benefits of using Continuous Performance Testing include:   Finding and Resolve Issues Earlier - Issues can be found at an earlier stage in the SDLC, then fixed quicker and at lower cost Faster Release Cycles - The automation built into leading-edge performance testing platforms save a huge amount of time. With this approach, testing becomes just another part of the build - not a manual step performed as an afterthought Deploy with Confidence & Lower Risk- Improved code quality since everything is KNOW to perform as designed - under real-world loads Success is based on the ability to deliver both high quality testing and speed. And this cannot be achieved with legacy methods and tools that make Performance testing the bottleneck in the SDLC! Be confident your applications will perform in production Leaders achieve Excellent performance testing while supporting the speed of Agile and this creates a competitive advantage for their organizations. No tradeoff
• #20: Organizations need to constantly monitor the performance of their applications, at every step of the Software Delivery Life Cycle (SDLC), from the development of the first component to the deployment of the end-to-end application in pre-production and production environments. NeoLoad supports continuous testing requirements from API testing to enable teams test earlier and identify performance issues as early as possible up to integration testing and to the large, complex end-to-end application performance and load testing to release with confidence in production. NeoLoad is fully integrated into CI/CD pipelines so performance testing can be embedded into automated processes and executed continuously to let teams track non-regression performance trends and make sure their code is still performing, day after day.
• #21: NeoLoad provides the best capabilities for API testing in terms of API technology support: SOAP and REST support Ease of use to create tests for developers who are the most likely to do API testing import swagger definitions to create scripts rapidly define test scripts as code, in a Dev environment (or use the NeoLoad GUI productivity if you prefer) Integration of API testing into a continuous process, fully automated CI/CD integration Automated pass/fail based on SLAs Automatic provisioning of dynamic load testing infrastructure/load generators Testing more than a standalone API Test a system of APIs with more complex scenarios Dev and QA use the same platform
• #22: Better Support for Web Technologies Neotys has consistently beaten HP to market with support for new web protocols (sometimes by 2-3 years!), but it’s more than just saying your tool is able to test a particular technology – it’s how well your tool is able to test that technology. Many current NeoLoad customers were once LoadRunner customers who made the switch because NeoLoad was able to more accurately capture and replay traffic from applications utilizing technologies like GWT, Oracle Forms, Flex, adaptive bitrate streaming and more. Out-of-the-box Support for Mobile Applications Every NeoLoad edition comes out-of-the-box with proxy recording of native mobile applications, mobile device simulation and network virtualization – no expensive mobile package to buy. You can even run tests with virtual mobile users on your web applications with just a few clicks.
• #23: NeoLoad’s “sweet spot” is in enabling large enterprises to secure their move to DevOps while ensuring testing of their legacy systems Enterprise requirements Large set of applications with wide business usage Wide coverage of technology Latest frameworks (AngularJS, Node.JS, WebSocket…) Enterprise apps (Oracle, SAP, Kronos…) Heterogeneous architectures and deployments (on-premise, public and private cloud applications)