Service Virtualization: What, Who, When, and How
- 1. W8 Test Techniques 10/4/17 13:45 Service Virtualization: What, Who, When, and How Presented by: Kenneth Merkel CA Technologies Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888-‐-‐-‐268-‐-‐-‐8770 ·∙·∙ 904-‐-‐-‐278-‐-‐-‐0524 -‐ info@techwell.com -‐ http://www.starwest.techwell.com/
- 2. Kenneth Merkel CA Technologies Kenneth Merkel’s twenty-‐two year IT career has covered development, test, and operations. From developing in the telecommunications industry to helping customers with development platforms, testing frameworks, and operations platforms for monitoring applications, Kenneth has spanned the entire SDLC. For the past seven years Kenneth has focused on service virtualization at both iTKO and now CA following the acquisition. Kenneth has been addressing customers in multiple industries about the need for service virtualization, which he views as the cornerstone for continuous delivery and continuous testing. Kenneth enjoys spending time with his wife and four-‐year-‐old daughter—with an occasional round of golf thrown in.
- 3. 1 The What, Why, Who and How of Service Virtualization October 2017 Removing Constraints for Continuous Testing © 2017 CA. Confidential. All rights reserved. About Me! • 21 year IT career – development, test, and operations. • Past 7 years focused on Service Virtualization • Addressing customers in multiple industries about the need for service virtualization – The cornerstone for continuous delivery and continuous testing. • Fun = time with wife + 4 Yr. old daughter ~ occasional round of golf
- 4. 2 © 2017 CA. Confidential. All rights reserved. About You… How many Developers? Integration vs. Performance…? How many Testers? © 2017 CA. Confidential. All rights reserved. Agenda WHAT IS SERVICE VIRTUALIZATION? WHY DO I NEED SERVICE VIRTUALIZATION? WHO BENEFITS FROM SERVICE VIRTUALIZATION? HOW DO I BUILD VIRTUAL SERVICES? 1 2 3 4
- 5. 3 Application Complexity • Distributed System Progression • Integration of Legacy/3rd Party Systems • Agile Development Methods • Continuous Testing • Continuous Delivery What
- 6. 4 © 2017 CA. Confidential. All rights reserved. Service Virtualization Key Benefits • Provide testers and developers with access to “life-like” production systems • Replicate production like dependencies for testing • Mobile, Web, Middleware, Mainframe, 3rd Party Services and API’s • Test components out of order • Capture behavior data and performance characteristics of composite applications • Avoid manual repetitive development and management of wrappers, stubs & mocks • Eliminate false failures • Test earlier and reduce the amount of rework that has to be done in production Wikipedia - Service virtualization emulates the behavior of software components to remove dependency constraints on development and testing teams. Service virtualization extends across all aspects of composite applications: services, APIs, databases, mainframes, ESBs, and other components that communicate using common messaging protocols. © 2017 CA. Confidential. All rights reserved. Service Virtualization Basics TAKEAWAY § Service Virtualization Improves – Environment Availability – Load and Performance Testing – Data and Test Scenario Management – Delivery Schedules MESSAGE § Service Virtualization removes constraints by simulating constrained or unavailable systems. Development and test teams are able to work in a constraint-free environments and experience significant gains in efficiency § Service Virtualization creates an accurate rendering of dependent systems allowing developments team to find and resolve defects earlier in the SDLC, saving time and money. METRICS § 25-50% reduction in application development schedule § 60-90% more defects detected at least one step earlier in the software development lifecycle § Customers have saved millions of dollars, in development and test lab hardware, software, maintenance, and 3rd party access fees
- 7. 5 © 2017 CA. Confidential. All rights reserved. What’s the Difference Between Stubs, Mocks, and Service Virtualization? © 2017 CA. Confidential. All rights reserved. Service Virtualization Destroys Stubs and Mocks Critical Dev./Test Feature Service Virtualization Stubs and Mocks Reduce dependencies and constraints in application development Automated creation of simulated system Rich test data for comprehensive testing early in SDLC Share virtual services across entire development team—not trapped in a single sandbox Know that your code will scale in production Changes to any dependent systems (mainframe, ERP, middleware, 3rd party) are automatically synced…teams focus on building solutions vs. maintenance Wizard-based UI for use by all team members regardless of coding skill
- 8. 6 Why © 2017 CA. Confidential. All rights reserved. Service Virtualization: Why It’s Needed “I can’t do anything until I have everything … and I never have everything!” Data Constraints System Constraints Cost Constraints Development Constraints Bottlenecks Everywhere ESB of teams experience delays in development and QA due to unavailable dependencies* Over 80% 79% of teams face prohibitive restrictions, time limits or access fees on needed 3rd party services* *Source: voke Market Snapshot TM Report: ServiceVirtualization – January 2015 AccesstoTest Environments/ BrittleStubs& Mocks Developers Deadlocked
- 9. 7 © 2017 CA. Confidential. All rights reserved. 7 Common Service Virtualization Use Cases Training Environments Create complete and comprehensive virtual training environments “Business In a Box” Use SV for Integration constraints 3rd Party APIs Use SV to remove access and cost constraints. Mainframe Constraints Eliminate mainframe constraints for both distributed and mainframe development Negative Scenarios Use SV to enable Negative Scenario Testing Performance Constraints Stress test applications components using virtual services Time Constraints Use SV to “Shift-Left” your SDLC, customers have shown 25%-50% faster © 2017 CA. Confidential. All rights reserved. EMA – DevOps/CD Tooling Survey Of the following application delivery-related practices and capabilities, please indicate the top 3 that are most important to your company's Digital Business? Enterprise Management Associates - Analyst Deck – April 2017 32% 30% 28% 26% 25% 25% 24% 24% 20% 19% 18% DevOps Integrations unifying and/or sharing data in existing mgt. tools across stages of the app lifecycle Continuous Delivery of new code and features into production Integrations capable of unifying and/or sharing data during production Process and/or workflow automation Deployment automation Agile Development Automated Application Performance Management (APM) tools supporting production applications Continuous delivery-related productivity metrics Development-related productivity metrics Structured, predictable Release Management processes
- 10. 8 © 2017 CA. Confidential. All rights reserved. Distributed Teams • Remove constraints with virtual services • Test components out of order • Capture behavior data and performance characteristics of composite applications • Avoid manual repetitive development of stubs or mockups • Mobile, Web, Middleware, Mainframe, 3rd Party Services and API’s Virtual Services Components Set-Up Test Environment Test Data Systems and Services Integration Testing Create test environments that exactly replicate production infrastructure. • Cut integration time from three days to three hours • Avoided $300,000 in test hardware and software costs • Decreased software defects by 25 percent hours AutoTrader STABILITY “CA Service Virtualization gives us a more stable and available environment for Testing” Increase availability of testing platforms up to 90% Enable Agile Testing Sprints KPN Telecommunications Save $2.5 million in infrastructure Cut overall development cycle by 66% NordstromForrester TEI Study November 2015 © 2017 CA. Confidential. All rights reserved. ü Use the same tests used for functional test ü Virtual services for performance ü Engineering ü Simulate backend load ü Outlier conditions ü Mobile experience Establish IT as an Enabler of growth 1 x 500 throughput increase in testing Eliminate capacity constraints for performance testing Reduce delays with high-performance masking and sub-setting, and automated data discovery Nordstrom SPEED “CA Service Virtualization helps us bring better applications to market faster and establish our IT function as an enabler of business growth” • Reduced performance testing time from 3 months to an average of 4 days • Cut overall development cycle by 66% Application “X” BillMeLater PayPal TNT Express 3rd Party Service Current Testing Tools Thousands of transactions Test Data Performance Testing Innovate Faster while Delivering a High Quality Experience
- 11. 9 © 2017 CA. Confidential. All rights reserved. New Innovation Paradigm “Shift-left” the SDLC Without SV WITH SV Dev1 Dev2 Dev3 System Test Integration Performance Test UAT System Dev 1 Dev 2 Dev 1 Dev 3 Dev 2 Dev 3 Integration Performance UAT… Uncertain delivery schedule – defects persist until UAT Typical composite app today waits for whole assembly to begin With Service Virtualization quality effort moved earlier in the lifecycle Reduction in SDLC Faster Delivery Accelerate Delivery Increase Quality Who
- 12. 10 © 2017 CA. Confidential. All rights reserved. • Enable Parallel Development • Eliminate Mocking/ Stubbing • Build True Release Candidate • Reproduce Production Defects • Minimize System Availability Wait Time DEVELOPERS • Eliminate Wait Time • Minimize Test Data Setup • Eliminate Test Data Burn • Negative Test Coverage • Provide Stable Test Environment INTEGRATION TESTER • Reduce Infrastructure Costs • Eliminate Environment Sharing • Improved Scalability • Reduce Transaction Costs PERFORMANCE TESTER Who Benefits from Service Virtualization How
- 13. 11 © 2017 CA. Confidential. All rights reserved. Service Virtualization Having Everything you need, when you need them. Front End Back End Internet of Things Mobile SaaS/Cloud Partner Ecosystems External Developers Secure Environments Applications ERP/SAP Mainframe 3rd Party/APIs Orchestration Layer Performance Testing § Provide end-to-end security for apps, mobile, and IoT § Control access with SSO and identity management § Protect against threads and OWASP vulnerabilities Integration Testing § Remove constraints with virtual services § Avoid manual repetitive development of stubs/mocks § Simulate web services, Middleware, 3rd Party, APIs, or Mainframe Better Quality § Test sooner and more often § Increase test coverage and negative testing capabilities § Find up to 90% more defects at least one cycle earlier Faster Time to Market § Always available resources to continue work § No waiting for backend or 3rd party resources needed § Speed Software Development Lifecycle by up to 50% © 2017 CA. Confidential. All rights reserved. Service Virtualization: How Does it Work? Evaluate data and protocols Convert into live-like model “Make it easy” for developers Consistent interface across supported protocols CAPTURE PROCESS MODEL Record traffic between existing systems Create from engineering specs Draw from sources such as log files, sample data, packet capture, and CA APIM Gateway Living, breathing, “live” model Sophisticated, contextual behavior Automatic handling for dynamic properties “Any sufficiently advanced technology is indistinguishable from magic.” - Arthur C. Clarke
- 14. 12 Thank You.