Virtualization: Improve Speed and Increase Quality
- 1. W8 Test Techniques 10/15/2014 1:45:00 PM Virtualization: Improve Speed and Increase Quality Presented by: Clint Sprauve HP Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
- 2. Clint Sprauve HP Clint Sprauve is the senior product marketing manager for HP Software Functional Testing. Previously, Clint was the director of product strategy for the Borland Solutions division of Micro Focus, where he created Borland’s mobile strategy for functional test automation. With more than twenty years of experience in the software development and quality assurance industry, Clint has served as the senior product marketing manager for the Silk Testing Solutions at Borland Software and Segue Software, and as a senior technical sales engineer for both companies. He has been an independent consultant, specializing in test management and test automation.
- 3. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Virtualization: ImproveSpeed, IncreaseQuality ClintSprauve-HP ProductMarketingManager,FunctionalTesting © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 4. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2 Today’s Agenda • Industry TestingCchallenges • Agile Testing Challenges • Service Virtualization • Network Virtualization • Q&A
- 5. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3 About HP Software Top10 Software company 95% Customer satisfaction 7,000 technologists driving innovation #1 in each of our categories #2 Customers 50,000+ 94% of Fortune 100 10+ years delivering SaaS Software
- 6. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4 Surging application numbers A tipping point for application delivery 2010 4 per app 2015 36 per app 2020 120 per app “60% of on-line devices are now smartphones are tablets” – Business Intelligence “In 2016, total global mobile application revenue will reach estimated $46 billion.” --ABI Research 2013 Number of releases per app per year • Apps everywhere • Accessed through multiple devices • 30x increase in application releases • Closed feedback loop with customers • Focus on time-to-value and ROI What we expect:
- 7. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5 Composite applications? Search Product Pay Payment Buy Ship Shipping Track Track package Public cloudTraditionalManaged cloudComposite Business processes are often an integration of existing components and services Example: The online shopping process Each of these steps are interconnected software components, also called services Customer profiles
- 8. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6 Delivering change continuously and fast is risky Quality assurance by validation throughout the Application Lifecycle will address these risks Q The risks: Change is constant • New implementations • Support packs • Customizations Speed impacts bottom line • Time to revenue • Cost of implementation Interdependence increases business risk • Apps are interdependent • Each change adds to risk Composite application
- 9. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7 The Internet of things Smart thermostats Connected cars Activity trackers Smart outlets Parking sensors
- 10. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8 The Internet of things Things get interesting when these connected devices and services start creating compound applications within their own verticals and across industries Home Consumer Buildings Infrastructure Cities Industry Transport Mobility Health Body Transportation and smart cities In downtown San Francisco 20-30% of all traffic congestion is caused by people hunting for a parking spot. – San Francisco Municipal Transportation Agency Healthcare and smart home 40 million adults age 65 and over will be living alone in the U.S., Canada and Europe – U.S. Department of Health
- 11. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9 Streamlining development and operations: on-premise or in the cloud Continuous delivery Deploy test app Run test cases Test results Dev-test with lab managementautomation1 Provision dev and test environments Production patterns, snapshots, and monitors back to dev and test3 Management, collaboration, risk management and security for the complete lifecycle4 Provision and deploy to staging Provision and deploy to prod Automateddeployment across development and operations Monitor 2
- 12. Agiletesting
- 13. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11 The Agile Manifesto vs. the Enterprise Agile Manifesto The Agile Manifesto • Individuals & interactions over processes & tools • Working software over comprehensive docs • Customer collaboration over contract negotiation • Responding to change over following a plan The Enterprise Agile Manifesto • Individuals & interactions with lean processes & tools • Working software with essential docs • Stakeholder collaboration with agile contracts • Responding to change as intrinsic part of the plan • Delivered agile architecture which reuses and evolves enterprise frameworks and patterns http://agilemanifesto.org http://davidsprottsblog.blogspot.com/2012/10/agile-manifesto-for-enterprise.html
- 15. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13 Advantages and disadvantages Stubbing (mocking) Reduces external dependencies Promotes a test driven development approach Allows some testing of code with limited functionality Stubs have to be created from scratch Doesn’t foster proper re-use (multiple developers using different versions of the stubs) Real world test conditions are very difficult to recreate
- 16. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14 Composite Application API Mobile App Web browser Application under test Existing infrastructure The service virtualization concept Virtual services are created to stand in for the real service when developers or testers need access Mainframe JDBC SOAP RFC/IDOC MQ/CICS Third party SAP System Existing database Web service and legacy application REST Pay-per-transaction SOAP REST JDBC MQ RFC CICS Data Perf. Config Service virtualization Simulation Under construction
- 17. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15 For continuous development and quality Service virtualization addresses the challenges 1. Composite applications and software re-use 2. Highly-visible demand for quality 3. Proliferation of mobility… 4. and cloud service integration 5. Release faster-test earlier: shift left testing (development and infrastructure testing)Service virtualization removes constraints and wait times frequently experienced by development and test teams needing to access components, architectures, databases, mainframes, and so on.
- 18. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16 End-to-end system virtualization Traditional test environment End-to-end virtualization + Wifi 3g 2gLTE Network Services ERP Virtual LDAP 3rd Party
- 20. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18 Application Complexity The average application connects to 38 discreet services Mainframe Storage DB Servers Web Services App Servers Web Servers Load Balancers Mobile Components Major ISP 3rd Party Cloud Services Content Delivery Networks Mobile Carriers & ISPsBrowser s & Devices Customers Employees Private or Public Cloud Services
- 22. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20 It’s All About Bandwidth Network Misconceptions 10Mbps 20Mbps 2Mbps 500kbps Latency 25ms Bandwidth No Impact No Impact No Impact Some Impact All Traffic Impacted Packet Loss = Further Impact
- 23. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21 It’s All About Bandwidth Less Critical Due to 4G (5G, 6G …) Network Misconceptions Carrier Frequency: • Increased Interference 2G 3G 4G 5G … 20% of all 4G Transfers Drop to 3G or Lower Cisco Mobile Forecast: • Mobile data traffic will grow 7-fold from 2013 to 2018 = compound annual growth rate of 50% Ofcom: • Current UK Mobile Data capacity will be exhausted by 2018 Shannon-Hartley Theorem: • Every Mobile Cell can only support a maximum channel capacity
- 24. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22 It’s All About Bandwidth … Less Critical Due to 4G (5G, 6G …) It Doesn’t Make Much Difference … Network Misconceptions Web Users – Average Transaction Response Time (s) 20x to 35x slower Baseline LondonWeb Dublin Web
- 25. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23 It’s All About Bandwidth … Less Critical Due to 4G (5G, 6G …) It Doesn’t Make Much Difference … Network Misconceptions Mobile Users – Average Transaction Response Time (s) 80x to 400x Slower Functional Failures Baseline London 3G Dublin 3G London2.5G
- 26. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24 It’s All About Bandwidth … Less Critical Due to 4G (5G, 6G …) It Doesn’t Make Much Difference … It’s Only About Performance … Network Misconceptions Load Test with NVLocal Load Test Transaction Time Transaction TimeVUsers VUsers Capacity > 500+ Users Response < 10 seconds Capacity < 200 Users Response > 40 seconds
- 27. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.25 It’s All About Bandwidth … Less Critical Due to 4G (5G, 6G …) It Doesn’t Make Much Difference … It’s Only About Performance … Network Misconceptions No Network With Remote With Web With Mobile Thread Count No Network Remote Web Users 50% CPU Increase 22% Thread Count Increase
- 28. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26 It’s All About Bandwidth … Less Critical Due to 4G (5G, 6G …) It Doesn’t Make Much Difference … It’s Only About Performance … NV is Only For Mobile … Network Misconceptions Remote Office Web Cloud Deployments All Other Connectivity (Wifi, Satellite, BT) Back-End Splits DCR … Wherever Applications Meet Networks
- 29. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27 When to Use Network Virtualization Development Manual, Unit Test, Emulators Functional Test Desktop or On-Device – Manual or Mobile test automation Load/Performance Test On premise or Cloud Network/System Test WAN Acceleration, VDI Service Virtualization End-to-End Lifecycle virtualization Powerful combination!
- 30. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28 Continuous Testing with Virtualization for Real World Conditions The ideal Agile picture Sprint 41 Sprint 3Sprint 2Sprint 1 Sprint 5 C1 C1 G1 C1 G1 C2 G2 C1 G1 C2 G2 C3 B1 C1 G1 C2 G2 C3 B1 G1 C2 Longevity testing (independent of sprint cycles) Regression 1 Regression 2 Regression 3 CI CI CI CI CI Regression 4 ET ET ET ET ET
- 31. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.29 Relentless automation – Agile sprint to enterprise release… Shift left, then test continuously Solving key testing challenges Exploratory testing Automated testing Continuous integration Regression testing Longevity testing Lack of the right test tools to create re-usable test sets Difficulty in re-using and repeating tests across sprints / iterations
- 32. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30 Continuous testing for faster app delivery “Shift-left” with confidence • Improve development efficiency • Reduce the test burden • Accelerate application delivery Validate Security Summary - Continuous testing is more critical than ever
- 33. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Closingandquestions
- 34. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Thankyou