Ensuring Maximum Quality in the Era of IoT and Wearables
- 1. 5/13/16 1 Ensuring Maximum Quality in the Era of IoT Digital Landscape of IoT 2 What is IoT? Adding Connec+vity Fostering Cross-‐Communica+on Cloud Compu+ng + Data Gathering Sensors Where is IoT used? Health and Fitness Smart Homes Smart Ci+es IoT Sta?s?cs IoT market will have between 20 billion and 30 billion connected devices by 2020. IoT market will grow from $655.8 billion in 2014 to $1.7 trillion in 2020. Smart-‐home industry generated $79.4 billion in revenue in 2014, 90% of cars of will be online in 2020 (2% in 2012) ¹ Kelton Research/Makovsky Health, Pulse of Online Health 2015 ² IDFT Data Breach Reports 2015 3 – PwC Health Research Ins?tute, Top Health Industry Issues of 2016 4-‐ CTA Industry Report
- 2. 5/13/16 2 3 ©2016 InfoStretch Corporation. All rights reserved. IoT in Fitness Wearables 4
- 3. 5/13/16 3 IoT Product– Key Considera?ons 5 Needs analysis and business alignment An?cipa?ng new use cases Integra?on of development and test Design blueprin?ng IOT Strategy PlaXorm design Agile and con?nuous delivery Pre-‐built tools and reusable frameworks Experience with the latest plaXorms, sensors, devices and OSs IOT Development Data tes?ng using firmware Simula?on-‐based tes?ng Data comprehensiveness & accuracy tes?ng Interrup?on tes?ng IOT QA OEM Wearable Device Backend Portal – Server & DB Companion Applica>on – Mobile & Web Wearable IoT ecosystem SECURITY PERFORMANCE INTEGRATION COMPLIANCE Web Services § Device, § Firmware § Func>onal & Non-‐ Func>onal Tes>ng § API § Func>onal Tes>ng § Func>onal § Non-‐Func>onal § Usability § Accessibility Tes>ng API TEST AUTOMATION API TEST AUTOMATION BLE, NFC, Wi-‐Fi Web Services 6
- 4. 5/13/16 4 Types of QA Tes?ng in IoT Ø Usability / User Experience Ø Connec+vity Ø Security Ø Interoperability Ø Compa+bility Ø Performance 7 ©2016 InfoStretch Corporation. All rights reserved. PELOTON -‐ THIS IS FITNESS EVOLVED 8 ©2016 InfoStretch Corporation. All rights reserved.
- 5. 5/13/16 5 9 ©2016 InfoStretch Corporation. All rights reserved. QA Challenges at Peloton 10 ©2016 InfoStretch Corporation. All rights reserved. Seamless interac?on between technologies Priori?za?on and Test Management Building QA Infrastructure Scaling Solu?on
- 6. 5/13/16 6 InfoStretch’s QA and Test Strategy 11 ©2016 InfoStretch Corporation. All rights reserved. Ø Qmetry Automa+on Studio – Framework Solu?on Ø Shi^ Le^ concepts crea?ng an ongoing quality control framework Ø Parallel test execu+on using mul?ple test suites on mul?ple Android devices Ø 24X7 Monitoring system to check applica?on stability Ø Behavior-‐Driven Development scenario tes?ng in Smoke Test suite covering Android -‐ CMS – Web integra?on tes?ng Ø Performance and Load Tes+ng Ø Monkey stress tests Ø Con+nuous Integra+on leveraging Jenkins QMetry Automa?on Studio What is it? • Automa?on Framework (QAF) • Supports Web, Mobile (Na?ve & Web App) & Web Services • Eclipse Based UI What are the benefits • Robust Features (Repor?ng, Logging, Design Paiern) • Readymade Components • Data Driven (CSV, JSON, DB) • Integra?ons (HP-‐ALM, QMetry, Jenkins) How to use it? • Keyword Driven / Behavior Driven / Java Driven • Define Test Cases via UI • Re-‐Use TestStep across mul?ple Test Cases Framework with Powerful Features, Tighter Integra+ons and Support for all Automa+on Needs
- 7. 5/13/16 7 QAS: Reports - Made Readable Summary Trending TestDetails Environment 14 ©2016 InfoStretch Corporation. All rights reserved.
- 8. 5/13/16 8 15 ©2016 InfoStretch Corporation. All rights reserved. Results 16 ©2016 InfoStretch Corporation. All rights reserved. Automa?ng 80% of test footprint using Selenium for Android. Reducing regression tes?ng ?me by more than 50% -‐ from 4 hours to 1.5 hrs.
- 9. 5/13/16 9 To sum up the IoT QA process… 17 ©2016 InfoStretch Corporation. All rights reserved. Ø Build Collabora+ve QA Teams Ø Look for Tool-‐build opportuni+es Ø Build labs that serve the en+re digital porcolio Ø Orient people to gain an amalgama+on of skills Ø Build a culture of “test as a user” Thank You Info@infostretch.com 408.727.1100
- 10. 5/13/16 10 + + + + + + Evolution of InfoStretch Services MOBILE DEV SERVICES MOBILE QA SERVICES IOT DEV & QA SERVICES 2004 QA SERVICES § Mobile Strategy § Mobile App Development § Mobile Enterprise Integration § Elemento § Kony Accelerators § SMS Platform § Mobile Testing Services § Appstore Certification Services § Device Testing § QMetry ACE § Mobile Private Cloud § Synchro § Event Management Platform § IoT Applications § IoT Monitoring § IoT Maintenance § QA Services § Test Automation § Performance Testing § Security Testing § QMetry Test Mgmt. § ISFW - Selenium Framework Services Tools & IP We Service These Industries Mobile Hospitality Retail Entertainment Finance Healthcare 2006 2010 2013 { }