Collaborative Mobile Test Automation
0 likes601 views
This document discusses trends in mobile app development and testing. It notes that users have higher expectations for frequent app updates and quality. Development teams are specializing while also using more open source tools and outsourcing. Testing in development focuses on units and features using emulators and personal devices, while testing in QA uses real devices for end-to-end and exploratory testing. The document advocates for collaboration between development and QA to leverage both teams' assets and improve test validity, coverage, and defect fixing. It introduces Keynote's real device cloud and integration with Appium to enable remote, automated testing across many real Android and iOS devices.
Collaborative Mobile Test Automation
- 1. Collaborative Mobile Test Automation July 14, 2015
- 2. Uber, the world’s largest taxi company, owns no vehicles. Facebook, the world’s most popular media owner, creates no content. Alibaba, the most valuable retailer, has no inventory. And Airbnb, the world’s largest accommodation provider, owns no real estate. Something interesting is happening. – Tom Goodwin Tech Crunch 3/3/15 toddler apps by jenny downing on Flickr
- 3. Today’s technology priority: growth 5% 6% 10% 11% 8% 9% 16% 12% 23% 3% 6% 11% 7% 15% 14% 13% 15% 15% 6% 9% 8% 12% 9% 10% 12% 19% 16% Hire a C-level executive who is focused… Invest in more outsourced resources to… Improve usability Reduce IT costs Increase proportionate investment in… Develop or acquire new skills in IT Invest in more external digital services… Expand the breadth of digital assets… Improve the quality and performance of… Top strategies for digital success next 18 mos. 1 2 3 16% 12% 23% 13% 15% 15% 12% 19% 16% More external digital services Expand digital assets (e.g. mobile) Improve customer experience quality and performance 1 2 3 Top 3 210 IT and LOB decision-makers in the US, UK, and Germany from organizations with 1000+ employees Source: A commissioned study conducted by Forrester Consulting on behalf of Keynote, March, 2015
- 5. Higher release frequency, user expectations 28 DAYS 59 DAYS iOS vs Android App Update Management Insights, UEA/CCP, 2015 ONLY 16% OF CUTOMERS willing to give a bad app more than one attempt 20%of apps are used once, then deleted Localytics, 2014
- 6. Development realities Specialization Open Source Testing “Open Source Water” by schoschie on flickr "TIOBEindex" onWikipedia
- 7. Units Feature validation Development environment Mix of emulators, personal devices Testing in Development
- 9. End-to-end, exploratory Coverage, regression Application lifecycle management, build acceptance/automation Higher reliance on real devices Testing in QA
- 12. Collaboration Dev -> QA 1. Leverage assets without sacrificing capability 2. Enhance narrow units with additional coverage E.g., modify unit testing registration functionality based on single data value to run on broad data arrays 3. Combine multiple units into full cases
- 13. Collaboration QA -> Dev 1. Reduce “source of truth” conflicts 2. Improve defect fix veracity 3. Improve test validity with the accuracy of same real device(s)
- 14. Shortcomings “bridge-to-nowhere” by careax on wikiality
- 15. Real Device Technology Perform cloud- based testing and monitoring of any app or website on the largest library of real mobile devices, or your own private devices.
- 16. Shared Devices 24X7 access to hundreds of smart devices Use for manual, compatibility, “untrusted device” testing Private Devices Managed and hosted by Keynote or on premise Inside corporate firewall Enterprise only Best for automation Local Devices Plug your smart devices on hand directly into your local computer Make use of existing assets, great for local teams Enterprise only Android only (iOS on roadmap) Flexible device options © 2015 Keynote, LLC
- 17. Keynote + Appium Run Appium scripts on real Android and iOS smartphones and tablets remotely Test on demand Execute multiple tests on multiple devices without the need to manage them Run test sequences with hundreds of test cases, across multiple devices Manage your tests online: View device interactions in real-time and share with colleagues using built-in collaborative screencasting Leverage results directly in Appium © 2015 Keynote, LLC
- 18. Live Appium test Let’s watch a test case run on a real iPhone
- 19. Collaboration—the sooner the better! User expectations are higher than ever—quality is critical Seek integrated approaches for both developers and quality assurance teams Prioritize consistency in testing, and foster connection across testing teams
- 20. Questions?
- 21. Thank you Learn more about Keynote Mobile Testing with Appium: http://www.keynote.com/solutions/testing/appium-integration