Overcoming Test Automation Obstacles
Download as PPTX, PDF2 likes1,898 views
The document outlines seven key recommendations for building a robust mobile test automation suite, focusing on challenges and strategies related to mobile test coverage. It emphasizes the importance of defining test parameters, maintaining device diversity, and facilitating collaboration among teams. Additionally, the document discusses automation tools and methods to enhance the effectiveness of testing in mobile environments.
Overcoming Test Automation Obstacles
- 1. 5/12/2016 1© 2016, Perfecto Mobile Ltd. All Rights Reserved. 7 key recommendations for building a solid test automation suite May 2016 Eran Kinsbruner Director, Tech. Evangelist Perfecto Uzi Eilon Technology Director Perfecto Daniel Knott Mobile Senior Test Engineer Xing AG
- 2. Webinar Agenda 5/12/2016 2© 2016, Perfecto Mobile Ltd. All Rights Reserved. Mobile Test Automation Challenges Strategy for defining the right digital test coverage Practices For Robust Test Automation The 7 Keys for Unattended Mobile Test Automation Live Demo! Q & A
- 3. 5/12/2016 3© 2015, Perfecto Mobile Ltd. All Rights Reserved. I SAID I WAS FINE. I LIED.
- 4. Poll – Mobile Test Automation Challenges 5/12/2016 4© 2016, Perfecto Mobile Ltd. All Rights Reserved.
- 5. Code / Test – Common Challenges 1) Execution of One script across platforms 2) Automating build/deploy and acceptance testing during CI 3) Test results analysis 4) Object id Identification 5) Does it work over time ? 6) Maintenance of scripts and Objects 7) Matching Dev/Testers skill set
- 7. The Test Coverage Conversation – What To Answer? Which Devices? Which OS Versions? How Many platforms are Enough? When Should I refresh my test lab? Who is in charge of coverage? 5/12/2016 7© 2016, Perfecto Mobile Ltd. All Rights Reserved.
- 8. Mobile Test Coverage Method
- 9. Recommended OS – Usage & Quality Rationale Usage & Quality Issues Wi-Fi Issues Battery Drain Latest REF Android OS
- 10. Recommendations Leverage market calendars and stay updated Refresh/Review your test lab once a quarter Beta versions are no longer an option Chrome, FireFox, iOS Leverage analytics but validate and calibrate using market trends Real user conditions extends your test coverage Assign an owner for digital test coverage but keep the conversation open to all teams Mix your mobile test lab with the 4 device types 5/12/2016 10© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 11. WHY AUTOMATE?
- 12. UI Integration Unit Testing Performance Security Digital Transformation Requires Changes Around Test Automation Target Devices Target Env.OS OS versions Form factors CPU & Memory Manufacturers Wearables IOT Networks Orientation Location Notifications Events Device events
- 13. Object Identification Is Key For Robust Automation 5/12/2016 13© 2016, Perfecto Mobile Ltd. All Rights Reserved. • Selenium • Appium • XCTest • UIAutomation • Perfecto • Abby OCR • Applitools • Perfecto
- 14. Device/System Level Control is Critical 14
- 15. Assure Proper Error Handling 15 System level control Application control Device control
- 16. 3 Layers Involved In Test Automation Optimization 5/12/2016 16© 2016, Perfecto Mobile Ltd. All Rights Reserved. App • Info.Plist (iOS) • Manifest.MF (Android) Test Cases • Define Desired Capabilities Device • Supports Feature • Doesn’t Support
- 17. Facebook App Testing Diversity 5/12/2016 17© 2016, Perfecto Mobile Ltd. All Rights Reserved. Test Scenario iPhone 6/iPhone 5S iPhone 6S/6S Plus iPad Tablets Login YES YES YES Write Post (FB UI) YES YES YES Write Post (FB Force Touch) NO YES NO Upload Photo/Video (FB UI) YES YES YES Upload Photo/Video (FB Force Touch) NO YES NO Take Photo/Video (FB UI) YES YES YES Take Photo/Video (FB Force Touch) NO YES NO
- 18. More Examples: Android Doze & Multi Window 5/12/2016 18© 2016, Perfecto Mobile Ltd. All Rights Reserved. Android 6 and Above Android N and Above
- 19. Validate Feature Compliance & Test Accordingly 5/12/2016 19© 2016, Perfecto Mobile Ltd. All Rights Reserved. IOS Developer Library INFO.PLIST
- 20. 7 Keys for Successful Unattended Automation and CI 5/12/2016 20© 2015, Perfecto Mobile Ltd. All Rights Reserved. Start small & Grow Accept that not every test enters CI Debug & Debug Again across few platforms Make your script reusable Validate within and between the tests Plan for unexpected events Keep channel between Engineering, Ops and Biz opened
- 22. More Example 5/12/2016 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.
- 23. Smart Monkey Automation 5/12/2016 23© 2016, Perfecto Mobile Ltd. All Rights Reserved.
- 24. Smart Monkey Automation 5/12/2016 24© 2016, Perfecto Mobile Ltd. All Rights Reserved.
- 25. Webinar Agenda 5/12/2016 25© 2016, Perfecto Mobile Ltd. All Rights Reserved. Mobile Test Automation Challenges Strategy for defining the right digital test coverage Practices For Robust Test Automation The 7 Keys for Unattended Mobile Test Automation Live Demo! Q & A
- 26. Thank You