Mobile Testing With Confidence
- 1. Mobile Testing with Confidence Amy Phillips @itjustbroke
- 2. • Fragmentation • Reduced control over versions being used • Release process can be slow • Less control over environment (settings, other apps, etc) Confidence ˈkɒnfɪd(ə)ns/ Belief in oneself and one’s powers or abilities
- 6. Reduced Control • Releases • Environment
- 7. PANIC!!!
- 9. What is Testing? An empirical, technical, investigation conducted to provide stakeholders with information about the quality of the product or service under test. - James Bach
- 10. What is Quality? “value to some person who matters” - Michael Bolton
- 11. What Makes A Tester?
- 12. What Are We Trying To Do? • Have we built the right thing? • Have we broken stuff that used to work? • Have we introduced unintended behaviour?
- 13. Test Approach
- 15. Test At The End Develop Test Bug Fix
- 16. Develop Test Bug Fix Test As We Go Develop Test
- 17. Choose The Right Approach • The right approach is the one that works for you • It might change over time • Do what’s right for your users
- 18. What To Test?
- 19. Features • Do they look right? • Do they work correctly?
- 20. Memory Usage • Download size • Runtime size • Memory management
- 21. Crashes
- 22. Battery Usage
- 23. Performance
- 24. Security
- 25. Settings
- 26. Time
- 27. Orientation
- 28. Connectivity • 4G • 3G • WIFI • GPRS • No Service
- 29. Accessibility
- 30. Uninstalling • Remove all data • Leave device in state that allows re-install
- 31. Automation
- 32. Plan Your Testing • Pick and choose test areas • Focus on risk • Monitor coverage
- 33. Where To Test?
- 34. Test Device or Emulator?
- 36. Test Environment
- 37. Engage Users
- 38. Mobile Testing • Plan your testing in advance • Focus on risk • Learn from your mistakes • Make it easy for the user to recover from problems