Stop guessing, start testing – mobile testing done right - Timo Euteneuer

About Me
TestObject GmbH
Co-Founder I Sales
Mobile Quality Crew’s
Co-Founder I Organizer
Contact:
@testobject I timo@testobject

Session
1)  Mobile app testing: Why it is important
2)  Challenges
3)  Diﬀerent testing approaches
4)  Automation as key factor for success

Familiar?
48 % of users won‘t use an
app again after encountering a
major issue!
Source: Compuware Global Study Mobile Apps 2013

Better Find Bugs Before Users Do

Bad Quality = Less Revenue
Quality
Ratings
Downloads
Revenue

Device Fragmentation
http://opensignal.com/reports/2015/08/android-fragmentation/

OS Fragmentation

Screen Size Fragmentation
Android iOS

... More Challenges
§  Mobile means your users are not in a
protected environment
§  Network (Wiﬁ, 3G, GPRS ...)
§  Sensors, Bluetooth ...

Learnings
§  Your users are not very patient
§  Quality has direct impact on apps‘
success
§  Challenges: Fragmentation and mobile
use of apps
§  Implication: Mobile QA is a central part
of development

There must
be an easy
solution to
handle
this ?!

What Do I Have to Test?
§  What to test:
§  Usability
§  Functionality
§  Performance
§  Edge Cases
§  Approx. 50 use cases (per platform)
§  Approx. minimum 20 target devices

Testing Framework
Development QA Production
Unit Tests
Functional Tests
Usability
Sanity
Monitoring
Automation
Manual Edge Cases
Checkups

Manual Approaches
§  Checkups, Usability, Edge Cases, Performance
§  Pros: You can test the actual user behavior
§  Cons: Time consuming, ineﬃcient

Continuous Delivery = Continuous Testing
Build
Test
Deploy
Enhance

UI Automation Approaches
§  Regression, End-to-end, Integration
§  Pro: High test coverage, scalable, time-to-market,
releases resources for manual testing
§  Con: Initial investment, requires technical know-
how, maintaining of scripts, no edge cases

Automated Testing
ROI
Investment
Test Cycles
Resources

UI Automation Components
§  CI & Build: Jenkins, Bamboo, Travis CI, Gradle, Ant,
Maven
§  Scripting Tool: Proprietary or Open Source Tools
§  Infrastructure: e.g. Spoon, Selenium Grid,
SauceLabs, TestObject ...

UI Automation Frameworks
iOS Android Web Language
Calabash
x x - Ruby
Robotium
- x - Java
Espresso
- x - Java
Appium
x x x
Java, JavaScript, Python,
Ruby ...

Learnings
§  Quality is crucial but mobile QA is
complex
§  Diﬀerent automation and manual
testing approaches are required
§  For decent test coverage and time-to-
market UI test automation is key

Stop guessing, start testing – mobile testing done right - Timo Euteneuer

More Related Content

What's hot (20)

Viewers also liked (9)

Similar to Stop guessing, start testing – mobile testing done right - Timo Euteneuer (20)

More from JAXLondon_Conference (20)

Recently uploaded (20)

Stop guessing, start testing – mobile testing done right - Timo Euteneuer