Automation Proposal_V1.0

1
Automation Test Practical
For Mobile Domain
October 2016

Content
2
 Abstract
 Our Vision
 Our Selection Criteria
 Solution & Tools
 The process to success
 Demo
 Q&A

Abstract
4
With the growing number of mobile apps and their agile development
life cycle, Automation Testing around them will no longer be optional.
The intent of this presentation is to present a comparison between the
widely used solution & mobile automation tools in order to determine
their ease of use & effectiveness.
We’ve picked up a typical our project, tested its GUI manually and
followed it up by a round of automation testing using these solution &
automation tools

Complexities in Mobile Landscape
6
Operating System
Screen size
Screen resolution
Device Manufacturers
Smartphone or Tablet
GPU used

Localization: The big hurdle
7
Mobile apps
stores are global,
Mobile apps
should be too.
Supporting the
app in around 18
locales
Globalization
ready

Our Vision
9
GUI Testing
Functional Testing
App success
Usability
Appealing
Design
Positive
interaction

Need automation?
10
Growing
mobile apps
Agile
development
cycle
Mobile
Landscape
Complexities
Globalization:
Apps
releasing in
multiple
languages
Automation
is the key

Our Selection Criteria
12
We want to have a combination of tools which satisfy the following criteria:
Can automate Android/iOS/Both mobile apps
First party/Third party tool
Bundled with the OS IDE/ Should be installed separately
Coordinate based/ Object based automation

MonkeyRunner
16
Key Features
Components of this tool
Google
• MonkeyRunner
• MonkeyDevice
• MonkeyImage
• Provides an API for writing programs to control an
Android device/emulator.
• Can be used for both functional and UI testing.
• Entirely based on coordinates based automation.
• Easy to extensible .

MonkeyRunner
17
Strengths
Easy to set-up and
extensible.
Test multiple devices at a
time.
Appropriate for regression
testing of a basic app.
Random testing.
Limitations
Only supports Android.
Different script for
different device.
Even slight change in UI
breaks the script.

UI Automator
19
Key Features
Google• It is a java library containing API’s to create customized
functional UI tests.
• Integrated with Google’s own Android development IDE
• Entirely based on object based automation.
• Uiautomatorviewer
• API framework.

UI Automator
20
Strengths
One of the best tools for
testing android apps.
Comes bundled with Android
Studio IDE.
Appropriate for UI testing of
any android app.
Limitations
Only supports Android
(versions > 4.3).
Lack of support for Web view.
Lack methods for some
gestures like long press on an
element.

22
Key Features
• It is an integrated environment for recording, customizing
and managing test suites.
• Open source, eclipse based IDE.
• Used for automation of both iOS & Android apps.
• Limited features are available in the free version of this
tool. Paid version is costly.
• MonkeyTalk IDE
• MonkeyTalk Agent
Cloud Monkey

23
Strengths
Supports both iOS and Android
apps.
Test multiple devices at a time.
Open source
Image comparison is supported
Limitations
The essential features are available
in the paid version.
Doesn’t support web view.
Agent needs to be installed in the
app which needs to be tested.
Limited xPath support.

25
Key Features
• Appium Server
• Appium Client libraries
• Appium Inspector
• It is a HTTP server that takes HTTP commands from the
test script and executes the command on the device.
• Based on WebDriver JSON protocol.
• Used for automation of both iOS & Android apps.
• Totally derived from selenium code + mobile gesture
handling
Sauce Labs

26
Strengths
Supports both iOS and Android apps.
One of the most versatile tools for
testing any native, hybrid and mobile
web apps.
Doesn’t require code access or
recompiling the app.
Test multiple android devices at a
time.
Limitations
No support for parallel test for iOS
apps.
No support for Android version < 4.1
(selendroid can be used)
No Image comparision.
No option to switch off network
connection.

AOP Technique
30
Key Features
• Eclipse IDE
• IntelliJ IDE
• Android Studio
• It is a techniques that injects the test code to the
source code by the configuration way.
• Easy to config and control
• Used for automation test of both iOS & Android apps.
Open Source

AOP Techniques
31
Strengths
Supports many programming
languages.
Easy to config and control.
Easy to tracking the logging,
performance, data validation,…
Limitations
Poor tool support as debugger,
profiler,..
Lack of universal framework
No UI testing support.

The process: Recipe of Success
33
performance, data vlidation,…
Know your
mobile app.
Identify the
right
automation
tool.
Write test
script to cover
all the testing
workflows in
the app.
Run the script
for the test
pass.
Next Release:
Update the
script.
Repeat until
the app lives
on the app
store.

Use case scenario
34
Monkey
Runner
Android app only Basic UI testing Time Crunch
Low
effort/investment
UI
Automator
Android app only
Intensive UI
testing.
Don’t want to use
third party tool.
Have time to
build a stable
automation
solution.
Monkey
Talk
Android & iOS
app
Your app doesn’t
supports web
view.
Image
comparison
requirement.
Can install agents
in your app / can
invest money per
month
Appium
Android & iOS
app
Intensive UI
testing
Don’t have code /
Don’t want to
install any agent.
Stable
automation
solution (free) for
suite of apps

Key fact
35
 Use real devices.
 All elements in the UI should have a unique resource id.
The App UI has changed: Get ready for modifying your test script.
iOS Automation: You need code access or debug build.

Automation Proposal_V1.0

More Related Content

What's hot (20)

Viewers also liked (16)

Similar to Automation Proposal_V1.0 (20)

Automation Proposal_V1.0