SlideShare a Scribd company logo
An Introduction to Mobile
Software Testing
Stephen Janaway
Test Manager
Net-a-Porter Group
Who am I?
Stephen Janaway
• 12 years experience in mobile software
testing.
• Mobile devices
• Mobile networks
• Mobile applications
• Have worked for companies such as
Ericsson, Motorola and Nokia.
• Currently at Net-a-Porter Group.
• www.stephenjanaway.co.uk
• @stephenjanaway
This Presentation
• Why mobile testing?
• What is mobile testing?
• Hints, tips and techniques.
• Why get involved?
So Why Mobile?
So Why Mobile?
So Why Mobile?
The mobile market is huge
Mobile devices are
• Smart Phones
• Feature Phones
• Tablets
• E-readers
• Big screens, small screens, touch screens and
keypads.
Mobile devices are much more
• Alarm Clocks
• Maps
• Link to loved ones
• Hand held shops
• Tickets
• Music Players
• Books
• Games Players
• Cameras
• ……
• These are key experiences. Imagine if they did not work?
My alarm didn’t go off…
I’m lost
Where were we meeting?
Quality is not currently great
• Many applications launch un-tested.
• Phones launch with serious issues (remember
the iPhone 4 death grip).
• Android has security issues.
• Users tolerate this….but for how long?
• How can we improve this?
Different Sorts of Testing
• Hardware level:
• Protocol/ Air Interface:
• Applications
• The software that you test could be in the hands of millions of people
once you have finished.
• Releasing a phone with bugs in it loses a company a huge amount of
money.
• The mobile world is a low margin, high volume game.
Native or Web?
• Native app:
– Specifically designed to run on a device.
– Runs on device OS.
– Testing needs to include download/ upgrade/ uninstall.
– Typically needs to be adapted for different devices.
• Mobile website:
– All or some parts of the software are downloaded from the Web
each time it is run.
– Usually accessible from all Web-capable mobile devices.
– HTML5 makes it increasingly difficult to separate web apps from
native apps.
– Testing needs to include different mobile browsers.
Interactions
• While your application runs, the phone is:
– Talking to the network
– Working out where you are
– Maybe receiving calls, texts, Facebook and Twitter
updates.
• What happens when you have your application
running, and then get a call, and a text, whilst
uploading video to YouTube? Test for it and find
out.
Performance
• Mobile devices have limited memory and limited
processing capacity.
• It’s important to test how the devices work when
stressed.
• Test for memory leaks and general performance of the
operating system and applications.
• Think of battery life!!!
• Think of how the application works when network
performance is poor or on different speeds (2G/ 3G/
LTE/ Wifi).
Apps Stores
• Test app store submission and
download/ install.
• One estimate is that 70% of
applications are submitted to apps
stores without any formal testing
have been conducted.
Security
• Only a fraction of smartphones and tablets are protected by security
software
• Big recent rise in malware and copy apps targeted at mobile devices.
• Test for security issues.
• Check browser security, cookies, etc.
• Check application permissions.
Usability Matters
• You should test for usability.
• Usability could mean testing it on a panel of real users.
• Usability is more important in the mobile world:
– Smaller screen.
– More difficult to interact with and typically used one handed.
• Typical areas to focus upon are:
– How easy is it to use the application? Do user ‘just get it’?
– How is the look and feel?
– Does the application or device feel fast?
Strategy - Fragmentation
Where do I get all the devices from?
• Don’t use them at all – simulators or user
agents.
• Buy them.
• Rent them.
• Use a cloud based service (Perfecto Mobile,
DeviceAnywhere).
Automation – the answer?
• Yes and No 
• More difficult on mobiles.
• Many options:
– Appium
– iOS Driver
– Robotium
– Gorilla Logic (Monkey Talk)
– Touch Test
– Bespoke solutions….
So……why get involved?
So…
• Smartphone usage is increasing rapidly.
• Users are more emotionally attached to their
phones than they are to their PCs.
• Testing applications is the easiest route into the
industry.
• A mobile test strategy should not merely be a copy
of a desktop test strategy.
• “Be proud, your work will soon be in the hands of
millions”.
And two more things…
Net-a-Porter Are Hiring
• Dev-in-Test – Java/ Ruby
• Test Automation Analyst
Mobile Training
• Coming in early 2014
Stephen Janaway
Test Manager
Net-a-Porter Group
www.stephenjanaway.co.uk
@stephenjanaway
Questions?

More Related Content

PDF
Mobile Testing, That's Just A Smaller Screen, Right?
PDF
Stephen janaway mobile testing - that's just a smaller screen, right
PDF
Enough is not enough - Test Strategy for Mobile
PPTX
Mobile Usability
PDF
Mobile Testing Trends and Innovations
PDF
Georgi hristov continuous integration-for mobile test automation
PPT
Enhancing Mobile Apps Quality-Manual Testing Revisited
PPTX
The Essentials of Mobile App Performance Testing and Monitoring
Mobile Testing, That's Just A Smaller Screen, Right?
Stephen janaway mobile testing - that's just a smaller screen, right
Enough is not enough - Test Strategy for Mobile
Mobile Usability
Mobile Testing Trends and Innovations
Georgi hristov continuous integration-for mobile test automation
Enhancing Mobile Apps Quality-Manual Testing Revisited
The Essentials of Mobile App Performance Testing and Monitoring

What's hot (20)

PPTX
DevOps is about people, beyond automation
PDF
Mobile App Testing by Mark Wilson
PPTX
Automating Accessibility Testing
PDF
Roland van leusden mobile performance testing rtc 2014 v0.6
PDF
Performance testing of mobile apps
ODP
Mobile applicationtesting
PPTX
State of Mobile UX webinar slide deck - Chandika Bhandari, Seattle AppLab
PPT
Smartphone Shootout: Which One is Best?
PDF
Fall detection slideshow
PPTX
1273005 634588431410996250
PPTX
Tablet computers = success for struggling students
PPTX
Best Effort Security Testing for Mobile Applications - 2015 #ISC2CONGRESS
PPTX
SUPERPHONES
PPTX
iExperience
PPTX
"Transforming your learning strategy with a mobile LMS" - presentation slides
PPTX
Inspiratiedag uitapps
PPTX
Understand human behaviour to improve user adoption
PPTX
Sock le blue restaurant
PPSX
Microsoft surface
DOC
Mobile App Testing Checklist
DevOps is about people, beyond automation
Mobile App Testing by Mark Wilson
Automating Accessibility Testing
Roland van leusden mobile performance testing rtc 2014 v0.6
Performance testing of mobile apps
Mobile applicationtesting
State of Mobile UX webinar slide deck - Chandika Bhandari, Seattle AppLab
Smartphone Shootout: Which One is Best?
Fall detection slideshow
1273005 634588431410996250
Tablet computers = success for struggling students
Best Effort Security Testing for Mobile Applications - 2015 #ISC2CONGRESS
SUPERPHONES
iExperience
"Transforming your learning strategy with a mobile LMS" - presentation slides
Inspiratiedag uitapps
Understand human behaviour to improve user adoption
Sock le blue restaurant
Microsoft surface
Mobile App Testing Checklist
Ad

Similar to An Introduction To Mobile Software Testing (20)

PPTX
London Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
PPTX
Mobile Testing, That's Just a Smaller Screen, Right? Stephen Janaway
PDF
The current state of mobile testing by stephen janaway
PDF
Mobile Testing Trends and Innovations
PPTX
Mobile Application testing
PPTX
Tap into mobile app testing@TDT Iasi Sept2013
PDF
Mobile Testing Trends
PDF
"The Web - You're Doing it Wrong" for Forum Oxford May 2014
PPTX
2015 Mastering SAP Tech - Enterprise Mobility - Testing Lessons Learned
PDF
Usability Testing Goes Mobile
PDF
Addressing Mobile App Testing Challenges
PPTX
Smartphones
PDF
Remote usability testing and remote user research for usability
PPT
Android & iPhone App Testing
PDF
Web Apps and Responsive Design for Libraries
PPTX
Mobile application testing
DOCX
Mobile testing
DOCX
Mobile app testing
PDF
Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013
PPTX
Mobile Application Testing Training Presentation
London Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
Mobile Testing, That's Just a Smaller Screen, Right? Stephen Janaway
The current state of mobile testing by stephen janaway
Mobile Testing Trends and Innovations
Mobile Application testing
Tap into mobile app testing@TDT Iasi Sept2013
Mobile Testing Trends
"The Web - You're Doing it Wrong" for Forum Oxford May 2014
2015 Mastering SAP Tech - Enterprise Mobility - Testing Lessons Learned
Usability Testing Goes Mobile
Addressing Mobile App Testing Challenges
Smartphones
Remote usability testing and remote user research for usability
Android & iPhone App Testing
Web Apps and Responsive Design for Libraries
Mobile application testing
Mobile testing
Mobile app testing
Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013
Mobile Application Testing Training Presentation
Ad

More from Stephen Janaway (9)

PDF
Check This - Test Automation, A Development Managers View
PDF
Understanding Your Mobile User
PDF
Why I Lost My Job As a Test Manager and What I Learnt As a Result
PDF
Mobile Users Are Different
PPTX
Mobile Testing, That's Just a Smaller Screen, Right
PPTX
Automation and Testing
PDF
Testing As An Activity
PDF
Testing Your Emotions
PDF
A Testers Hierarchy Of Needs
Check This - Test Automation, A Development Managers View
Understanding Your Mobile User
Why I Lost My Job As a Test Manager and What I Learnt As a Result
Mobile Users Are Different
Mobile Testing, That's Just a Smaller Screen, Right
Automation and Testing
Testing As An Activity
Testing Your Emotions
A Testers Hierarchy Of Needs

Recently uploaded (20)

PDF
KodekX | Application Modernization Development
PDF
cuic standard and advanced reporting.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
GDG Cloud Iasi [PUBLIC] Florian Blaga - Unveiling the Evolution of Cybersecur...
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Advanced Soft Computing BINUS July 2025.pdf
PDF
Electronic commerce courselecture one. Pdf
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
solutions_manual_-_materials___processing_in_manufacturing__demargo_.pdf
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Cloud computing and distributed systems.
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
[발표본] 너의 과제는 클라우드에 있어_KTDS_김동현_20250524.pdf
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Unlocking AI with Model Context Protocol (MCP)
KodekX | Application Modernization Development
cuic standard and advanced reporting.pdf
Understanding_Digital_Forensics_Presentation.pptx
GDG Cloud Iasi [PUBLIC] Florian Blaga - Unveiling the Evolution of Cybersecur...
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Advanced Soft Computing BINUS July 2025.pdf
Electronic commerce courselecture one. Pdf
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
Dropbox Q2 2025 Financial Results & Investor Presentation
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
solutions_manual_-_materials___processing_in_manufacturing__demargo_.pdf
Big Data Technologies - Introduction.pptx
Cloud computing and distributed systems.
Review of recent advances in non-invasive hemoglobin estimation
The Rise and Fall of 3GPP – Time for a Sabbatical?
[발표본] 너의 과제는 클라우드에 있어_KTDS_김동현_20250524.pdf
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Unlocking AI with Model Context Protocol (MCP)

An Introduction To Mobile Software Testing

  • 1. An Introduction to Mobile Software Testing Stephen Janaway Test Manager Net-a-Porter Group
  • 2. Who am I? Stephen Janaway • 12 years experience in mobile software testing. • Mobile devices • Mobile networks • Mobile applications • Have worked for companies such as Ericsson, Motorola and Nokia. • Currently at Net-a-Porter Group. • www.stephenjanaway.co.uk • @stephenjanaway
  • 3. This Presentation • Why mobile testing? • What is mobile testing? • Hints, tips and techniques. • Why get involved?
  • 8. Mobile devices are • Smart Phones • Feature Phones • Tablets • E-readers • Big screens, small screens, touch screens and keypads.
  • 9. Mobile devices are much more • Alarm Clocks • Maps • Link to loved ones • Hand held shops • Tickets • Music Players • Books • Games Players • Cameras • …… • These are key experiences. Imagine if they did not work?
  • 10. My alarm didn’t go off…
  • 12. Where were we meeting?
  • 13. Quality is not currently great • Many applications launch un-tested. • Phones launch with serious issues (remember the iPhone 4 death grip). • Android has security issues. • Users tolerate this….but for how long? • How can we improve this?
  • 14. Different Sorts of Testing • Hardware level: • Protocol/ Air Interface: • Applications • The software that you test could be in the hands of millions of people once you have finished. • Releasing a phone with bugs in it loses a company a huge amount of money. • The mobile world is a low margin, high volume game.
  • 15. Native or Web? • Native app: – Specifically designed to run on a device. – Runs on device OS. – Testing needs to include download/ upgrade/ uninstall. – Typically needs to be adapted for different devices. • Mobile website: – All or some parts of the software are downloaded from the Web each time it is run. – Usually accessible from all Web-capable mobile devices. – HTML5 makes it increasingly difficult to separate web apps from native apps. – Testing needs to include different mobile browsers.
  • 16. Interactions • While your application runs, the phone is: – Talking to the network – Working out where you are – Maybe receiving calls, texts, Facebook and Twitter updates. • What happens when you have your application running, and then get a call, and a text, whilst uploading video to YouTube? Test for it and find out.
  • 17. Performance • Mobile devices have limited memory and limited processing capacity. • It’s important to test how the devices work when stressed. • Test for memory leaks and general performance of the operating system and applications. • Think of battery life!!! • Think of how the application works when network performance is poor or on different speeds (2G/ 3G/ LTE/ Wifi).
  • 18. Apps Stores • Test app store submission and download/ install. • One estimate is that 70% of applications are submitted to apps stores without any formal testing have been conducted.
  • 19. Security • Only a fraction of smartphones and tablets are protected by security software • Big recent rise in malware and copy apps targeted at mobile devices. • Test for security issues. • Check browser security, cookies, etc. • Check application permissions.
  • 20. Usability Matters • You should test for usability. • Usability could mean testing it on a panel of real users. • Usability is more important in the mobile world: – Smaller screen. – More difficult to interact with and typically used one handed. • Typical areas to focus upon are: – How easy is it to use the application? Do user ‘just get it’? – How is the look and feel? – Does the application or device feel fast?
  • 22. Where do I get all the devices from? • Don’t use them at all – simulators or user agents. • Buy them. • Rent them. • Use a cloud based service (Perfecto Mobile, DeviceAnywhere).
  • 23. Automation – the answer? • Yes and No  • More difficult on mobiles. • Many options: – Appium – iOS Driver – Robotium – Gorilla Logic (Monkey Talk) – Touch Test – Bespoke solutions….
  • 25. So… • Smartphone usage is increasing rapidly. • Users are more emotionally attached to their phones than they are to their PCs. • Testing applications is the easiest route into the industry. • A mobile test strategy should not merely be a copy of a desktop test strategy. • “Be proud, your work will soon be in the hands of millions”.
  • 26. And two more things… Net-a-Porter Are Hiring • Dev-in-Test – Java/ Ruby • Test Automation Analyst Mobile Training • Coming in early 2014
  • 27. Stephen Janaway Test Manager Net-a-Porter Group www.stephenjanaway.co.uk @stephenjanaway Questions?