SlideShare a Scribd company logo
Mobile Performance Testing
Roland van Leusden
1
Working for the FITT project, which
consist of migration from several
datacenters into one, more then 400
applications will be migrated.
Roland van leusden   mobile performance testing  rtc 2014 v0.6
Study researchers found three-quarters (77%) of
mobile users are concerned about app performance
before they buy. (Kristina Knight)
However mobile devices typically have: slower CPUs,
smaller screens, and less memory than the typical
desktop PC.
Connections can come from cell phones, tablets, and
various other devices with widely different
capabilities. Then there is the diverse and growing
range of platforms used in the mobile world,
including Android, BlackBerry, iPhone, and Microsoft
Windows Phone. To complicate matters further,
there are many existing versions of platforms in use
today.
There aren’t enough hours in the day to test on every device….
Roland van leusden   mobile performance testing  rtc 2014 v0.6
http://opensignal.com/coverage-maps/Netherlands/
Devices
• Different platforms &
Hardware
Network
• Connections from various
networks with different quality
Apps
• Other applications using
resources.
Where is the app used ?
•At home and office
•At the train station
•In the train
Which devices ?
•Android Phone
•Android Tablet
•iPhone
•iPad
Networks used ?
•Home / Office: 73% Wifi 27% Mobile
•Train station: 47% Wifi 53% Mobile
•In the train: 26% Wifi 74% Mobile
Architecture questions
• Required functionality ?
• Quality of Mobile Network ?
• User profile and expectations ?
• Amount of data in bundle ?
• Network speed ?
• Devices used ?
• Experience of Developers ?
http://wiki.developerforce.com/
11
0 5
Device use
Network use
Server use
Resource Allocation
0 5
Device use
Network use
Server use
Resource Allocation
0 5
Device use
Network use
Server use
Resource Allocation
0 5
Device use
Network use
Server use
Resource Allocation
0 5
Device use
Network use
Server use
Resource Allocation
12
Best Practice Guidelines for Developing Quality Mobile Apps
In house,
Need to buy devices all the time / For older models secondhand .
In controll of network and installed apps.
Good for Performance testing
In the cloud,
Pay per use
Good for functional testing
Newest devices available
Network control ?
Installed apps ?
Measuring recources ?
AppInsight: Mobile App Performance Monitoring in the Wild
http://research.microsoft.com/en-us/projects/appinsight/
Closed Beta
Bought by Facebook
AT&T Application Resource Optimizer (ARO)
https://developer.att.com/application-resource-optimizer
$3500/ year
Modify Headers
add-on
Roland van leusden   mobile performance testing  rtc 2014 v0.6
NeoLoad
Silk Performer
Spirent Avalanche
Shunra
WANemDummy Cloud
Dummy Net
Roland van leusden   mobile performance testing  rtc 2014 v0.6
m.nshighspeed.nl
IP 1: 192.168.0.20
IP 2: 192.168.0.30
IP 3: 192.168.0.40
Roland van leusden   mobile performance testing  rtc 2014 v0.6
192.168.0.62
Architecture
• Users, Devices, Functionality
• Mobile Networks
Development
• Web, Hybrid or Native.
• Instrumentation, Emulators
Functional &
Performance
testing
• Real devices
• Mobile Network emulation
Roland van leusden   mobile performance testing  rtc 2014 v0.6

More Related Content

PDF
Stephen janaway mobile testing - that's just a smaller screen, right
PDF
Georgi hristov continuous integration-for mobile test automation
PDF
Baris sarialioglu testing on the move, mobile testing
PDF
Ady beleanu automate-theprocessdelivery
PDF
Continuous Quality For a 5 Star Mobile Apps Delivery
PPTX
Mobile App Quality Roadmap for DevTest Teams
PPTX
Juc oct 2014 final
PPTX
How Digital Changed the Game... and how to cross platform test for it
Stephen janaway mobile testing - that's just a smaller screen, right
Georgi hristov continuous integration-for mobile test automation
Baris sarialioglu testing on the move, mobile testing
Ady beleanu automate-theprocessdelivery
Continuous Quality For a 5 Star Mobile Apps Delivery
Mobile App Quality Roadmap for DevTest Teams
Juc oct 2014 final
How Digital Changed the Game... and how to cross platform test for it

What's hot (20)

PPT
Achieving a Winning Digital User Experience with Real World Testing
PPTX
Mobile and Web App Testing for Visual Studio Teams
PPTX
Testing Mobile Apps under Real User Conditions
POT
Mobile Test Coverage- Israel 4th meetup
PDF
Wearables meetup
PDF
Enough is not enough - Test Strategy for Mobile
PPTX
Mobile test automation perfecto star east
PPTX
Virgin Media's Mobile Quality Transformation
PPTX
How to Test on the Right Mobile Platforms
PPTX
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
PPTX
Testing Mobile Apps under Real User Conditions
PPTX
Responsive Web Design: Testing to Deliver a Consistent User Experience
PPTX
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
PPTX
TechTalk: Getting to Know Perfecto
PPTX
Overcoming Test Automation Obstacles
PDF
7 mobile app usability testing best practices by UserTesting
PPTX
The Essentials of Mobile App Performance Testing and Monitoring
PPTX
Mobile App Testing Best Practices
PPTX
Testing Apps for Wearables
PDF
Ciprian balea automated performance-testing
Achieving a Winning Digital User Experience with Real World Testing
Mobile and Web App Testing for Visual Studio Teams
Testing Mobile Apps under Real User Conditions
Mobile Test Coverage- Israel 4th meetup
Wearables meetup
Enough is not enough - Test Strategy for Mobile
Mobile test automation perfecto star east
Virgin Media's Mobile Quality Transformation
How to Test on the Right Mobile Platforms
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Testing Mobile Apps under Real User Conditions
Responsive Web Design: Testing to Deliver a Consistent User Experience
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
TechTalk: Getting to Know Perfecto
Overcoming Test Automation Obstacles
7 mobile app usability testing best practices by UserTesting
The Essentials of Mobile App Performance Testing and Monitoring
Mobile App Testing Best Practices
Testing Apps for Wearables
Ciprian balea automated performance-testing
Ad

Similar to Roland van leusden mobile performance testing rtc 2014 v0.6 (20)

PDF
SauceCon 2017: test.allTheThings(): Digital Edition
PDF
Ibm mobile first platform presentation refresh 05 18-mc
PPTX
redpill Mobile Case Study (Salvation Army)
PDF
Presentation build and connect apps, devices and data ibm worklight overview
PDF
Splunk MINT Deepdive
PDF
Splunk MINT Deepdive
PDF
Splunk MINT Deepdive
PDF
Splunk MINT Deepdive
PPT
Mobile enterprise overview v6
PDF
Architect a Winning Mobile Application
PPTX
Bug deBug Chennai 2012 Talk - Future of testing impact of mobile devices by S...
PPTX
Mobile development services
PDF
Choosing the right mobile architecture
PDF
Think tank event mobile app testing v1.3
PDF
Mobile Testing Trends
PDF
Testing Mobile App Performance
PPTX
Customer Presentation - Ford Network Operations Adminstration
DOCX
Mobile testing
DOCX
Mobile app testing
PPTX
Android introduction
SauceCon 2017: test.allTheThings(): Digital Edition
Ibm mobile first platform presentation refresh 05 18-mc
redpill Mobile Case Study (Salvation Army)
Presentation build and connect apps, devices and data ibm worklight overview
Splunk MINT Deepdive
Splunk MINT Deepdive
Splunk MINT Deepdive
Splunk MINT Deepdive
Mobile enterprise overview v6
Architect a Winning Mobile Application
Bug deBug Chennai 2012 Talk - Future of testing impact of mobile devices by S...
Mobile development services
Choosing the right mobile architecture
Think tank event mobile app testing v1.3
Mobile Testing Trends
Testing Mobile App Performance
Customer Presentation - Ford Network Operations Adminstration
Mobile testing
Mobile app testing
Android introduction
Ad

More from Romania Testing (15)

PDF
Jan jaap TMMi facts and figures v2
PDF
Kiran karnad rtc2014 ghdb-final
PDF
Luis fraile exploratory testing myths ro
PDF
Rene tuinhout passionate dating for testers and vice versa
PDF
Gabriel carabat a healthy approach for test automation
PDF
Daniel billing exploring the security testers toolbox
PDF
Codruta bunea establishing a test approach for a private cloud environment
PDF
Andy glover - Artist within everyone
PDF
Andy glover - Visual Testing Workshop
PDF
Adrian bolboaca sherlock holmesandpairing-adibolboaca
PDF
Stephen blower inspiring testers - rtc2014
ODP
Testing-as-a-service on demand
PDF
10 Lessons learned in test automation
PPT
Programming skills for test automation
PPT
Mentoring embedded testing
Jan jaap TMMi facts and figures v2
Kiran karnad rtc2014 ghdb-final
Luis fraile exploratory testing myths ro
Rene tuinhout passionate dating for testers and vice versa
Gabriel carabat a healthy approach for test automation
Daniel billing exploring the security testers toolbox
Codruta bunea establishing a test approach for a private cloud environment
Andy glover - Artist within everyone
Andy glover - Visual Testing Workshop
Adrian bolboaca sherlock holmesandpairing-adibolboaca
Stephen blower inspiring testers - rtc2014
Testing-as-a-service on demand
10 Lessons learned in test automation
Programming skills for test automation
Mentoring embedded testing

Recently uploaded (20)

PDF
Machine learning based COVID-19 study performance prediction
PDF
Empathic Computing: Creating Shared Understanding
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
Big Data Technologies - Introduction.pptx
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
KodekX | Application Modernization Development
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Network Security Unit 5.pdf for BCA BBA.
PDF
Encapsulation theory and applications.pdf
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Machine learning based COVID-19 study performance prediction
Empathic Computing: Creating Shared Understanding
Digital-Transformation-Roadmap-for-Companies.pptx
Big Data Technologies - Introduction.pptx
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
KodekX | Application Modernization Development
The AUB Centre for AI in Media Proposal.docx
Network Security Unit 5.pdf for BCA BBA.
Encapsulation theory and applications.pdf
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
NewMind AI Monthly Chronicles - July 2025
Advanced methodologies resolving dimensionality complications for autism neur...
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...

Roland van leusden mobile performance testing rtc 2014 v0.6

  • 2. Working for the FITT project, which consist of migration from several datacenters into one, more then 400 applications will be migrated.
  • 4. Study researchers found three-quarters (77%) of mobile users are concerned about app performance before they buy. (Kristina Knight) However mobile devices typically have: slower CPUs, smaller screens, and less memory than the typical desktop PC.
  • 5. Connections can come from cell phones, tablets, and various other devices with widely different capabilities. Then there is the diverse and growing range of platforms used in the mobile world, including Android, BlackBerry, iPhone, and Microsoft Windows Phone. To complicate matters further, there are many existing versions of platforms in use today. There aren’t enough hours in the day to test on every device….
  • 8. Devices • Different platforms & Hardware Network • Connections from various networks with different quality Apps • Other applications using resources.
  • 9. Where is the app used ? •At home and office •At the train station •In the train Which devices ? •Android Phone •Android Tablet •iPhone •iPad Networks used ? •Home / Office: 73% Wifi 27% Mobile •Train station: 47% Wifi 53% Mobile •In the train: 26% Wifi 74% Mobile
  • 10. Architecture questions • Required functionality ? • Quality of Mobile Network ? • User profile and expectations ? • Amount of data in bundle ? • Network speed ? • Devices used ? • Experience of Developers ? http://wiki.developerforce.com/
  • 11. 11 0 5 Device use Network use Server use Resource Allocation 0 5 Device use Network use Server use Resource Allocation 0 5 Device use Network use Server use Resource Allocation 0 5 Device use Network use Server use Resource Allocation 0 5 Device use Network use Server use Resource Allocation
  • 12. 12
  • 13. Best Practice Guidelines for Developing Quality Mobile Apps
  • 14. In house, Need to buy devices all the time / For older models secondhand . In controll of network and installed apps. Good for Performance testing In the cloud, Pay per use Good for functional testing Newest devices available Network control ? Installed apps ? Measuring recources ?
  • 15. AppInsight: Mobile App Performance Monitoring in the Wild http://research.microsoft.com/en-us/projects/appinsight/ Closed Beta Bought by Facebook AT&T Application Resource Optimizer (ARO) https://developer.att.com/application-resource-optimizer $3500/ year
  • 21. IP 1: 192.168.0.20 IP 2: 192.168.0.30 IP 3: 192.168.0.40
  • 24. Architecture • Users, Devices, Functionality • Mobile Networks Development • Web, Hybrid or Native. • Instrumentation, Emulators Functional & Performance testing • Real devices • Mobile Network emulation