SlideShare a Scribd company logo
Addressing Mobile App Testing
                  Challenges (Part 2)


                          Notes from webinar by
                               Lee Barnes
                            hosted by QAI on
                           February 13th 2013




This presentation by Maira Bay de Souza is licensed under a
Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License
Before we begin ...

Items in this font are the notes I took from what the
  presenter said



Items in this font are my own comments
Testing needs


    Location-specific apps need to find a way to
    simulate location change. Otherwise you would
    have to actually move the device around the world!

    The same applies for moving the device around
    different mobile carrier networks.
Mobile websites



    Existing applications that help in testing:
        −   There are some mobile browser simulators
        −   There are also markup checkers
Essential things to know


    What are the most popular browsers?

    What are the devices that exist now?

    What are the languages used to program these
    devices?

    What is the OS model (closed or open source?)


Keep up with what's important for you!
Common mobile issues
Like in desktop testing, with experience testers will
  know what issues are common in certain
  environments


    Interrupt response: how does the app behave when
    there is an incoming call, alarm from calendar, etc

    What happens when the app is “backgrounded” for
    extended periods of time?
Common mobile issues (contd.)

    Memory/performance. Developers are not used to
    programming economically (for low
    power/memory/etc usage)


    Usability
        −   Sometimes users cannot tell if an image is a button
            or just an image
        −   Sometimes users cannot tell if there is a list/combo
            box or not
Test Automation
Success criteria for mobile test automation is the same
 as the criteria for desktop test automation:
       −    Reliable (can we leave it unattended?)
       −    Maintainable
       −    Scalable (can we expand the test coverage
            efficiently?)

It's interesting how mobile testing is similar to desktop
  testing in so many ways.
Mobile testing goals

    Ideal goal: use a single set of test cases for all
    devices

    Realistic goal: this is a rapidly evolving space with
    many providers and many approaches.

    Suggestions:
        −   Research carefully and look beyond the demo
        −   What can be automated vs. cost to automate

I like his approach of having realistic goals.
Good suggestions too!
Automation tools

    Tool categories:
        −   Native (from devices, companies): exist but are
            different for each device
        −   Multi-platform:
               
                   Visual-based:
                      −   text and image recognition
                      −   may require jailbreaking
                      −   are more reliable
               
                   Object-based:
                      −   interacts with UI objects itself
                      −   requires instrumentation in the application
                      −   interacts with the entire device
Automation questions

    How to reduce automation?
        −   Build a layer that's independent of the device


    Can I create an automation framework to test the
    desktop and the mobile environment?
        −   It's possible theoretically. But realistically it's hard,
            because objects, websites, etc are different .

Wow, I learned a lot from the webinar!
And I hope you learned a lot from my presentation!
Disclaimer
The notes presented here are what I understood from
  what the presenter communicated. They might not be
  100% accurate, as I was taking notes and listening to
  the presentation at the same time.
All the information I am quoting from the presenter is
  their intellectual property. I am reproducing it here
  under the fair use policy, for quoting purposes only.

More Related Content

PPT
Mobile Apps Testing - Part1
PPTX
Project Management for Mobile/#MWeb2014/Aheibel
PDF
Remote Usability Testing
PDF
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
ODP
Introduction to ETL
PPT
Handalian shelkey mobile-presentation_upa_2010
PPTX
2015 Mastering SAP Tech - Enterprise Mobility - Testing Lessons Learned
PDF
MobileBench Consortium 2013
Mobile Apps Testing - Part1
Project Management for Mobile/#MWeb2014/Aheibel
Remote Usability Testing
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
Introduction to ETL
Handalian shelkey mobile-presentation_upa_2010
2015 Mastering SAP Tech - Enterprise Mobility - Testing Lessons Learned
MobileBench Consortium 2013

Similar to Mobile Apps Testing - Part 2 (20)

DOCX
Mobile testing
DOCX
Mobile app testing
PPTX
Mobile applications testing
PPTX
WinOps Conf 2016 - Matteo Emili - Development and QA Dilemmas in DevOps
PPTX
Language learning using augmented reality
PPTX
Learning's from mobile testing
PPTX
Basic Guide For Mobile Application Testing
PDF
Mobile Testing Tools 101
PDF
SauceCon 2017: Mobile Test Pyramid
PDF
5-Ways-to-Revolutionize-Your-Software-Testing
PDF
The Essentials of Mobile App Testing and Monitoring
PDF
Interact2011 - Designing Inter-usable Systems
PPTX
Testing on Real Devices vs. Emulators
PPTX
Droid con slides 2013 mobileci-v1.0
PDF
Leveraging Visual Testing with Your Functional Tests
PDF
UXLx 2015: 'Designing Connected Products workshop
PPTX
Mobile Application testing
PPTX
Mobile Application Testing
PPTX
Usability for all budgets
PDF
Stop guessing, start testing – mobile testing done right - Timo Euteneuer
Mobile testing
Mobile app testing
Mobile applications testing
WinOps Conf 2016 - Matteo Emili - Development and QA Dilemmas in DevOps
Language learning using augmented reality
Learning's from mobile testing
Basic Guide For Mobile Application Testing
Mobile Testing Tools 101
SauceCon 2017: Mobile Test Pyramid
5-Ways-to-Revolutionize-Your-Software-Testing
The Essentials of Mobile App Testing and Monitoring
Interact2011 - Designing Inter-usable Systems
Testing on Real Devices vs. Emulators
Droid con slides 2013 mobileci-v1.0
Leveraging Visual Testing with Your Functional Tests
UXLx 2015: 'Designing Connected Products workshop
Mobile Application testing
Mobile Application Testing
Usability for all budgets
Stop guessing, start testing – mobile testing done right - Timo Euteneuer
Ad

More from Maira Bay de Souza (9)

PPTX
Software Quality for Developers
PPT
Using LinkedIn to find your next job
PPT
Job hunting tips from an HR perspective
PPT
4 steps to networking success
PPT
3 Secrets of a Top Linked-In Networker
PPT
What is an RTM?
PPT
Using LinkedIn to Help Find Your Next Job
PPT
Success in Toronto for Newcomers
PPT
TesTrek Notes
Software Quality for Developers
Using LinkedIn to find your next job
Job hunting tips from an HR perspective
4 steps to networking success
3 Secrets of a Top Linked-In Networker
What is an RTM?
Using LinkedIn to Help Find Your Next Job
Success in Toronto for Newcomers
TesTrek Notes
Ad

Recently uploaded (20)

PPTX
sap open course for s4hana steps from ECC to s4
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Electronic commerce courselecture one. Pdf
PDF
cuic standard and advanced reporting.pdf
PPT
Teaching material agriculture food technology
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Empathic Computing: Creating Shared Understanding
PDF
Machine learning based COVID-19 study performance prediction
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
Big Data Technologies - Introduction.pptx
PDF
KodekX | Application Modernization Development
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPTX
Spectroscopy.pptx food analysis technology
PDF
MIND Revenue Release Quarter 2 2025 Press Release
sap open course for s4hana steps from ECC to s4
Unlocking AI with Model Context Protocol (MCP)
Electronic commerce courselecture one. Pdf
cuic standard and advanced reporting.pdf
Teaching material agriculture food technology
Per capita expenditure prediction using model stacking based on satellite ima...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
20250228 LYD VKU AI Blended-Learning.pptx
The AUB Centre for AI in Media Proposal.docx
Empathic Computing: Creating Shared Understanding
Machine learning based COVID-19 study performance prediction
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Big Data Technologies - Introduction.pptx
KodekX | Application Modernization Development
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Digital-Transformation-Roadmap-for-Companies.pptx
Spectroscopy.pptx food analysis technology
MIND Revenue Release Quarter 2 2025 Press Release

Mobile Apps Testing - Part 2

  • 1. Addressing Mobile App Testing Challenges (Part 2) Notes from webinar by Lee Barnes hosted by QAI on February 13th 2013 This presentation by Maira Bay de Souza is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License
  • 2. Before we begin ... Items in this font are the notes I took from what the presenter said Items in this font are my own comments
  • 3. Testing needs  Location-specific apps need to find a way to simulate location change. Otherwise you would have to actually move the device around the world!  The same applies for moving the device around different mobile carrier networks.
  • 4. Mobile websites  Existing applications that help in testing: − There are some mobile browser simulators − There are also markup checkers
  • 5. Essential things to know  What are the most popular browsers?  What are the devices that exist now?  What are the languages used to program these devices?  What is the OS model (closed or open source?) Keep up with what's important for you!
  • 6. Common mobile issues Like in desktop testing, with experience testers will know what issues are common in certain environments  Interrupt response: how does the app behave when there is an incoming call, alarm from calendar, etc  What happens when the app is “backgrounded” for extended periods of time?
  • 7. Common mobile issues (contd.)  Memory/performance. Developers are not used to programming economically (for low power/memory/etc usage)  Usability − Sometimes users cannot tell if an image is a button or just an image − Sometimes users cannot tell if there is a list/combo box or not
  • 8. Test Automation Success criteria for mobile test automation is the same as the criteria for desktop test automation: − Reliable (can we leave it unattended?) − Maintainable − Scalable (can we expand the test coverage efficiently?) It's interesting how mobile testing is similar to desktop testing in so many ways.
  • 9. Mobile testing goals  Ideal goal: use a single set of test cases for all devices  Realistic goal: this is a rapidly evolving space with many providers and many approaches.  Suggestions: − Research carefully and look beyond the demo − What can be automated vs. cost to automate I like his approach of having realistic goals. Good suggestions too!
  • 10. Automation tools  Tool categories: − Native (from devices, companies): exist but are different for each device − Multi-platform:  Visual-based: − text and image recognition − may require jailbreaking − are more reliable  Object-based: − interacts with UI objects itself − requires instrumentation in the application − interacts with the entire device
  • 11. Automation questions  How to reduce automation? − Build a layer that's independent of the device  Can I create an automation framework to test the desktop and the mobile environment? − It's possible theoretically. But realistically it's hard, because objects, websites, etc are different . Wow, I learned a lot from the webinar! And I hope you learned a lot from my presentation!
  • 12. Disclaimer The notes presented here are what I understood from what the presenter communicated. They might not be 100% accurate, as I was taking notes and listening to the presentation at the same time. All the information I am quoting from the presenter is their intellectual property. I am reproducing it here under the fair use policy, for quoting purposes only.