SlideShare a Scribd company logo
Web API Fragility
How Robust Is Your Mobile Application?
Tiago Espinha, Andy Zaidman, Gerd Gross
MobileSoft 2015, Firenze, Italy
Web API Fragility: How Robust Is Your Mobile Application?
Web API Fragility: How Robust Is Your Mobile Application?
Web API Fragility: How Robust Is Your Mobile Application?
Web API Fragility: How Robust Is Your Mobile Application?
Developer decides when Web API provider decides
when
Web API Fragility: How Robust Is Your Mobile Application?
v1
v2
What is the damage?
43 Android apps
Proxy server
Web API Fragility: How Robust Is Your Mobile Application?
Mutation operators on response message
- Remove node
- Add irrelevant node
- Malformed response
- Empty message response
- Change of implicit data type
- Data formatting disruption
Mutation operators on response message
- Remove node
- Add irrelevant node
- Malformed response
- Empty message response
- Change of implicit data type
- Data formatting disruption
App behaviour
• Force close
• Error message (no silent fail)
• Timeout (versus indefinitely loading)
• No indication
What happens?
Undesirable
• >50% apps fail silently • Most apps fairly robust
(30% crash on field removal)
Recommendations
• HATEAOS versioning of Web APIs
• Better error reporting for users
• Built-in validity checks for Web API
response
• Design for change when dealing with
Web APIs

More Related Content

PDF
How to Find Vulnerabilities and Bugs in Mobile Applications
PPTX
ATAGTR2017 SPEAKING EYE for differently abled people to see the web content
PPTX
Making the Transition from Manual to Automated Testing
PDF
Functional to Visual: AI-powered UI Testing from Testim and Applitools
PDF
Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing
PPTX
CMG imPACt2016 - Mobile performance testing - Vendor training - Federico Tole...
PPTX
Get More out of Appium
PDF
Measuring your way_to_successful_automation_webinar
How to Find Vulnerabilities and Bugs in Mobile Applications
ATAGTR2017 SPEAKING EYE for differently abled people to see the web content
Making the Transition from Manual to Automated Testing
Functional to Visual: AI-powered UI Testing from Testim and Applitools
Continuous Testing Odyssey: Learn Best Practices for End-to-End Web App Testing
CMG imPACt2016 - Mobile performance testing - Vendor training - Federico Tole...
Get More out of Appium
Measuring your way_to_successful_automation_webinar

What's hot (20)

PDF
Key note Manish and Deepa
PDF
Learnings from Hybrid App Testing Jijesh Mohan
PPTX
ATAGTR2017 Wearable App Testing
PDF
Testing Mobile App Performance
PDF
SauceCon 2017: Making Your Mobile App Automatable
PDF
Awesome Test Automation Made Simple w/ Dave Haeffner
PPTX
Mobile App Testing Best Practices
PDF
SauceCon 2017: test.allTheThings(): Digital Edition
PDF
Quality at Speed: More API Testing, Less UI Testing
PDF
Using Selenium To Test Mobile? Meet Appium!
PPTX
CA CD for Linkedin
PDF
SauceCon 2017: Building a Continuous Delivery Pipeline with Testing in Mind
PPTX
The Essentials of Mobile App Performance Testing and Monitoring
PDF
YAGNI, YMMV and APIs: building a hybrid strategy for your API platform.
PDF
Appium for RubyMotion
PPTX
Integrate Visual AI Into Your Appium Scripts in Minutes
PDF
2018 State of Testing Survey Results
PDF
SauceCon 2017: Testing @ the Speed of Concurrency
PDF
Automation Pyramid - Make it right!
PPTX
Dimensions CM Summer VUG Presentation
Key note Manish and Deepa
Learnings from Hybrid App Testing Jijesh Mohan
ATAGTR2017 Wearable App Testing
Testing Mobile App Performance
SauceCon 2017: Making Your Mobile App Automatable
Awesome Test Automation Made Simple w/ Dave Haeffner
Mobile App Testing Best Practices
SauceCon 2017: test.allTheThings(): Digital Edition
Quality at Speed: More API Testing, Less UI Testing
Using Selenium To Test Mobile? Meet Appium!
CA CD for Linkedin
SauceCon 2017: Building a Continuous Delivery Pipeline with Testing in Mind
The Essentials of Mobile App Performance Testing and Monitoring
YAGNI, YMMV and APIs: building a hybrid strategy for your API platform.
Appium for RubyMotion
Integrate Visual AI Into Your Appium Scripts in Minutes
2018 State of Testing Survey Results
SauceCon 2017: Testing @ the Speed of Concurrency
Automation Pyramid - Make it right!
Dimensions CM Summer VUG Presentation
Ad

Similar to Web API Fragility: How Robust Is Your Mobile Application? (20)

PPTX
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
PPTX
Monitoring Solutions for APIs
PDF
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
PPTX
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
PPTX
Atmosphere 2016 - Andreas Grabner - Metrics Driven-DevOps: Delivering High Qu...
PDF
Encontrando la Aguja en el Rendimiento de Aplicaciones
PPTX
Interview questions for an Android Developer
PDF
Improve App Performance: Key Tips Explained
PPTX
Mobile App Testing on Cloud
PPTX
Operationalize all the network things
PPTX
Operationalize All the Network Things by Lori MacVittie
PPTX
Chapter 1. Why Performance Test
PPTX
Twelve factor-app
PPTX
Progressive Web App
PDF
How to deal with mobile traffic expansion
PDF
Webinar effective mobile performance testing using real devices
PDF
Mobile apps & Server Apis, the weak link? par Emanuele Pecorari
PDF
Connect Ops and Security with Flexible Web App and API Protection
PDF
Thinking about the full stack to create great mobile experiences
PPTX
How to Monitor Your Java & .NET Applications with eG Enterprise
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
Monitoring Solutions for APIs
[TTT Meetup] Enhance mobile app testing with performance-centric strategies (...
Metrics Driven DevOps - Automate Scalability and Performance Into your Pipeline
Atmosphere 2016 - Andreas Grabner - Metrics Driven-DevOps: Delivering High Qu...
Encontrando la Aguja en el Rendimiento de Aplicaciones
Interview questions for an Android Developer
Improve App Performance: Key Tips Explained
Mobile App Testing on Cloud
Operationalize all the network things
Operationalize All the Network Things by Lori MacVittie
Chapter 1. Why Performance Test
Twelve factor-app
Progressive Web App
How to deal with mobile traffic expansion
Webinar effective mobile performance testing using real devices
Mobile apps & Server Apis, the weak link? par Emanuele Pecorari
Connect Ops and Security with Flexible Web App and API Protection
Thinking about the full stack to create great mobile experiences
How to Monitor Your Java & .NET Applications with eG Enterprise
Ad

More from Andy Zaidman (7)

PDF
Show Your True Testing Color: The Environmental Impact of Software Testing
PPTX
Automatic for the People
PPTX
Software Analytics
PPTX
Fact or Fiction? What Software Analytics Can Do For Us
PPTX
Software Analytics: The Dark Side and the Test Side
PPTX
First steps in testing analytics: Does test code quality matter?
PPTX
Studying Late Propagations in Code Clone Evolution Using Software Repository ...
Show Your True Testing Color: The Environmental Impact of Software Testing
Automatic for the People
Software Analytics
Fact or Fiction? What Software Analytics Can Do For Us
Software Analytics: The Dark Side and the Test Side
First steps in testing analytics: Does test code quality matter?
Studying Late Propagations in Code Clone Evolution Using Software Repository ...

Recently uploaded (6)

PDF
Lesson 13- HEREDITY _ pedSAWEREGFVCXZDSASEWFigree.pdf
PDF
heheheueueyeyeyegehehehhehshMedia-Literacy.pdf
DOC
Camb毕业证学历认证,格罗斯泰斯特主教大学毕业证仿冒文凭毕业证
DOC
证书学历UoA毕业证,澳大利亚中汇学院毕业证国外大学毕业证
PPTX
ASMS Telecommunication company Profile
PDF
6-UseCfgfhgfhgfhgfhgfhfhhaseActivity.pdf
Lesson 13- HEREDITY _ pedSAWEREGFVCXZDSASEWFigree.pdf
heheheueueyeyeyegehehehhehshMedia-Literacy.pdf
Camb毕业证学历认证,格罗斯泰斯特主教大学毕业证仿冒文凭毕业证
证书学历UoA毕业证,澳大利亚中汇学院毕业证国外大学毕业证
ASMS Telecommunication company Profile
6-UseCfgfhgfhgfhgfhgfhfhhaseActivity.pdf

Web API Fragility: How Robust Is Your Mobile Application?

  • 1. Web API Fragility How Robust Is Your Mobile Application? Tiago Espinha, Andy Zaidman, Gerd Gross MobileSoft 2015, Firenze, Italy
  • 6. Developer decides when Web API provider decides when
  • 9. What is the damage?
  • 12. Mutation operators on response message - Remove node - Add irrelevant node - Malformed response - Empty message response - Change of implicit data type - Data formatting disruption
  • 13. Mutation operators on response message - Remove node - Add irrelevant node - Malformed response - Empty message response - Change of implicit data type - Data formatting disruption
  • 14. App behaviour • Force close • Error message (no silent fail) • Timeout (versus indefinitely loading) • No indication
  • 16. • >50% apps fail silently • Most apps fairly robust (30% crash on field removal) Recommendations • HATEAOS versioning of Web APIs • Better error reporting for users • Built-in validity checks for Web API response • Design for change when dealing with Web APIs