SlideShare a Scribd company logo
Assure End User Experience by
Testing In Real World Scenarios
Kaushik Nath
Head of Product Strategy, 99tests
Bharath S
Director of Operations,
99tests
About 99tests
99tests - In A Nutshell
Usability
Testing
Security
Testing
Functional Exploratory
Testing
Automation
Testing
Localisation
Testing
AuFn
Ux LnSc
150+
Countries
20000+
Testers
Test Case Driven
Testing
Tc
99tests Advantage
Save money
& time
Access to top notch
professional testers
across globe
App testing in the
real world
Easy
integration
Flexible Engagement
Models
Testers with
Domain-Specific
Knowledge
How we work?
Requirement gathering & analysis +
Test strategy creation
( Through a personalized requirement
discussion, Testing needs & plans are
chalked out )
Project creation & launch Within 24 hours
( Testers & validators are assigned to the projects )
Monitoring Project progress
( Bug logging, Bug Validation & Testing
coverage analysis )
Project delivery
( Sharing bug reports, Test Summary
Reports & Recommendations )
Crowd Testing - Relevance
Testing For Customer Experience
Real World Network Conditions
Wide Variety in Screen Size
Device coverage
Massive variety of OS versions
+
Customization of OS by
manufacturers
100+ Companies
Difficulty to test in a distributed environment
Real People In Real Condition
Google map vs. Apple map
Challenges In Customer Experience Testing
The Process
‱Clients give broad requirements.
‱Users, from the crowd, as they are like real users, are able to expand
to large variety of end user expectations and requirements.
‱How do we choose the crowd in such case – We carefully choose with
a broad demographics and expertise
‱Exploratory → Test Case (Carefully Designed) → Usability Testing
with Non-Testers (Real Users).
The 99tests Process
Exploratory Test case
Carefully Designed - Maximum Coverage
Usability
Case Study - Increasing The Review Rating
A mid sized travel segment client
No testing team, agile process, with 15 days release cycle
Regular bug fixes and new features added to the application
Web and Mobile Web Application
What 99tests provided
25 testers across the globe with a mix of travel domain expertise
Coverage of up to 50 devices
Exploratory testing followed by regression cycles
Results:
Reduced the number of issues identified by their actual users
Increase the quality index of the application from 4.2 to 4.8
User Review Rating
Case Study - Enhanced End User Experience
For A Leading Airline Service Enterprise In The APJ Region
Large Enterprise Airline Booking Platform
Huge testing team
Web, Android and iOS application
Monthly release cycle
What 99tests provided
50 testers across the globe with a mix of travel and ticketing expertise
Coverage of more than 50 configurations
Exploratory testing followed by regression cycles
Results:
Critical bugs identified before release and reported to the client
Increase of (Internal) Quality Index from 3.8 to 4.4
Bugathon
THANK YOU

More Related Content

PDF
Spring cloud on kubernetes
PPTX
소프튞웚얎 개발 튾랜드 및 MSA (ë§ˆìŽíŹëĄœ 서ëč„슀 ì•„í‚€í…ìł)의 읎핎
PDF
Python Programming and GIS
PDF
Geodatabase: The ArcGIS Mechanism for Data Management
PPTX
Rwd ppt
PDF
ìčŽìčŽì˜€ êŽ‘êł  플랫폌 MSA 적용 ì‚ŹëĄ€ 및 API Gateway와 읞슝 ê”Źí˜„ì— 대한 소개
PPTX
1. á„‹á…Ąá„á…”á„á…Šá†šá„Žá…§ ᄉᅄᆯᄀᅚ 프로ᄉᅊ스
PDF
Cloud native application ìž…ëŹž
Spring cloud on kubernetes
소프튞웚얎 개발 튾랜드 및 MSA (ë§ˆìŽíŹëĄœ 서ëč„슀 ì•„í‚€í…ìł)의 읎핎
Python Programming and GIS
Geodatabase: The ArcGIS Mechanism for Data Management
Rwd ppt
ìčŽìčŽì˜€ êŽ‘êł  플랫폌 MSA 적용 ì‚ŹëĄ€ 및 API Gateway와 읞슝 ê”Źí˜„ì— 대한 소개
1. á„‹á…Ąá„á…”á„á…Šá†šá„Žá…§ ᄉᅄᆯᄀᅚ 프로ᄉᅊ스
Cloud native application ìž…ëŹž

What's hot (20)

PDF
지식귞래프 ê°œë…êłŒ 활용방안 (Knowledge Graph - Introduction and Use Cases)
PDF
Branching Strategies: Feature Branches vs Branch by Abstraction
PDF
R í”„ëĄœê·žëž˜ë°ì„ 읎용한 ì•Œìƒë™ëŹŒ 행동권(HR) 분석
PDF
Introduction to elasticsearch
 
PPTX
ASP.NET 開癌äșșć“ĄäžćŻäžçŸ„çš„ IIS (IIS for ASP.NET Developers)
PDF
PostGIS 시작하Ʞ
PPTX
ë”„ëŸŹë‹ì„ 읎용한 ì‚Źìš©ìž 선혞도 êž°ë°˜ 의상 추ìȜ ì•Œêł ëŠŹìŠ˜ Ppt 선수강
PDF
Systems Engineering Management Plan (SEMP) for a standard fisher boat
PPTX
였픈소슀GIS넌 활용한 서ëČ„êž°ë°˜ êł”ê°„ë¶„ì„êłŒ 시각화
PPTX
4. á„ƒá…ąá„‹á…­á†Œá„…á…Łá†Œ á„‹á…Ąá„á…”á„á…Šá†šá„Žá…§ ᄉᅄᆯᄀᅚ ᄑᅹᄐᅄᆫ
PDF
Test Automation Using Python | Edureka
PPTX
Raster data model
PDF
Intro To React Native
 
PDF
[224]넀읎ëȄ êČ€ìƒ‰êłŒ 개읞화
PDF
ì§€ëŠŹì •ëłŽìČŽêł„(GIS) - [1] GIS 데읎터 유형, ê”ŹìĄ° 알Ʞ
PPTX
PostGIS and Spatial SQL
PPTX
MVVMć…„é–€
PDF
NextJS, A JavaScript Framework for building next generation SPA
PPTX
React Native
PDF
[Atlassian meets dev ops and itsm] kakao meets jira
지식귞래프 ê°œë…êłŒ 활용방안 (Knowledge Graph - Introduction and Use Cases)
Branching Strategies: Feature Branches vs Branch by Abstraction
R í”„ëĄœê·žëž˜ë°ì„ 읎용한 ì•Œìƒë™ëŹŒ 행동권(HR) 분석
Introduction to elasticsearch
 
ASP.NET 開癌äșșć“ĄäžćŻäžçŸ„çš„ IIS (IIS for ASP.NET Developers)
PostGIS 시작하Ʞ
ë”„ëŸŹë‹ì„ 읎용한 ì‚Źìš©ìž 선혞도 êž°ë°˜ 의상 추ìȜ ì•Œêł ëŠŹìŠ˜ Ppt 선수강
Systems Engineering Management Plan (SEMP) for a standard fisher boat
였픈소슀GIS넌 활용한 서ëČ„êž°ë°˜ êł”ê°„ë¶„ì„êłŒ 시각화
4. á„ƒá…ąá„‹á…­á†Œá„…á…Łá†Œ á„‹á…Ąá„á…”á„á…Šá†šá„Žá…§ ᄉᅄᆯᄀᅚ ᄑᅹᄐᅄᆫ
Test Automation Using Python | Edureka
Raster data model
Intro To React Native
 
[224]넀읎ëȄ êČ€ìƒ‰êłŒ 개읞화
ì§€ëŠŹì •ëłŽìČŽêł„(GIS) - [1] GIS 데읎터 유형, ê”ŹìĄ° 알Ʞ
PostGIS and Spatial SQL
MVVMć…„é–€
NextJS, A JavaScript Framework for building next generation SPA
React Native
[Atlassian meets dev ops and itsm] kakao meets jira
Ad

Viewers also liked (6)

PDF
Best Practices In Exploratory Testing
PDF
Best Practises In Test Automation
PDF
Future Of Software Testing
PDF
Market Guide For Mobile Wallets In India
PDF
Best practices for test case creation & maintenance
PPTX
An Overview of User Acceptance Testing (UAT)
Best Practices In Exploratory Testing
Best Practises In Test Automation
Future Of Software Testing
Market Guide For Mobile Wallets In India
Best practices for test case creation & maintenance
An Overview of User Acceptance Testing (UAT)
Ad

Similar to Assure End User Experience By Testing In Real World Scenarios (20)

PDF
Proctor & Gamble Case Study
PPT
Mobile Application Testing Strategy
PPT
Reverie case study
PPTX
Crowd Catcher: Take control of the Crowd (part 3 of 3) | QualiTest Group
PDF
Webinar app testing and distribution
PPT
Functional testing
PPTX
Mobile App Testing: Moving Outside the Lab
PDF
7 mobile app usability testing best practices by UserTesting
PDF
Get Testing Help from the Crowd
PPT
Usability testing
PDF
Think tank event mobile app testing v1.3
PDF
Agile testing (n)
PDF
Produkt Tank Amsterdam PULSE UX
PDF
Product Tank Amsterdam Pulse UX Presentation
PDF
Agile Acceptance testing with Fitnesse
PPTX
Mobile application testing
PDF
User Testing- guiding the way to success
 
PDF
The Importance of User Testing in Android App Development.pdf
PDF
Essential information to be included in test cases
PDF
Doron Reuveni - The Mobile App Quality Challenge - EuroSTAR 2010
Proctor & Gamble Case Study
Mobile Application Testing Strategy
Reverie case study
Crowd Catcher: Take control of the Crowd (part 3 of 3) | QualiTest Group
Webinar app testing and distribution
Functional testing
Mobile App Testing: Moving Outside the Lab
7 mobile app usability testing best practices by UserTesting
Get Testing Help from the Crowd
Usability testing
Think tank event mobile app testing v1.3
Agile testing (n)
Produkt Tank Amsterdam PULSE UX
Product Tank Amsterdam Pulse UX Presentation
Agile Acceptance testing with Fitnesse
Mobile application testing
User Testing- guiding the way to success
 
The Importance of User Testing in Android App Development.pdf
Essential information to be included in test cases
Doron Reuveni - The Mobile App Quality Challenge - EuroSTAR 2010

More from 99tests (20)

PDF
Restoration Hardware Case Study
PDF
BHIM App Case Study
PDF
Reverie Case Study
PDF
Allianz Case Study
PDF
99tests Corporate Brochure 2017
PDF
How Crowd Testing Works
PDF
Bhim app case study.ppt
PDF
Difference between crowd testing & in house QA
PDF
Need for automation testing
PPTX
99tests Market Guide For Mobile Wallets In India
PDF
Why Google Uses Crowd Testing
PDF
Top 5 Software Testing Skills For Testers
PDF
7 Factors to Consider While Developing Mobile Apps
PDF
21 infamous & expensive software bugs
PDF
99tests Corporate Brochure
PPT
Security testing
PPT
Localization testing
PPT
Automation testing
PPT
Allianz case study
PDF
99tests Software testing services
Restoration Hardware Case Study
BHIM App Case Study
Reverie Case Study
Allianz Case Study
99tests Corporate Brochure 2017
How Crowd Testing Works
Bhim app case study.ppt
Difference between crowd testing & in house QA
Need for automation testing
99tests Market Guide For Mobile Wallets In India
Why Google Uses Crowd Testing
Top 5 Software Testing Skills For Testers
7 Factors to Consider While Developing Mobile Apps
21 infamous & expensive software bugs
99tests Corporate Brochure
Security testing
Localization testing
Automation testing
Allianz case study
99tests Software testing services

Recently uploaded (20)

PDF
Wondershare Filmora 15 Crack With Activation Key [2025
PPTX
ai tools demonstartion for schools and inter college
PPTX
Introduction to Artificial Intelligence
PPTX
CHAPTER 2 - PM Management and IT Context
PPTX
history of c programming in notes for students .pptx
PPTX
Reimagine Home Health with the Power of Agentic AI​
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PDF
Digital Strategies for Manufacturing Companies
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PDF
System and Network Administraation Chapter 3
PPTX
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
PPTX
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
PPTX
Operating system designcfffgfgggggggvggggggggg
PDF
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
PPTX
Computer Software and OS of computer science of grade 11.pptx
PDF
medical staffing services at VALiNTRY
PPTX
Transform Your Business with a Software ERP System
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PDF
wealthsignaloriginal-com-DS-text-... (1).pdf
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
Wondershare Filmora 15 Crack With Activation Key [2025
ai tools demonstartion for schools and inter college
Introduction to Artificial Intelligence
CHAPTER 2 - PM Management and IT Context
history of c programming in notes for students .pptx
Reimagine Home Health with the Power of Agentic AI​
Odoo Companies in India – Driving Business Transformation.pdf
Digital Strategies for Manufacturing Companies
Design an Analysis of Algorithms II-SECS-1021-03
System and Network Administraation Chapter 3
Agentic AI Use Case- Contract Lifecycle Management (CLM).pptx
Oracle E-Business Suite: A Comprehensive Guide for Modern Enterprises
Operating system designcfffgfgggggggvggggggggg
Claude Code: Everyone is a 10x Developer - A Comprehensive AI-Powered CLI Tool
Computer Software and OS of computer science of grade 11.pptx
medical staffing services at VALiNTRY
Transform Your Business with a Software ERP System
Navsoft: AI-Powered Business Solutions & Custom Software Development
wealthsignaloriginal-com-DS-text-... (1).pdf
How to Migrate SBCGlobal Email to Yahoo Easily

Assure End User Experience By Testing In Real World Scenarios

  • 1. Assure End User Experience by Testing In Real World Scenarios Kaushik Nath Head of Product Strategy, 99tests Bharath S Director of Operations, 99tests
  • 3. 99tests - In A Nutshell Usability Testing Security Testing Functional Exploratory Testing Automation Testing Localisation Testing AuFn Ux LnSc 150+ Countries 20000+ Testers Test Case Driven Testing Tc
  • 4. 99tests Advantage Save money & time Access to top notch professional testers across globe App testing in the real world Easy integration Flexible Engagement Models Testers with Domain-Specific Knowledge
  • 5. How we work? Requirement gathering & analysis + Test strategy creation ( Through a personalized requirement discussion, Testing needs & plans are chalked out ) Project creation & launch Within 24 hours ( Testers & validators are assigned to the projects ) Monitoring Project progress ( Bug logging, Bug Validation & Testing coverage analysis ) Project delivery ( Sharing bug reports, Test Summary Reports & Recommendations )
  • 6. Crowd Testing - Relevance
  • 7. Testing For Customer Experience
  • 8. Real World Network Conditions
  • 9. Wide Variety in Screen Size
  • 11. Massive variety of OS versions + Customization of OS by manufacturers 100+ Companies
  • 12. Difficulty to test in a distributed environment
  • 13. Real People In Real Condition Google map vs. Apple map
  • 14. Challenges In Customer Experience Testing
  • 15. The Process ‱Clients give broad requirements. ‱Users, from the crowd, as they are like real users, are able to expand to large variety of end user expectations and requirements. ‱How do we choose the crowd in such case – We carefully choose with a broad demographics and expertise ‱Exploratory → Test Case (Carefully Designed) → Usability Testing with Non-Testers (Real Users).
  • 16. The 99tests Process Exploratory Test case Carefully Designed - Maximum Coverage Usability
  • 17. Case Study - Increasing The Review Rating A mid sized travel segment client No testing team, agile process, with 15 days release cycle Regular bug fixes and new features added to the application Web and Mobile Web Application What 99tests provided 25 testers across the globe with a mix of travel domain expertise Coverage of up to 50 devices Exploratory testing followed by regression cycles Results: Reduced the number of issues identified by their actual users Increase the quality index of the application from 4.2 to 4.8 User Review Rating
  • 18. Case Study - Enhanced End User Experience For A Leading Airline Service Enterprise In The APJ Region Large Enterprise Airline Booking Platform Huge testing team Web, Android and iOS application Monthly release cycle What 99tests provided 50 testers across the globe with a mix of travel and ticketing expertise Coverage of more than 50 configurations Exploratory testing followed by regression cycles Results: Critical bugs identified before release and reported to the client Increase of (Internal) Quality Index from 3.8 to 4.4