SlideShare a Scribd company logo
Mobile A/B Testing: Best Practices,
Pretotyping and Why It's a Good
Alternative to App Prototyping
Lina Danilchik
Marketing Manager Senior ASO consultant
Maggie Ngai
Pretotyping. What is it?
Pretotype is an image that conveys the idea of a product.
Mobile app title, icon, description and screenshots designed to reflect its
setting and features together make up an app’s pretotype.
What can serve as app pretotypes?
How publishers
validate app ideas
via pretotyping
Once you’re ready with your app’s
pretotypes – several versions of app
title, description, icon & screenshots –
proceed to validating your app idea with
the help of a third-party A/B testing
platform.
How mobile A/B
testing works together
with pretotyping
A/B Testing Capabilities for Mobile
App Idea Validation
Test your mobile
app idea
Test mobile game
setting
Compare a few mobile
app concepts
Validate or
prioritize app
features
Decide on targeting
& positioning
Test your app idea
and decide if you
should build it
Compare a few app concepts & select the best
one
Decide on targeting
and positioning
Decide on localization
Feature validation: prioritize your app features
Test mobile game setting
Test mobile game styles and characters
Main metrics to rely
on when running A/B
tests on SplitMetrics
7 Biggest Mistakes in Mobile A/B Testing
Mistake №2
Finishing an experiment before
7 days have passed
Mistake №1
Finishing an experiment before you
get the right amount of traffic
7 Biggest Mistakes in Mobile A/B Testing
Mistake №4
Your banner ads have the same design
as one of the app store visual assets
Mistake №3
Testing too small changes
in design
7 Biggest Mistakes in Mobile A/B Testing
Mistake №5
Testing several hypotheses at once
7 Biggest Mistakes in Mobile A/B Testing
Mistake №6
Misinterpreting the situation when two
variations are the same but you get a
winner
Mistake №7
Getting upset when a new variation
loses to the current one
Thank you!
If you have any questions, feel free to reach out to us on LinkedIn or via email:
lina.d@splitmetrics.com & maggie.ngai@phiture.com

More Related Content

PDF
SplitMetrics answers burning questions on mobile A/B testing
PDF
The Promise of Personalization: How to Create Meaningful Consumer Experiences...
PDF
Success Story: Flowkey and SearchAdsHQ
PDF
Apply A/B Testing with NGINX Routing Policy
PDF
Optimizely Experience Customer Story - Atlassian
PPTX
Improve your content: The What, Why, Where and How about A/B Testing
PDF
Creating an Effective A/B Testing Strategy for App Stores
PDF
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...
SplitMetrics answers burning questions on mobile A/B testing
The Promise of Personalization: How to Create Meaningful Consumer Experiences...
Success Story: Flowkey and SearchAdsHQ
Apply A/B Testing with NGINX Routing Policy
Optimizely Experience Customer Story - Atlassian
Improve your content: The What, Why, Where and How about A/B Testing
Creating an Effective A/B Testing Strategy for App Stores
The Optimizely Experience Keynote by Matt Althauser - Optimizely Experience L...

What's hot (19)

PDF
Optimizely Partner Ecosystem
PDF
Optimizely Workshop: Mobile Walkthrough
PPTX
VWO Webinar: How To Plan Your Optimisation Roadmap
 
PDF
Getting Started with Server-Side Testing
PPTX
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
PDF
The anatomy of an A/B Test - JSConf Colombia Workshop
PDF
MAU Vegas 2016 — How to Build an Internal Growth Culture
PDF
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
PDF
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
PDF
Optimizely X Seminar Amsterdam Nov 10
PPT
Preparing for a Website Redesign | SEO Design
PPTX
Retain or Die: The Retention Playbook
PPTX
MAU Vegas 2016 — Tackling Retention During Activation
PDF
Optimizely Experience - LA - Disney-ABC
PDF
4 Steps Toward Scientific A/B Testing
PDF
Workshop 6: Build Your Organization's Optimization Culture
PDF
Website Redesigns: Why they Fail and How to Ensure Success
PDF
Cox Automotive: Testing Across Multiple Brands
PDF
Optimize Everything : A framework for solving your BIGGEST Problems Through O...
Optimizely Partner Ecosystem
Optimizely Workshop: Mobile Walkthrough
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Getting Started with Server-Side Testing
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
The anatomy of an A/B Test - JSConf Colombia Workshop
MAU Vegas 2016 — How to Build an Internal Growth Culture
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
Optimizely X Seminar Amsterdam Nov 10
Preparing for a Website Redesign | SEO Design
Retain or Die: The Retention Playbook
MAU Vegas 2016 — Tackling Retention During Activation
Optimizely Experience - LA - Disney-ABC
4 Steps Toward Scientific A/B Testing
Workshop 6: Build Your Organization's Optimization Culture
Website Redesigns: Why they Fail and How to Ensure Success
Cox Automotive: Testing Across Multiple Brands
Optimize Everything : A framework for solving your BIGGEST Problems Through O...
Ad

Similar to Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture (20)

PPT
Mob4Hire Mobile App Usability (MobExperience) Overview
PPT
Mobile Usability Overview
PDF
Mobile App Development Proposal Template PowerPoint Presentation Slides
PDF
Apps are destroyed in these ways....
DOCX
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
PDF
Are you a lean mobile startup? Applying lean startup principles to mobile app...
PPTX
POC vs MVP vs Prototype: What's The Key Differences?
PPTX
Competitive analysis for mobile apps.pptx
DOCX
Industry Experts on How to Build Really Good Mobile Application
PDF
One-Pager: App Intelligence
PDF
Benefits & Best Practices to Develop Minimum Viable Product For Startups
PPTX
Top 10 questions to answer before you hire mobile app developers
PPTX
Top 10 questions to answer before you hire mobile app developers
PDF
Testing Mobile Apps
PDF
10 stages of mobile app development process 2022
DOCX
Sayanti Mondal CV
PPTX
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PDF
Top 10 Factors to Check Before Hiring a Mobile App Development Company.pdf
PDF
7 Factors to Consider While Developing Mobile Apps
PPTX
How much does it cost to develop an app? - The million dollar question
Mob4Hire Mobile App Usability (MobExperience) Overview
Mobile Usability Overview
Mobile App Development Proposal Template PowerPoint Presentation Slides
Apps are destroyed in these ways....
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
Are you a lean mobile startup? Applying lean startup principles to mobile app...
POC vs MVP vs Prototype: What's The Key Differences?
Competitive analysis for mobile apps.pptx
Industry Experts on How to Build Really Good Mobile Application
One-Pager: App Intelligence
Benefits & Best Practices to Develop Minimum Viable Product For Startups
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
Testing Mobile Apps
10 stages of mobile app development process 2022
Sayanti Mondal CV
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
Top 10 Factors to Check Before Hiring a Mobile App Development Company.pdf
7 Factors to Consider While Developing Mobile Apps
How much does it cost to develop an app? - The million dollar question
Ad

More from SplitMetrics (11)

PDF
Conversion optimization with A/B testing throughout app lifecycle
PDF
How to fortify UA strategy with creatives testing
PDF
The impact of COVID-19 on Apple Search Ads
PPTX
Apple Search Ads (RU): advantages, strategies, correlation with ASO
PDF
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
PDF
How to Create High Converting App Previews
PDF
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
PDF
Apple Search Ads Scaling and Optimization by SearchAdsHQ
PDF
All You Need to Know About ASA Keywords by AppTweak
PDF
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
PDF
ASA Influence on Organic Ranking by AppTweak
Conversion optimization with A/B testing throughout app lifecycle
How to fortify UA strategy with creatives testing
The impact of COVID-19 on Apple Search Ads
Apple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
How to Create High Converting App Previews
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQ
All You Need to Know About ASA Keywords by AppTweak
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
ASA Influence on Organic Ranking by AppTweak

Recently uploaded (20)

PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Encapsulation theory and applications.pdf
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Machine learning based COVID-19 study performance prediction
PDF
Electronic commerce courselecture one. Pdf
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
Big Data Technologies - Introduction.pptx
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
Spectroscopy.pptx food analysis technology
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
cuic standard and advanced reporting.pdf
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
“AI and Expert System Decision Support & Business Intelligence Systems”
Encapsulation theory and applications.pdf
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Machine learning based COVID-19 study performance prediction
Electronic commerce courselecture one. Pdf
MIND Revenue Release Quarter 2 2025 Press Release
Digital-Transformation-Roadmap-for-Companies.pptx
Unlocking AI with Model Context Protocol (MCP)
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Big Data Technologies - Introduction.pptx
Review of recent advances in non-invasive hemoglobin estimation
Spectral efficient network and resource selection model in 5G networks
Per capita expenditure prediction using model stacking based on satellite ima...
The Rise and Fall of 3GPP – Time for a Sabbatical?
Mobile App Security Testing_ A Comprehensive Guide.pdf
Spectroscopy.pptx food analysis technology
Diabetes mellitus diagnosis method based random forest with bat algorithm
cuic standard and advanced reporting.pdf

Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture

  • 1. Mobile A/B Testing: Best Practices, Pretotyping and Why It's a Good Alternative to App Prototyping Lina Danilchik Marketing Manager Senior ASO consultant Maggie Ngai
  • 2. Pretotyping. What is it? Pretotype is an image that conveys the idea of a product.
  • 3. Mobile app title, icon, description and screenshots designed to reflect its setting and features together make up an app’s pretotype. What can serve as app pretotypes?
  • 4. How publishers validate app ideas via pretotyping Once you’re ready with your app’s pretotypes – several versions of app title, description, icon & screenshots – proceed to validating your app idea with the help of a third-party A/B testing platform.
  • 5. How mobile A/B testing works together with pretotyping
  • 6. A/B Testing Capabilities for Mobile App Idea Validation Test your mobile app idea Test mobile game setting Compare a few mobile app concepts Validate or prioritize app features Decide on targeting & positioning
  • 7. Test your app idea and decide if you should build it
  • 8. Compare a few app concepts & select the best one
  • 11. Feature validation: prioritize your app features
  • 12. Test mobile game setting
  • 13. Test mobile game styles and characters
  • 14. Main metrics to rely on when running A/B tests on SplitMetrics
  • 15. 7 Biggest Mistakes in Mobile A/B Testing Mistake №2 Finishing an experiment before 7 days have passed Mistake №1 Finishing an experiment before you get the right amount of traffic
  • 16. 7 Biggest Mistakes in Mobile A/B Testing Mistake №4 Your banner ads have the same design as one of the app store visual assets Mistake №3 Testing too small changes in design
  • 17. 7 Biggest Mistakes in Mobile A/B Testing Mistake №5 Testing several hypotheses at once
  • 18. 7 Biggest Mistakes in Mobile A/B Testing Mistake №6 Misinterpreting the situation when two variations are the same but you get a winner Mistake №7 Getting upset when a new variation loses to the current one
  • 19. Thank you! If you have any questions, feel free to reach out to us on LinkedIn or via email: lina.d@splitmetrics.com & maggie.ngai@phiture.com