SlideShare a Scribd company logo
THE MILLION DOLLAR CASE STUDY
Session #15:
How To Split Test For
Improved Conversions
Journey to $1MM
May 31st, 2017
100% to
What is split
testing?
Controlled
Randomized
Experiment
Between two or more
variations...
2
Will lead to Improved Metrics
(ie click through rate,
conversions, profits, etc)
3 Reasons Why Split Tests Are Invaluable
Improve Conversion Rate:
An increase in your conversion rate
will increase your sales, and the
increased sales velocity increases
your rank, and gets you even more
sales.
All of this without needing to spend
on PPC or reduce your price etc.
Get More Visitors:
An increase in your sessions (from
CTR or keywords) has a similar
benefit.
Price Wisely:
The ROI of having your price where
it’s most effective can be
enormous.
The Trick Of Split Testing: Be Methodical
It’s like flipping a weighted coin, the more times you flip it, the more
sure you can be which way it’s weighted.
Split testing is an ongoing process.
Market conditions, seasons, customer demand, competition,
(and more) are constantly changing.
So best change your listing with the different
versions many times, as opposed to just once.
Split testing, Amazon style:
Amazon only gives traffic data on a
daily basis (therefore must make
changes daily at 12 midnight)
Sales velocity affects search rank (30
day rolling average)
5
How to do a split test manually
6
1. Decided on the different versions of your product you would like to test. We recommend keeping it simple here and just
having 2 versions, an A/B test.
2. Wait until midnight of your listings Amazon Marketplace; This would be PDT for amazon.com
3. Referring to these versions as variant A, and variant B, update your listing to variant A.
4. The following midnight, update your listing to variant B.
5. Keep repeating this process, we recommend for 2 weeks, so as each variant gets one day of the week.
6. In seller central, business reports, “detailed sales and traffic by asin”, set this report’s date range to one day,
corresponding to the first day of your test.
7. Record the sessions, page views, total orders, units ordered, and conversion rate.
8. Do the same for each day of your test, noting which data corresponds to which variant.
9. At this point, we can see which variant is winning, by simply adding up the data for each of them. However it’s important
to calculate the statistical significance. The easiest way is to just input your data into an online calculator
10. A statistical significance of above 90% is pretty reliable. If it is less than this, we recommend continuing your test some
more.
What Should You Test?
1. The best products to test are your
best sellers (assuming multiple
products).
1. Greatest lever for Sales and Profits
growth involve a Price or Image test
What Affects Sessions On Your Product Listing?
Title
Main Image
Price
What About Your Detail Page Affects Conversion Rate?
Title
All images
Price
Bullets
Description
Testing Main Image affects both Sessions and
Conversions Rate
VS
10
The Split Testing Process
Create
Your
Hypothesis
11
Identify
What/How
To Test
Run Your
Experiment
Measure
Results
Rinse &
Repeat
What’s the
bottom
line?
12
Use a data-driven approach to
outperform your competition.
Use code ‘Million’ for
25% off your first month on
A Small Gift

More Related Content

PPTX
Tthe Insider's Guide to Running Amazon Split Tests
PDF
Jungle Scout's Million Dollar Case Study Session #13: Amazon Pay Per Click
PPTX
The Million Dollar Case Study: Session #19: Optimizing PPC Campaigns
PPTX
Selling on Amazon 101 – Best Practice
PPTX
Selling on Amazon – Best Practice by Joel Lentz
PPTX
Amazon Search Engine Optimization and Ranking Best Practices
PDF
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
PDF
Million Dollar Case Study: Europe – Session #15 – Amazon Product Launch Europe
Tthe Insider's Guide to Running Amazon Split Tests
Jungle Scout's Million Dollar Case Study Session #13: Amazon Pay Per Click
The Million Dollar Case Study: Session #19: Optimizing PPC Campaigns
Selling on Amazon 101 – Best Practice
Selling on Amazon – Best Practice by Joel Lentz
Amazon Search Engine Optimization and Ranking Best Practices
Jungle Scout's Million Dollar Case Study: Crafting an optimized amazon listing
Million Dollar Case Study: Europe – Session #15 – Amazon Product Launch Europe

What's hot (20)

PDF
Jungle Scout's Million Dollar Case Study Session #12: Preparing for Launch
PDF
Million Dollar Case Study Europe – Session #19 – MDCS Updates
PDF
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
PPTX
Amazon PPC automation with Sellics
PDF
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
PDF
Amazon ppc management
PPTX
The 2017 Amazon Virtual Summit: Day 3
PDF
How To Drive Incremental Sales on Amazon – We Found The Missing Link
PDF
Accelerating Amazon Sales Strategy for Q4 2015: Day 2
PDF
Brightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
PDF
Cpc Strategy & Amazon on the New Sponsored Products Updates
PPTX
The 2017 Amazon Virtual Summit: Day 2
PPTX
How to Generate Product Reviews on Amazon
PPT
PPC 360 Presentation - Smart China Sourcing Summit - Hong Kong 2016
PDF
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
PPTX
Increasing Visibility on the Amazon Marketplace
PPTX
Jungle Scout's Million Dollar Case Study - Inventory Management
PPTX
Amazon product sponsored ads: Case study by BM Consulting
PPT
Growing Private Label with Amazon
PPTX
How Vendors Can Avoid Amazon Chargeback Fees
Jungle Scout's Million Dollar Case Study Session #12: Preparing for Launch
Million Dollar Case Study Europe – Session #19 – MDCS Updates
Million Dollar Case Study: Europe – Session #16 – Launching With Amazon PPC
Amazon PPC automation with Sellics
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
Amazon ppc management
The 2017 Amazon Virtual Summit: Day 3
How To Drive Incremental Sales on Amazon – We Found The Missing Link
Accelerating Amazon Sales Strategy for Q4 2015: Day 2
Brightpearl - Fulfillment & Inventory Control Management for Amazon Sellers
Cpc Strategy & Amazon on the New Sponsored Products Updates
The 2017 Amazon Virtual Summit: Day 2
How to Generate Product Reviews on Amazon
PPC 360 Presentation - Smart China Sourcing Summit - Hong Kong 2016
AmafestUK 2020 -Florian nottorf - 5 Amazon PPC Hacks:Maximize sales on amazon...
Increasing Visibility on the Amazon Marketplace
Jungle Scout's Million Dollar Case Study - Inventory Management
Amazon product sponsored ads: Case study by BM Consulting
Growing Private Label with Amazon
How Vendors Can Avoid Amazon Chargeback Fees
Ad

Viewers also liked (16)

PPTX
Jungle Scout's Million Dollar Case Study - amazon marketing services how to ...
PPTX
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
PDF
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
PDF
Jungle Scout's Million Dollar Case Study: Reviewing Samples
PDF
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
PDF
The Million Dollar Case Study - Outreach to Suppliers
PPTX
12 Tips for Creating Amazon Product Listings That Outsell The Competition
PPTX
The Secrets of Importing Your Amazon Product
PPTX
Jungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
PDF
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
PPTX
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
PDF
How To Find A Good Supplier For Your Amazon Product
PDF
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
PPTX
Master Inventory Replenishment: The FBA Sellers Guide To Inventory Management
PPTX
Jungle Scout's Million Dollar Case Study: How To Find Product Ideas
PPTX
Jungle Scout's million dollar case study session #16: Updates and Q&A
Jungle Scout's Million Dollar Case Study - amazon marketing services how to ...
Jungle Scout's Million Dollar Case Study Session #20: Amazon Marketing Servic...
Jungle Scout's Million Dollar Case Study Session #10: Tax and Legal Structure
Jungle Scout's Million Dollar Case Study: Reviewing Samples
Jungle Scout's Million Dollar Case Study: Intellectual Property and Protectin...
The Million Dollar Case Study - Outreach to Suppliers
12 Tips for Creating Amazon Product Listings That Outsell The Competition
The Secrets of Importing Your Amazon Product
Jungle Scout's Million Dollar Case Study Session #8: Shipping & Importing
Jungle Scout's Million Dollar Case Study: Session #2: Advanced Product Research
Million Dollar Case Study: Europe - Session #10 - Amazon Supplier Agreements
How To Find A Good Supplier For Your Amazon Product
Jungle Scout's Million Dollar Case Study Session #7: Branding & Package Design
Master Inventory Replenishment: The FBA Sellers Guide To Inventory Management
Jungle Scout's Million Dollar Case Study: How To Find Product Ideas
Jungle Scout's million dollar case study session #16: Updates and Q&A
Ad

Similar to Split testing for amazon sellers (20)

PDF
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
PDF
Introduction to ab_testing_for_marketing_optimization
PDF
Google optimizer
PPTX
Testing Is Not CRO But It’s Still Darn Important
PPTX
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
PPTX
Losing is the New Winning
PDF
What is AB testing, and why do you need it.pdf
PPTX
Elise Morel - Winning the SEO game with split testing - BrightonSEO [Auto-sav...
PDF
Maximizing Sales Using A/B Testing
PPTX
Develop a CRO & Testing Strategy - Convert Traffic Into Sale
PPT
Landing Page Testing to Attract Super Affiliates
PDF
A/B Testing: Fine-Tune Your Ads for Optimal Results
PPT
Only 4.6% of Marketers can Spot a Winning Landing Page – Can You?
PDF
Conversion Rate Optimisation Guide
PPT
Multivariate DIY - Daigneault
PPTX
Supercharge Your Testing Program
PDF
Webinar_ Demystifying A_B Testing_ Simplified Success for Your Campaigns (1).pdf
 
PDF
How to Keep Up Your Creative Testing After Budget Cuts
PPTX
Boosting Ecommerce Conversions and Revenue With A/B Testing
PPTX
Conversion Rate Optimization
Can I Test More Than One Variable at a Time? Statisticians answer some of th...
Introduction to ab_testing_for_marketing_optimization
Google optimizer
Testing Is Not CRO But It’s Still Darn Important
Conversion Rate Optimisation: The Science Behind Turning Visitors Into Customers
Losing is the New Winning
What is AB testing, and why do you need it.pdf
Elise Morel - Winning the SEO game with split testing - BrightonSEO [Auto-sav...
Maximizing Sales Using A/B Testing
Develop a CRO & Testing Strategy - Convert Traffic Into Sale
Landing Page Testing to Attract Super Affiliates
A/B Testing: Fine-Tune Your Ads for Optimal Results
Only 4.6% of Marketers can Spot a Winning Landing Page – Can You?
Conversion Rate Optimisation Guide
Multivariate DIY - Daigneault
Supercharge Your Testing Program
Webinar_ Demystifying A_B Testing_ Simplified Success for Your Campaigns (1).pdf
 
How to Keep Up Your Creative Testing After Budget Cuts
Boosting Ecommerce Conversions and Revenue With A/B Testing
Conversion Rate Optimization

Recently uploaded (20)

PPTX
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
PPTX
hnk joint business plan for_Rooftop_Plan
PPTX
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
PDF
SEO vs. AEO: Optimizing for Google vs AI-Powered Search Assistants
PDF
Building a strong social media presence.
PDF
exceptionalinsights.group visitor traffic statistics 08-08-25
PPTX
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
PPTX
Ranking a Webpage with SEO (And Tracking It with the Right Attribution Type a...
PDF
Mastering Bulk Email Campaign Optimization for 2025
PDF
Keshav Solutions Pest Control || Trending Branding Digital Solutions
PDF
Digital Marketing Agency vs Freelancers and VAs: Which Should You Hire in 2025
DOCX
procubiz_modern digital marketingblog.docx
PDF
Dream Powell - Project and Portfolio 3: Marketing
PDF
Best digital marketing company in Mumbai
PDF
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
PPTX
Choose the Right SEO Agency India - 7 Key Tips by Clickbold Media
PPTX
Your score increases as you pick a category, fill out a long description and ...
PPTX
Presentation - GreenPantry – Instagram-First Home Kitchen Brand.pptx
PDF
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
PPTX
Strategic Sage Digital-The Professional Digital Marketing Company in Mohali.pptx
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
hnk joint business plan for_Rooftop_Plan
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
SEO vs. AEO: Optimizing for Google vs AI-Powered Search Assistants
Building a strong social media presence.
exceptionalinsights.group visitor traffic statistics 08-08-25
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
Ranking a Webpage with SEO (And Tracking It with the Right Attribution Type a...
Mastering Bulk Email Campaign Optimization for 2025
Keshav Solutions Pest Control || Trending Branding Digital Solutions
Digital Marketing Agency vs Freelancers and VAs: Which Should You Hire in 2025
procubiz_modern digital marketingblog.docx
Dream Powell - Project and Portfolio 3: Marketing
Best digital marketing company in Mumbai
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
Choose the Right SEO Agency India - 7 Key Tips by Clickbold Media
Your score increases as you pick a category, fill out a long description and ...
Presentation - GreenPantry – Instagram-First Home Kitchen Brand.pptx
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
Strategic Sage Digital-The Professional Digital Marketing Company in Mohali.pptx

Split testing for amazon sellers

  • 1. THE MILLION DOLLAR CASE STUDY Session #15: How To Split Test For Improved Conversions Journey to $1MM May 31st, 2017 100% to
  • 2. What is split testing? Controlled Randomized Experiment Between two or more variations... 2 Will lead to Improved Metrics (ie click through rate, conversions, profits, etc)
  • 3. 3 Reasons Why Split Tests Are Invaluable Improve Conversion Rate: An increase in your conversion rate will increase your sales, and the increased sales velocity increases your rank, and gets you even more sales. All of this without needing to spend on PPC or reduce your price etc. Get More Visitors: An increase in your sessions (from CTR or keywords) has a similar benefit. Price Wisely: The ROI of having your price where it’s most effective can be enormous.
  • 4. The Trick Of Split Testing: Be Methodical It’s like flipping a weighted coin, the more times you flip it, the more sure you can be which way it’s weighted. Split testing is an ongoing process. Market conditions, seasons, customer demand, competition, (and more) are constantly changing. So best change your listing with the different versions many times, as opposed to just once.
  • 5. Split testing, Amazon style: Amazon only gives traffic data on a daily basis (therefore must make changes daily at 12 midnight) Sales velocity affects search rank (30 day rolling average) 5
  • 6. How to do a split test manually 6 1. Decided on the different versions of your product you would like to test. We recommend keeping it simple here and just having 2 versions, an A/B test. 2. Wait until midnight of your listings Amazon Marketplace; This would be PDT for amazon.com 3. Referring to these versions as variant A, and variant B, update your listing to variant A. 4. The following midnight, update your listing to variant B. 5. Keep repeating this process, we recommend for 2 weeks, so as each variant gets one day of the week. 6. In seller central, business reports, “detailed sales and traffic by asin”, set this report’s date range to one day, corresponding to the first day of your test. 7. Record the sessions, page views, total orders, units ordered, and conversion rate. 8. Do the same for each day of your test, noting which data corresponds to which variant. 9. At this point, we can see which variant is winning, by simply adding up the data for each of them. However it’s important to calculate the statistical significance. The easiest way is to just input your data into an online calculator 10. A statistical significance of above 90% is pretty reliable. If it is less than this, we recommend continuing your test some more.
  • 7. What Should You Test? 1. The best products to test are your best sellers (assuming multiple products). 1. Greatest lever for Sales and Profits growth involve a Price or Image test
  • 8. What Affects Sessions On Your Product Listing? Title Main Image Price
  • 9. What About Your Detail Page Affects Conversion Rate? Title All images Price Bullets Description
  • 10. Testing Main Image affects both Sessions and Conversions Rate VS 10
  • 11. The Split Testing Process Create Your Hypothesis 11 Identify What/How To Test Run Your Experiment Measure Results Rinse & Repeat
  • 12. What’s the bottom line? 12 Use a data-driven approach to outperform your competition.
  • 13. Use code ‘Million’ for 25% off your first month on A Small Gift

Editor's Notes

  • #11: Example of something effecting conversion rate and CTR