SlideShare a Scribd company logo
SESSION:
Lift testing:
Why, when and how it will transform your
business like it did for Custom Ink
Chris Berejik, SVP, Marketing
Custom Ink
July 23, 2019
Lift testing: Why, when, and how it will transform your business like it did for Custom Ink
2
The leader in custom apparel and products
● Founded in 1999 - as a website to make it easier to create &
design custom t-shirts online
● Headquartered in Fairfax, VA, with offices in Dallas, Reno,
Charlottesville, and LA
● Approximately $400M in annual revenue and over 1,600
employees
● Beyond t-shirts - Now offer business, performance,
activewear apparel and promotional products
● Cont. growth through fundraising apparel platform, influencer-
led apparel platform (Represent), stores, innovative design
tools, and a focus on customer service
3
When launching Facebook advertising, Custom Ink was
looking first for profitability and then for scale
Custom Ink Goal #1:
Find self-funding paid marketing channels
Facebook Goal:
Prove that Facebook-only-attributed ROAS
was greater than 3x
Custom Ink Goal #2:
Maximize scale of self-funded paid
channels to inflection point of diminishing
returns
Facebook Goal:
Ramp spend consistently while maintaining
above a 2x marginal ROAS
Profitability Scale
4
The problem: Facebook was self-reporting attractive ROAS, but was
not discounting for the portion of customers who would have made
purchases anyway
Campaign Audience
Facebook
Self-Reported
ROAS
Background
Purchase Rate of
Facebook Users
Facebook
Incremental
ROAS
Facebook Retargeting
Site visitors who
did not buy
30x ? ?
Facebook Reactivation Past customers 45x ? ?
So what was the real impact of Custom Ink Facebook ads?
5
The solution: Custom Ink worked with Social Fulcrum to run a lift test
and determine the real impact of its ads
Some customers saw
real Custom Ink ads
Some users saw ads
in a control group
This tracks the background
purchase behavior of
Facebook users
6
The results: The test showed that Facebook had a very attractive
incremental ROAS in both retargeting and reactivation campaigns
● Real ads generated $880K in
revenue
● Control ads generated $260K
in revenue
So, real ads generated $620K
in incremental revenue, or
15x incremental ROAS
7
This data helped us ask the board for the capital we needed
to fund the expansion of Facebook
Attribute Before Lift Test After Lift Test
Facebook self-reported results ✓ ✓
Incrementality of other paid channels ✓ ✓
Understanding of background purchase
behavior of Facebook users
✓
Incrementality of Facebook results ✓
Understanding of real impact of Custom Ink
Facebook ads
✓
Confidence ✓
8
In result, we grew Facebook revenue by 850% in 2 years
● Lift testing helped Custom Ink understand the incremental impact of
advertising on Facebook
● Custom Ink was able to scale spend on Facebook with the confidence that
the channel was generating incremental revenue
● As a result of this process, we have grown revenue from Facebook by 850%
in the past 2 years
9
What now?

More Related Content

PDF
150birds Sales Deck - Omnichannel Marketing Platform
PPTX
Deep Dive: How to put smarter cart abandonment marketing into play
PPTX
Incremental lift testing: Determine the true impact of your ad campaigns
PPTX
Case Study: Building smarter cart abandonment marketing
PPTX
Using Analytics to Improve Your Affiliate Marketing
PPTX
Profitable Customer Acquisition & Retention Strategies
PPTX
Start With the Customer – Using a Direct Marketing Automation Platform
PPTX
Profitable Customer Acquisition & Retention Strategies_Bronto
150birds Sales Deck - Omnichannel Marketing Platform
Deep Dive: How to put smarter cart abandonment marketing into play
Incremental lift testing: Determine the true impact of your ad campaigns
Case Study: Building smarter cart abandonment marketing
Using Analytics to Improve Your Affiliate Marketing
Profitable Customer Acquisition & Retention Strategies
Start With the Customer – Using a Direct Marketing Automation Platform
Profitable Customer Acquisition & Retention Strategies_Bronto

What's hot (20)

PDF
5 ways to convert holiday shoppers into loyal customers
PPTX
3 Advanced Google Shopping Strategies to Maximize Holiday Conversions
PPTX
Ask an Expert: How to Measure the Effectiveness of Your branding Campaigns
PDF
Facebook ads strategy e-commerce store
PDF
Driving Google Shopping Ad Relevancy Via The Manufacturer Center
PPTX
The E-Commerce Business’s Approach to Facebook Performance Marketing
PPTX
4 Facebook Ad Strategies for Ecommerce
PPTX
How Retail Marketers can Boost Their Facebook Advertising ROI in 2016
PDF
Segment Discovery (Brian Hawkins)
PPTX
Expert Q&A: The Top 13 Questions Affiliates Ask
PPTX
Paid Search & Social Advertising Made Easy - WordStream Webinar
PPTX
Custom Audiences: From Zero to Hero in 4 steps
PPTX
The Google Shopping Town Hall for Q4
PPTX
P19 technologys welcomed impact on labor cost 6.13.19
PPTX
EMERGENCY PRESS CONFERENCE: How Will Amazon’s New Review Policy Impact Sellers?
PDF
2016 Amazon Virtual Summit: Seller Labs
PPTX
How to Make Customer Satisfaction Your Key Differentiator
PPSX
Making an Efficient Generic Paid Search Strategy - 7thingsmedia - Figaro Sear...
PPTX
Top 10 Google Shopping Mistakes Draining Your Budget & How To Fix Them Today
PDF
LSA19: Amazon — Shifting Purchase Behaviors and the Advertising Mix
5 ways to convert holiday shoppers into loyal customers
3 Advanced Google Shopping Strategies to Maximize Holiday Conversions
Ask an Expert: How to Measure the Effectiveness of Your branding Campaigns
Facebook ads strategy e-commerce store
Driving Google Shopping Ad Relevancy Via The Manufacturer Center
The E-Commerce Business’s Approach to Facebook Performance Marketing
4 Facebook Ad Strategies for Ecommerce
How Retail Marketers can Boost Their Facebook Advertising ROI in 2016
Segment Discovery (Brian Hawkins)
Expert Q&A: The Top 13 Questions Affiliates Ask
Paid Search & Social Advertising Made Easy - WordStream Webinar
Custom Audiences: From Zero to Hero in 4 steps
The Google Shopping Town Hall for Q4
P19 technologys welcomed impact on labor cost 6.13.19
EMERGENCY PRESS CONFERENCE: How Will Amazon’s New Review Policy Impact Sellers?
2016 Amazon Virtual Summit: Seller Labs
How to Make Customer Satisfaction Your Key Differentiator
Making an Efficient Generic Paid Search Strategy - 7thingsmedia - Figaro Sear...
Top 10 Google Shopping Mistakes Draining Your Budget & How To Fix Them Today
LSA19: Amazon — Shifting Purchase Behaviors and the Advertising Mix
Ad

Similar to Lift testing: Why, when, and how it will transform your business like it did for Custom Ink (20)

PDF
WMF 2020 - Come misurare l'impatto incrementale dei tuoi ad Facebook nelle ca...
PPTX
Online Marketing Meetup ,Manchester
PDF
Amy Stamper HeroConf 2025 - The Truth Hurts_ Breaking Free from Misleading Ad...
PDF
Running better A/B tests: How to stop wasting time and money on bad tests
 
PDF
Understand A/B Testing in 9 use cases & 7 mistakes
PDF
Intuit - How to Scale Your Experimentation Program
PPT
Landing Page Testing To Increase Conversions
PPTX
Getting More From Facebook Ads
PPTX
Patrick McKenzie Opticon 2014: Advanced A/B Testing
PDF
Do You Even Lift?: Incrementality & Lift Testing Explained - Teresa Lewis, Adobe
PDF
Backstage 2019 - Accelerating Product Insights at Intuit - John Humphrey
PDF
Analytics Academy 2017 Presentation Slides
PPTX
A/B Testing for Everyone
PDF
#1NLab17 - Designing the Next Release: Measuring & Experimenting with Data
PPTX
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
PPTX
9 Influencer Marketing Metrics to Impress Your C-Suite
PDF
Pradeep Soundararajan - Testing for Sales and Competitor Analysis - EuroSTAR ...
PPTX
HeroConf LA - "How to Scale Facebook Ads with Automation", session with Sahil...
PDF
MEPRA Facebook & Social Media Evaluation Presentation
PPTX
Campaign Analytics and AB testing(1).pptx
WMF 2020 - Come misurare l'impatto incrementale dei tuoi ad Facebook nelle ca...
Online Marketing Meetup ,Manchester
Amy Stamper HeroConf 2025 - The Truth Hurts_ Breaking Free from Misleading Ad...
Running better A/B tests: How to stop wasting time and money on bad tests
 
Understand A/B Testing in 9 use cases & 7 mistakes
Intuit - How to Scale Your Experimentation Program
Landing Page Testing To Increase Conversions
Getting More From Facebook Ads
Patrick McKenzie Opticon 2014: Advanced A/B Testing
Do You Even Lift?: Incrementality & Lift Testing Explained - Teresa Lewis, Adobe
Backstage 2019 - Accelerating Product Insights at Intuit - John Humphrey
Analytics Academy 2017 Presentation Slides
A/B Testing for Everyone
#1NLab17 - Designing the Next Release: Measuring & Experimenting with Data
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
9 Influencer Marketing Metrics to Impress Your C-Suite
Pradeep Soundararajan - Testing for Sales and Competitor Analysis - EuroSTAR ...
HeroConf LA - "How to Scale Facebook Ads with Automation", session with Sahil...
MEPRA Facebook & Social Media Evaluation Presentation
Campaign Analytics and AB testing(1).pptx
Ad

More from National Retail Federation (20)

PPTX
Modernizing a legacy brand through retail marketing technology: How Del Monte...
PPTX
Unmistakably Target: The power of ‘Tar-zhay’ in a competitive environment
PPTX
Mastering digital personalization: Crafting unique journeys
PPTX
The social commerce opportunity: How brands are winning over Gen Z consumers ...
PDF
Forecasting the future: Consumer trends for 2025 and fireside chat with Rare ...
PPTX
Food safety guaranteed: Unveiling the technology solution for FSMA204 and beyond
PDF
Transform retail with AI: Elevating performance and enhancing human roles at ...
PPTX
From appetites to insights - How AI is mapping the entire customer journey
PPTX
Powering next-gen commerce through payments and checkout data
PDF
The state of commerce: Key trends and future predictions
PDF
The AI Playbook: How to capitalize on machine learning
PDF
Conversational digital humans: The future of retail?
PPTX
Drive enhanced customer experiences with the power of data
PPTX
Driving optimal decision-making in fresh grocery
PPTX
Five Guys and Flybuy - Challenges, innovations, and what's next
PPTX
Thermal intelligence - Advancing food safety and profitability for retailers
PDF
NRF 2023 Back-to-Class Consumer Trends
PPTX
Unlocking the power of in-session marketing to convert the anonymous
PDF
Navigating uncertainty: The art and science of learning and doing 10x in a te...
PDF
Building deeper empathy for your customers in uncertain times and beyond
Modernizing a legacy brand through retail marketing technology: How Del Monte...
Unmistakably Target: The power of ‘Tar-zhay’ in a competitive environment
Mastering digital personalization: Crafting unique journeys
The social commerce opportunity: How brands are winning over Gen Z consumers ...
Forecasting the future: Consumer trends for 2025 and fireside chat with Rare ...
Food safety guaranteed: Unveiling the technology solution for FSMA204 and beyond
Transform retail with AI: Elevating performance and enhancing human roles at ...
From appetites to insights - How AI is mapping the entire customer journey
Powering next-gen commerce through payments and checkout data
The state of commerce: Key trends and future predictions
The AI Playbook: How to capitalize on machine learning
Conversational digital humans: The future of retail?
Drive enhanced customer experiences with the power of data
Driving optimal decision-making in fresh grocery
Five Guys and Flybuy - Challenges, innovations, and what's next
Thermal intelligence - Advancing food safety and profitability for retailers
NRF 2023 Back-to-Class Consumer Trends
Unlocking the power of in-session marketing to convert the anonymous
Navigating uncertainty: The art and science of learning and doing 10x in a te...
Building deeper empathy for your customers in uncertain times and beyond

Recently uploaded (8)

PPTX
Business Benefits of Best Price Storage Containers in Manitoba.pptx
PPTX
Brand and tagline quiznnnnnnnnnnnnnnnnnn
PDF
Golden Star Crystal Wooden Trophies at Trophy-World Malaysia | Custom Trophie...
PPTX
Record Guys in Abilene, TX (Claudis Davis)
DOC
York毕业证学历认证,温哥华拉萨尔学院毕业证留学学历
PDF
Supermarket Floral Ad Roundup- Week 32 2025.pdf
PPTX
Redefining Organization with Affordable Storage Containers in Nova Scotia.pptx
PDF
Custom Round Plaques at Trophy-World Malaysia | Custom Trophies & Plaques Sup...
Business Benefits of Best Price Storage Containers in Manitoba.pptx
Brand and tagline quiznnnnnnnnnnnnnnnnnn
Golden Star Crystal Wooden Trophies at Trophy-World Malaysia | Custom Trophie...
Record Guys in Abilene, TX (Claudis Davis)
York毕业证学历认证,温哥华拉萨尔学院毕业证留学学历
Supermarket Floral Ad Roundup- Week 32 2025.pdf
Redefining Organization with Affordable Storage Containers in Nova Scotia.pptx
Custom Round Plaques at Trophy-World Malaysia | Custom Trophies & Plaques Sup...

Lift testing: Why, when, and how it will transform your business like it did for Custom Ink

  • 1. SESSION: Lift testing: Why, when and how it will transform your business like it did for Custom Ink Chris Berejik, SVP, Marketing Custom Ink July 23, 2019
  • 3. 2 The leader in custom apparel and products ● Founded in 1999 - as a website to make it easier to create & design custom t-shirts online ● Headquartered in Fairfax, VA, with offices in Dallas, Reno, Charlottesville, and LA ● Approximately $400M in annual revenue and over 1,600 employees ● Beyond t-shirts - Now offer business, performance, activewear apparel and promotional products ● Cont. growth through fundraising apparel platform, influencer- led apparel platform (Represent), stores, innovative design tools, and a focus on customer service
  • 4. 3 When launching Facebook advertising, Custom Ink was looking first for profitability and then for scale Custom Ink Goal #1: Find self-funding paid marketing channels Facebook Goal: Prove that Facebook-only-attributed ROAS was greater than 3x Custom Ink Goal #2: Maximize scale of self-funded paid channels to inflection point of diminishing returns Facebook Goal: Ramp spend consistently while maintaining above a 2x marginal ROAS Profitability Scale
  • 5. 4 The problem: Facebook was self-reporting attractive ROAS, but was not discounting for the portion of customers who would have made purchases anyway Campaign Audience Facebook Self-Reported ROAS Background Purchase Rate of Facebook Users Facebook Incremental ROAS Facebook Retargeting Site visitors who did not buy 30x ? ? Facebook Reactivation Past customers 45x ? ? So what was the real impact of Custom Ink Facebook ads?
  • 6. 5 The solution: Custom Ink worked with Social Fulcrum to run a lift test and determine the real impact of its ads Some customers saw real Custom Ink ads Some users saw ads in a control group This tracks the background purchase behavior of Facebook users
  • 7. 6 The results: The test showed that Facebook had a very attractive incremental ROAS in both retargeting and reactivation campaigns ● Real ads generated $880K in revenue ● Control ads generated $260K in revenue So, real ads generated $620K in incremental revenue, or 15x incremental ROAS
  • 8. 7 This data helped us ask the board for the capital we needed to fund the expansion of Facebook Attribute Before Lift Test After Lift Test Facebook self-reported results ✓ ✓ Incrementality of other paid channels ✓ ✓ Understanding of background purchase behavior of Facebook users ✓ Incrementality of Facebook results ✓ Understanding of real impact of Custom Ink Facebook ads ✓ Confidence ✓
  • 9. 8 In result, we grew Facebook revenue by 850% in 2 years
  • 10. ● Lift testing helped Custom Ink understand the incremental impact of advertising on Facebook ● Custom Ink was able to scale spend on Facebook with the confidence that the channel was generating incremental revenue ● As a result of this process, we have grown revenue from Facebook by 850% in the past 2 years 9 What now?