SlideShare a Scribd company logo
Tes$ng	
  Your	
  Crea$ve:	
  	
  
Small	
  Changes	
  with	
  Big	
  Effects	
  
By	
  Carrie	
  Albright	
  
Join	
  us	
  on	
  Twi6er	
  at	
  #Mozinar	
  
Ques;ons	
  or	
  problems?	
  Email	
  community@moz.com	
  
Agenda
q  Introduction to ad testing
q  Setting up an ad test, including 23 test ideas
q  Preparing for your ad test
q  Create your ads
q  Determining success – The Metric You Choose
q  The Good Stuff - 10 real tests & results we’ve seen
q  Timeline review
Introduction to ad testing
Why test?
FEATURES BENEFITS CALL TO
ACTION
FREE SHIPPING SAVES MONEY QUALIFY FOR
FREE SHIPPING
NEW ARRIVALS MOST UP-TO-DATE
STYLES
FIND THE LATEST
TRENDS
PROMO CODE GUARANTEED
DEAL
SAVE TODAY
1) To learn what matters to our customers
Why test?
2) Increased traffic/reach
Emotional Appeal
Site Content
Existing Traffic
Why test?
3) Account health matters.
Ad
testing
Higher CTR &
Relevance
Higher Quality
Score
Lower CPCs
Improved
Average
Position
Why test?
3) Account health matters.
Why test?
4) Improve messaging across all channels
Display	
  Buys	
  
Email	
  Marke;ng	
  
Search	
  Engine	
  Op;miza;on	
  
Direct	
  Mail	
  
Social	
  Media	
  
Television	
  &	
  Video	
  
Paid	
  Search	
  
Setting Up
Setting Up
q  Test subjects
q  Test audience
q  Test timeline
Branded
Campaign
Content/
Volume
Academic
Program
High
Funnel
Terms
Geo-
targeted
program
Specific
conversion
type
Non-
Branded
Product
Non-CRO
campaigns
Specific
course
offerings
Regional/
Cities
Seasonal
Main site
content
Choose your guinea pigs
Segmentation is your friend
Campaign segmentation
Device segmentation
Mobile
landing page
Mobile-specific
messaging
For the
love of
DATA
Promotions & Seasonality
Killer ads or seasonal trends?
Major breaks in
data and
messaging
What to test?
FULL	
  PAGE	
  IMAGE	
  
So. Many. Choices.
What to test? 1-4
Features
Free Shipping!
Benefit
Risk-Free Trial
NEW promotion
Now In 3 Convenient Order Options
Question
Ready To Publish Your Book?
What to test? 5-8
Personas
Audience
Age, Family Status, Affluence,
Profession
Pragmatic
Learn Basic Programming In Our
12wk Online Course.
Emotional
Worry, Pride, Concern, Celebratory
What to test? 9-11
Testimonials
Read Client
Testimonials
Product or
Service Price
Business Loans from
$2k-$50k
Location
Nursing School in
Boston
What to test? 12-15
E-Comm
Ad Customizers
Over 254 Styles Available
Deadline or Urgency
Sale Ends Soon
Lead Gen
Ad Customizers
Only 3 Seats Left- Book Now!
Competitor Messaging
They say / We say
What to test? 16-19
Punctuation
100% Guaranteed!
Display URL
www.Moz.com/Webinar
vs
www.Moz.com
Promotional Details
Enter code SAVNW at Checkout
Extended Headline
What to test? 20-23
Title Case
vs
Sentence case
Ownership
Symbols
Message
Placement
REI® vs REI
Preparing
to test your
Creative	
  
Equal rotation
Bing
Ad group level
setting
Google
Campaign level
setting
Equal rotation
Quick check:
Device Segmentation
This is a mobile world.
Get with it.
Device Segmentation
Google Bing
Create your
Ad monster
Create your ads
1.  Create ads in your format of choice.
Diagram your test
TIER 1 ROUND 1
Track your progress
Shortcuts:
Labels
Adtags
Tracking system
Success
YOU
YOUR AD
TESTING
JOURNEY
“Is my goal to…?”
Maintain ad health while generating leads
Increase lead volume
Increase sales volume
Increase other metric, such as onsite chats or searches
Increase site traffic
Generate cost efficient sales
Get the greatest profit from top messaging
Find the best landing page experience for your visitors
Click Through Rate
Conversion Rate
Conversion Rate
Impression until conversion
ROAS
Click Through Rate
Profit per Click
Trick Question!
Concluding a test
q  Volume
q  Limited Time Frame
q  Statistical Significance
Conclude by significance
Example resources:
http://abtester.com/calculator/ http://drpete.co/split-test-calculator
Selling it
CRO Test
16.1% increased Conv Rate
Ad Testing
3.05X Increase in CTR
10.4% Increase in Conv Rate
The Good Stuff
Lightning Round Ad Test Results
Test 1 – Enrollment Countdown
Industry - Education
Test 2 – Trademark in copy
Industry : Health Supplements
Test 3 – Call to Action Placement
Click
Through
Rate Δ
=
32.76%
for Test
Control
D1 Feature / D2 CTA
vs.
Test
D1 CTA / D2 Feature
Industry: Resort
Test 4 – Display URL
Program Location in Display URL Product in Display URL
Final Impression until
Conversion:
1816
Final Impression until
Conversion:
2494
Winner: Location URL, with 27% decrease in IUC.
Industry: Technological
Test 5 – Mobile Messaging
Industry : E-commerce
q  Low conversion rate on mobile devices
q  High inter-device correlation
Control ad:
Shop ___ Styles On Your
Phone in Description Line 1.
Test ad: Free Shipping in
Description line 1. 16.31%
greater
CTR!
Test 6 – Experience vs Credibility
Industry : Travel
Control Ad – Tour experience Test Ad – Customers’ Reviews
CTR: 1.50% CTR: 1.26%
Test 7 – Promotional Details
Control Results
CTR: 41.47%
Conv Rate: 1.80%
Industry : E-commerce
Test Results
CTR: 41.32%
Conv Rate: 1.98%
Promotional headline	

Keyword-based promo description	

Enter PROMOCODE at Checkout	

Promotional headline
Keyword-based promo description
Free Shipping On Items Over $$$.
Test 8 - Free Offer vs Branded Message
Ad A:
Get A Free Guide
Ad B:
“… A Division of ___
Publishing House.”
Industry: Self-Publishing
Test 9 – Ad Customizers
Industry: E-commerce Holidays
Test 10 – Second stage testing
Test 1: Control Message vs “In Just 2 Days”
Test 2: “In Just 2 Days”
vs “In Just 48 Hours”
Industry: Financial Services
Timeline
Choose
the Test
Subject.
Identify
your
metric
Identify
your data
threshold
Design
your
test!
Tip:
Start
general,
then
specify.
Create
and
proof
your
ads.
Run
ad
test!
Get a
snack.
Gather
results.
Report
on
results.
Next
round!
 Email:	
  carrie.albright@hanapinmarke$ng.com	
  
	
  Twi@er:	
  @albright_c	
  
	
  Website:	
  	
  h@p://www.hanapinmarke$ng.com	
  
	
  
	
  Find	
  this	
  recorded	
  #Mozinar	
  and	
  slide	
  deck	
  at	
  h@p://moz.com/webinars	
  very	
  soon!	
  

More Related Content

PPT
Ad Auditors: PPC Auditing Presentation
PPTX
Turning Google Analytics into a Webmaster's Tool Box - Brighton SEO - April 2013
PDF
CX16: Getting Started with Cross-Channel Journeys
PDF
CX16: How Rack Room Shoes Drives Customer Loyalty with a Mobile Cross Channel...
PPTX
Advanced Google Shopping: data insights from behind the scenes
PPTX
The economics of google shopping
PPTX
Using Predictive Bidding to Escape the Seasonal Trap
PPT
Search Engine Advertising
Ad Auditors: PPC Auditing Presentation
Turning Google Analytics into a Webmaster's Tool Box - Brighton SEO - April 2013
CX16: Getting Started with Cross-Channel Journeys
CX16: How Rack Room Shoes Drives Customer Loyalty with a Mobile Cross Channel...
Advanced Google Shopping: data insights from behind the scenes
The economics of google shopping
Using Predictive Bidding to Escape the Seasonal Trap
Search Engine Advertising

What's hot (20)

PPTX
How to make your PPC campaigns more efficient using targeted segmentation
PDF
Google Adwords Cheat Sheet
PPTX
Internet Marketing with SEO and SEM
PDF
CX16 Reimagining Retail in the Age of the Shopper
PDF
CX16 How Luxottica is Enhancing Their Email Marketing with Advertising
PDF
Advanced Strategies to get your Google Shopping Campaigns to the Next Level -...
PPTX
Perform Sponsored Lunch
PPTX
Hero Conf London 2016 - The Definitive Framework for Bidding in AdWords
PPT
SES San Jose Ad Testing Research & Findings
PPT
David Rodnitzky
PPT
SES San Jose Ads Quality Score
ODP
PPT
effective_domaining_strategies-victor_pitts.ppt
PDF
CX16 Leading Retailers Optimize The Customer Journey
PDF
Adwords introduction (1)
PDF
ACCURATELY TARGETING YOUR CONSUMER EN MASSE USING DSP
PDF
Mastering Lead Gen Forms for Higher Education
PPTX
Google Adwords
PPT
Econsultancy Adv Email Marketing Roundtable June 2009
How to make your PPC campaigns more efficient using targeted segmentation
Google Adwords Cheat Sheet
Internet Marketing with SEO and SEM
CX16 Reimagining Retail in the Age of the Shopper
CX16 How Luxottica is Enhancing Their Email Marketing with Advertising
Advanced Strategies to get your Google Shopping Campaigns to the Next Level -...
Perform Sponsored Lunch
Hero Conf London 2016 - The Definitive Framework for Bidding in AdWords
SES San Jose Ad Testing Research & Findings
David Rodnitzky
SES San Jose Ads Quality Score
effective_domaining_strategies-victor_pitts.ppt
CX16 Leading Retailers Optimize The Customer Journey
Adwords introduction (1)
ACCURATELY TARGETING YOUR CONSUMER EN MASSE USING DSP
Mastering Lead Gen Forms for Higher Education
Google Adwords
Econsultancy Adv Email Marketing Roundtable June 2009
Ad

Viewers also liked (8)

PDF
Advertising Testing Techniques
PPTX
DM 201 - Avalon Consulting - Testing Creative
PPTX
Defect Triage by Matt Eakin
PDF
Create testing commandos for creative problem solving!!! by Pradeepa Narayana...
PPTX
Advertising & marketing research
PPTX
Media objectives and strategies 1.30.13
PPT
Creative Message Strategies
PPT
Advertising ppt
Advertising Testing Techniques
DM 201 - Avalon Consulting - Testing Creative
Defect Triage by Matt Eakin
Create testing commandos for creative problem solving!!! by Pradeepa Narayana...
Advertising & marketing research
Media objectives and strategies 1.30.13
Creative Message Strategies
Advertising ppt
Ad

Similar to Testing Your Creative: Small Changes with Big Effects (20)

PPT
Pay-Per-Click Marketing Principles Part 1
PPTX
Using Attribution Modeling to Grow Your Business
PPTX
Future-proofing your AdWords for 2016.
PPTX
Did it work? Our Favorite Tests from 2018
PDF
Michelle Roberts - 5 AdWords Mistakes I Always See & How to Avoid Them
PPTX
Website Optimization Without a Committee: Using Testing to Make Decisions
PPTX
Closing the Loop on ROI: Paid Marketing + CRO
 
PPTX
nextNY Online Marketing School - SEM Presentation
PPTX
Micro Share Web Seminar
PPT
MasterLink Seminar
PPTX
Powerful PPC Tactics that Get You Leads
PDF
New Marketing Ideas, Strategies & Channels For 2022
PPT
Optimizing SEM Strategies from Keyword to Conversion
PPT
Widemile and Microsoft Multivariate Testing Case Study
PPTX
5 AdWords Mistakes I Always See and How to Avoid Them by Michelle Roberts
PDF
Van Moof: Simon Vreeman
PPTX
Retail ad copy clickability
PPTX
2015 MnSearch Summit - Brad Geddes - Perfecting you PPC Ad Testing in 2015 an...
PPT
Effectively Managing Online Marketing Programs
PPT
Vorian Agency PPC google adwords seminar
Pay-Per-Click Marketing Principles Part 1
Using Attribution Modeling to Grow Your Business
Future-proofing your AdWords for 2016.
Did it work? Our Favorite Tests from 2018
Michelle Roberts - 5 AdWords Mistakes I Always See & How to Avoid Them
Website Optimization Without a Committee: Using Testing to Make Decisions
Closing the Loop on ROI: Paid Marketing + CRO
 
nextNY Online Marketing School - SEM Presentation
Micro Share Web Seminar
MasterLink Seminar
Powerful PPC Tactics that Get You Leads
New Marketing Ideas, Strategies & Channels For 2022
Optimizing SEM Strategies from Keyword to Conversion
Widemile and Microsoft Multivariate Testing Case Study
5 AdWords Mistakes I Always See and How to Avoid Them by Michelle Roberts
Van Moof: Simon Vreeman
Retail ad copy clickability
2015 MnSearch Summit - Brad Geddes - Perfecting you PPC Ad Testing in 2015 an...
Effectively Managing Online Marketing Programs
Vorian Agency PPC google adwords seminar

More from Hanapin Marketing (20)

PDF
Last Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
PDF
5 Reasons to Use Amazon DSP in 2020
PDF
Identify & Leverage YouTube Audiences for Organic & Paid Growth
PDF
Connect the Likes: Tracking Visits to Improve Facebook Ads Performance
PDF
Hiring a Marketing Agency? Critical Questions that Drive the Right Decision
PDF
Diving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
PDF
The Rise of Conversational Marketing - How to Leverage Chatbots for PPC
PPTX
The Untapped Power of Quora Ads
PDF
Google is Getting More Expensive - How to Get Around that with Better Audienc...
PPTX
Investing in Brand Campaigns? Post-Click Experience is Key
PDF
How to Maximize the Impact of Video Content with Retargeting
PDF
Machine Learning Tech You Could and Should Use Tomorrow
PDF
Create a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
PDF
Building Optimised Post-Click Experiences
PDF
Keynote: Using Creativity in Advertising to Stay Ahead
PDF
Keynote: How to Supercharge Your PPC Career
PDF
Ad Extensions as a Lever for Powerful Text Ads
PDF
Why You Should (Not) be Using Automated Bidding Strategies
PDF
What I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
PDF
Data Driven Advertising
Last Click is Outdated: Learn to Use Google Analytics’ New Attribution Beta
5 Reasons to Use Amazon DSP in 2020
Identify & Leverage YouTube Audiences for Organic & Paid Growth
Connect the Likes: Tracking Visits to Improve Facebook Ads Performance
Hiring a Marketing Agency? Critical Questions that Drive the Right Decision
Diving Deeper into Programmatic: Succeeding Beyond the PPC Landscape
The Rise of Conversational Marketing - How to Leverage Chatbots for PPC
The Untapped Power of Quora Ads
Google is Getting More Expensive - How to Get Around that with Better Audienc...
Investing in Brand Campaigns? Post-Click Experience is Key
How to Maximize the Impact of Video Content with Retargeting
Machine Learning Tech You Could and Should Use Tomorrow
Create a PPC Playground For Your Clients: How To Co-Create Your Ad Customizers
Building Optimised Post-Click Experiences
Keynote: Using Creativity in Advertising to Stay Ahead
Keynote: How to Supercharge Your PPC Career
Ad Extensions as a Lever for Powerful Text Ads
Why You Should (Not) be Using Automated Bidding Strategies
What I Learned In One Year Marketing on Pinterest..Yes It Was Profitable
Data Driven Advertising

Recently uploaded (20)

PPT
Introduction to consumer behavior(1).PPT
PPTX
"Best Healthcare Digital Marketing Ideas
PDF
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
PPTX
Mastering eCommerce SEO: Strategies to Boost Traffic and Maximize Conversions
PDF
Biography of Brady Beitlich
PDF
How to Break Into AI Search with Andrew Holland
PPTX
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
PDF
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
PPTX
Mastering in Website Competitor Analysis
PDF
Digital Marketing - clear pictire of marketing
PDF
SEO vs. AEO: Optimizing for Google vs AI-Powered Search Assistants
PDF
sm_67a1bc7f35716dcb1a9195ea_382528b8-2159-47be-a7ba-d034a449f849.pdf
PDF
E_Book_Customer_Relation_Management_0.pdf
PPT
Market research before Marketing Research .PPT
DOCX
procubiz_modern digital marketingblog.docx
PPTX
hnk joint business plan for_Rooftop_Plan
PDF
Mastering Bulk Email Campaign Optimization for 2025
PDF
Boost Sales Around the Clock with AI Chatbots for Marketing
PPT
Market Segmentation and Positioning(3).ppt
PPTX
CH 1 AN INTRODUCTION OF INTEGRATED MARKETING COMMUNICATION (COMBINE)
Introduction to consumer behavior(1).PPT
"Best Healthcare Digital Marketing Ideas
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
Mastering eCommerce SEO: Strategies to Boost Traffic and Maximize Conversions
Biography of Brady Beitlich
How to Break Into AI Search with Andrew Holland
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
Mastering in Website Competitor Analysis
Digital Marketing - clear pictire of marketing
SEO vs. AEO: Optimizing for Google vs AI-Powered Search Assistants
sm_67a1bc7f35716dcb1a9195ea_382528b8-2159-47be-a7ba-d034a449f849.pdf
E_Book_Customer_Relation_Management_0.pdf
Market research before Marketing Research .PPT
procubiz_modern digital marketingblog.docx
hnk joint business plan for_Rooftop_Plan
Mastering Bulk Email Campaign Optimization for 2025
Boost Sales Around the Clock with AI Chatbots for Marketing
Market Segmentation and Positioning(3).ppt
CH 1 AN INTRODUCTION OF INTEGRATED MARKETING COMMUNICATION (COMBINE)

Testing Your Creative: Small Changes with Big Effects