The Van Wagner Ad Sets Optimization ModeltmMatt Van WagnerSearch Engine Marketing New England (SEMNE)Natick, MA  May 18, 2010©  Copyright 2010.  Find Me Faster   Nashua, NH.   All Rights Reserved.
Best of Breed
Could too much A/B Testing be detrimental to the overall health of our PPC campaigns?
How A/B Testing WorksThe idea is to find outwhich message resonates best with your target audience.
How A/B Testing WorksRun ads long enough to develop a performance profile.Declare a champ.  Kill the loser.  Bring in a new challenger.  Repeat until bored.
Setting ExpectationsYou declare Ad A the champ, and delete loser Ad B.What do you expect your Adgroup CTR to be going forward?(a) 3.75%      (b) 6.25%      (c) 7.5%       (d)  9.25%
Surprised?Answer:  It most cases, your new Ad Group CTR will range from 3.75%  -  6.25%.
CTR:  Adgroup vs. Ad
Worst Case: Ad Group CTR
Have you ever experienced this sort of surprise after a round of A/B Testing?
Pitfalls of A/B TestingWhy performance maydecline after an A/B Test: - Keywords do not equal queries match type influence
  Ad Impressions does not equal searchers
  Ad Rotation is not truly even
 A/B Testing will result in a best ad.   It does not know anything about your ad group.Keywords  ≠  QueriesBroad & Phrase Match bring in many variationsKeyword =  gluten free cakesSearch Queries = gluten free store bought cookies     gluten free bakeries                  gluten free frozen cookie dough      stoneham mass gluten free bakeries   ritt's gluten free cake              gluten free cheesecake glutenfree angel food cakegluten free m & m cookiesgluten free bakeries in stoneham gluten free wedding cakes gluten free desertsgluten free cheese cakegluten free bakeries                 mi del gluten free cookiesgluten free desserts  gluten free cookies gluten free cupcakesgluten free gourmet desserts gluten free recopiesgluten free desserts easy where to buy gluten free brownies    gluten free cheesecake ma            gluten free cat treats  gluten free store bought cookies  gluten free  pie crust
Impressions ≠ SearchersSearches are not randomly distributed - Searches for specific keywords happen in ’hotspots’    ”...as many as 50% of all searches are repeat searches...”** Yusuf Mehdi, Microsoft Senior Vice President, March 2010
Even Ad Rotation is Not Truly EvenEven when Ad Rotation is set to Even, it is not truly even: - Search engines attempt to achieve approximately even search volume History of [ad + keyword] combination impacts Quality Score
  Relevance of [ad+keyword] impacts Quality ScoreDiversity of Sales PitchesSelection:      All Shades of Blue WidgetsSavings:        Save 20% on Blue WidgetsQuality:	       Eco-Friendly Blue WidgetsAvailability:   Blue Widgets Shipped Overnight! Brand:	       Official Site ACME® Blue Widgets Savings:        Save 20% on Blue WidgetsWill you sell more widgets if you are allowed to use 5 great sales pitches or if you are limited to just 1 of of those pitches?
Ad Set OptimizationHow a few well-performing ads can outperform the single best ad in an ad group.
The Value of Ad Message DiversitySelection:      All Shades of Blue WidgetsSavings:        Save 20% on Blue WidgetsQuality:	       Eco-Friendly Blue WidgetsAvailability:   Blue Widgets Shipped Overnight! Brand:	       Official Site ACME® Blue Widgets Savings:        Save 20% on Blue WidgetsSavings:        Save 20% on Blue WidgetsSavings:        Save 20% on Blue WidgetsSavings:        Save 20% on Blue WidgetsSavings:        Save 20% on Blue WidgetsWouldn’t it be a bit annoying for a salesperson to harp on the same thing 5 times in a row?
Beginning of a Testing Cycle
The Results Start Coming In
Cutting Poor Performing Ads
Down to the FinalsWithout the other ads and repeat searches, you can expect that impressions, clicks and CTR performance changes in unexpected ways.
Should YouDeclare a Winner?Yes? No?  Don’t Know?
Assuming the Worst CaseYou get the same # of visitors, clicks, but CTR declines.Why?   Perhaps people who like to save money assume ECO means more expensive, and don’t bother clicking.
What would happen if you kept both ads online?
Multiple Searches Changes ThingsWith two ads left online, it becomes highly likely that a person will encounter the ad they prefer.	1 search:       50%       (either ad A  or ad B)	2 searches:   75%       (AA, AB, BA, BB) 	3 searches:   87.5%    (etc...)	4 searches:   93.75%Since we know that people will search multiple times, anywhere from 2-20 times over the course of a search session, it becomes almost certain they will see both ads.
Implementing the Van Wagner Ad Sets Optimization ModelUse A/B Testing to narrow out to well-performing ads.  Don’t try to reduce to one winning ad.Instead of Reducing to a single ad, test more combinations.Ad Sets can mask the performance of poorly performing ad groups.  You still have to optimize your ad groups and watch your search queries.Set Ad Rotation to even – at all times.

More Related Content

PPT
Advanced Paid Search- SEMPDX 2/24/12
PPTX
3 Bold Tips to Rethink Remarketing
PPT
PPC 360 Presentation - Smart China Sourcing Summit - Hong Kong 2016
PPTX
Don't Start A Bidding War: Outmaneuver Your PPC Competitors
PPT
Using AdWords to Grow Your Business
PPTX
Hero Conf Portland 2015 - PPC Audits - AdWords Scorecard
PPT
Quality Score And PPC Management
PDF
Amazon ppc management
Advanced Paid Search- SEMPDX 2/24/12
3 Bold Tips to Rethink Remarketing
PPC 360 Presentation - Smart China Sourcing Summit - Hong Kong 2016
Don't Start A Bidding War: Outmaneuver Your PPC Competitors
Using AdWords to Grow Your Business
Hero Conf Portland 2015 - PPC Audits - AdWords Scorecard
Quality Score And PPC Management
Amazon ppc management

What's hot (18)

PPTX
Amazon product sponsored ads: Case study by BM Consulting
PPTX
Hero Conf London 2016 - The Definitive Framework for Bidding in AdWords
PPTX
The Amazon Seller PPC Presentation (Sept 2016)
PPTX
Amazon Sponsored Ads (PPC) Presentation - Advanced Tips; Tricks & Optimisatio...
PPTX
2009 Philly Search Camp Advanced Ppc Strategies
PPTX
Sam & mary
PPT
Atlanta SEO Meetup - PPC Optimization Lifecycle
PPTX
How to compete in the world of Google Shopping
PDF
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
PDF
How To Drive Incremental Sales on Amazon – We Found The Missing Link
PPTX
Advanced Google Shopping: data insights from behind the scenes
PDF
Amazon PPC sample audit
PPTX
How l’express increased ad sense revenue by 18%
PPTX
PPTX
Split testing for amazon sellers
PPTX
Nov 2011 webinar account structure
PDF
High-Frequency Bidding Explained
PDF
Google qs misconceptions
Amazon product sponsored ads: Case study by BM Consulting
Hero Conf London 2016 - The Definitive Framework for Bidding in AdWords
The Amazon Seller PPC Presentation (Sept 2016)
Amazon Sponsored Ads (PPC) Presentation - Advanced Tips; Tricks & Optimisatio...
2009 Philly Search Camp Advanced Ppc Strategies
Sam & mary
Atlanta SEO Meetup - PPC Optimization Lifecycle
How to compete in the world of Google Shopping
AMAZON PPC: HOW HIGH-VOLUME SELLERS ARE MANAGING THEIR CAMPAIGNS
How To Drive Incremental Sales on Amazon – We Found The Missing Link
Advanced Google Shopping: data insights from behind the scenes
Amazon PPC sample audit
How l’express increased ad sense revenue by 18%
Split testing for amazon sellers
Nov 2011 webinar account structure
High-Frequency Bidding Explained
Google qs misconceptions
Ad

Viewers also liked (6)

PDF
Lightsofafrica photographergabrielbrau
PPT
Sourcebooks Apps 101 - BEA 2012
PPT
Xeipion Presentation Corporate
PPTX
حقيبة اكترونية تعلم ذاتي - الصف 1م -ف1-الوحدة2
PDF
4 t2007 1
PDF
Anprotec - O uso das competições de planos de negócios como ferramenta de ens...
Lightsofafrica photographergabrielbrau
Sourcebooks Apps 101 - BEA 2012
Xeipion Presentation Corporate
حقيبة اكترونية تعلم ذاتي - الصف 1م -ف1-الوحدة2
4 t2007 1
Anprotec - O uso das competições de planos de negócios como ferramenta de ens...
Ad

Similar to SEMNE: Van Wagner Ad Sets Optimization Model for Google Adwords (20)

PPT
Google AdWords Update at Pubcon Austin 2009
PDF
google adwords search advertising exam question and answers 2018 pdf
PDF
Adword search-advertising-exam-answers-july-edition-2017
PDF
Michelle Roberts - 5 AdWords Mistakes I Always See & How to Avoid Them
PDF
SES Chicago 2010 Advanced Paid Search - by Andrew Goodman
DOCX
Google Adwords Fundamental Certification Question Answers
PDF
8 easy Adwords Optimization Tips
PPTX
7 Practical learnings from Retargeting campaigns on 400 ecommerce stores
PPTX
The Million Dollar Case Study: Session #19: Optimizing PPC Campaigns
PPT
Optimizing SEM Strategies from Keyword to Conversion
PPTX
Four Principals for Better Account Structure
PPTX
Практически съвети за AdSense оптимизация - Огнян Попов
PPTX
Micro Share Web Seminar
PPT
Search social-revelations
PPT
Google Quality Score & the PPC Black Hole
PPTX
The Magic of Copywriting
PDF
Beating AdWords Bidding [Webinar]
PPTX
Google Adwords Seminar Bangalore - Ex-Googler brought to you by Web marketing...
PPTX
Ppc for startups
PPT
Search Engine Advertising
Google AdWords Update at Pubcon Austin 2009
google adwords search advertising exam question and answers 2018 pdf
Adword search-advertising-exam-answers-july-edition-2017
Michelle Roberts - 5 AdWords Mistakes I Always See & How to Avoid Them
SES Chicago 2010 Advanced Paid Search - by Andrew Goodman
Google Adwords Fundamental Certification Question Answers
8 easy Adwords Optimization Tips
7 Practical learnings from Retargeting campaigns on 400 ecommerce stores
The Million Dollar Case Study: Session #19: Optimizing PPC Campaigns
Optimizing SEM Strategies from Keyword to Conversion
Four Principals for Better Account Structure
Практически съвети за AdSense оптимизация - Огнян Попов
Micro Share Web Seminar
Search social-revelations
Google Quality Score & the PPC Black Hole
The Magic of Copywriting
Beating AdWords Bidding [Webinar]
Google Adwords Seminar Bangalore - Ex-Googler brought to you by Web marketing...
Ppc for startups
Search Engine Advertising

Recently uploaded (20)

PDF
income tax laws notes important pakistan
PDF
Daniels 2024 Inclusive, Sustainable Development
PDF
Environmental Law Communication: Strategies for Advocacy (www.kiu.ac.ug)
PDF
THE COMPLETE GUIDE TO BUILDING PASSIVE INCOME ONLINE
PDF
Kishore Vora - Best CFO in India to watch in 2025.pdf
PPTX
Project Management_ SMART Projects Class.pptx
PDF
Susan Semmelmann: Enriching the Lives of others through her Talents and Bless...
PDF
Chapter 2 - AI chatbots and prompt engineering.pdf
PDF
Introduction to Generative Engine Optimization (GEO)
PDF
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
DOCX
Center Enamel Powering Innovation and Resilience in the Italian Chemical Indu...
PPTX
Slide gioi thieu VietinBank Quy 2 - 2025
PPTX
2 - Self & Personality 587689213yiuedhwejbmansbeakjrk
PDF
Family Law: The Role of Communication in Mediation (www.kiu.ac.ug)
PDF
Ron Thomas - Top Influential Business Leaders Shaping the Modern Industry – 2025
DOCX
FINALS-BSHhchcuvivicucucucucM-Centro.docx
PDF
Satish NS: Fostering Innovation and Sustainability: Haier India’s Customer-Ce...
PDF
ANALYZING THE OPPORTUNITIES OF DIGITAL MARKETING IN BANGLADESH TO PROVIDE AN ...
PDF
Solaris Resources Presentation - Corporate August 2025.pdf
PDF
Keppel_Proposed Divestment of M1 Limited
income tax laws notes important pakistan
Daniels 2024 Inclusive, Sustainable Development
Environmental Law Communication: Strategies for Advocacy (www.kiu.ac.ug)
THE COMPLETE GUIDE TO BUILDING PASSIVE INCOME ONLINE
Kishore Vora - Best CFO in India to watch in 2025.pdf
Project Management_ SMART Projects Class.pptx
Susan Semmelmann: Enriching the Lives of others through her Talents and Bless...
Chapter 2 - AI chatbots and prompt engineering.pdf
Introduction to Generative Engine Optimization (GEO)
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
Center Enamel Powering Innovation and Resilience in the Italian Chemical Indu...
Slide gioi thieu VietinBank Quy 2 - 2025
2 - Self & Personality 587689213yiuedhwejbmansbeakjrk
Family Law: The Role of Communication in Mediation (www.kiu.ac.ug)
Ron Thomas - Top Influential Business Leaders Shaping the Modern Industry – 2025
FINALS-BSHhchcuvivicucucucucM-Centro.docx
Satish NS: Fostering Innovation and Sustainability: Haier India’s Customer-Ce...
ANALYZING THE OPPORTUNITIES OF DIGITAL MARKETING IN BANGLADESH TO PROVIDE AN ...
Solaris Resources Presentation - Corporate August 2025.pdf
Keppel_Proposed Divestment of M1 Limited

SEMNE: Van Wagner Ad Sets Optimization Model for Google Adwords

  • 1. The Van Wagner Ad Sets Optimization ModeltmMatt Van WagnerSearch Engine Marketing New England (SEMNE)Natick, MA May 18, 2010© Copyright 2010. Find Me Faster Nashua, NH. All Rights Reserved.
  • 3. Could too much A/B Testing be detrimental to the overall health of our PPC campaigns?
  • 4. How A/B Testing WorksThe idea is to find outwhich message resonates best with your target audience.
  • 5. How A/B Testing WorksRun ads long enough to develop a performance profile.Declare a champ. Kill the loser. Bring in a new challenger. Repeat until bored.
  • 6. Setting ExpectationsYou declare Ad A the champ, and delete loser Ad B.What do you expect your Adgroup CTR to be going forward?(a) 3.75% (b) 6.25% (c) 7.5% (d) 9.25%
  • 7. Surprised?Answer: It most cases, your new Ad Group CTR will range from 3.75% - 6.25%.
  • 8. CTR: Adgroup vs. Ad
  • 9. Worst Case: Ad Group CTR
  • 10. Have you ever experienced this sort of surprise after a round of A/B Testing?
  • 11. Pitfalls of A/B TestingWhy performance maydecline after an A/B Test: - Keywords do not equal queries match type influence
  • 12. Ad Impressions does not equal searchers
  • 13. Ad Rotation is not truly even
  • 14. A/B Testing will result in a best ad. It does not know anything about your ad group.Keywords ≠ QueriesBroad & Phrase Match bring in many variationsKeyword = gluten free cakesSearch Queries = gluten free store bought cookies gluten free bakeries gluten free frozen cookie dough stoneham mass gluten free bakeries ritt's gluten free cake gluten free cheesecake glutenfree angel food cakegluten free m & m cookiesgluten free bakeries in stoneham gluten free wedding cakes gluten free desertsgluten free cheese cakegluten free bakeries mi del gluten free cookiesgluten free desserts gluten free cookies gluten free cupcakesgluten free gourmet desserts gluten free recopiesgluten free desserts easy where to buy gluten free brownies gluten free cheesecake ma gluten free cat treats gluten free store bought cookies gluten free pie crust
  • 15. Impressions ≠ SearchersSearches are not randomly distributed - Searches for specific keywords happen in ’hotspots’ ”...as many as 50% of all searches are repeat searches...”** Yusuf Mehdi, Microsoft Senior Vice President, March 2010
  • 16. Even Ad Rotation is Not Truly EvenEven when Ad Rotation is set to Even, it is not truly even: - Search engines attempt to achieve approximately even search volume History of [ad + keyword] combination impacts Quality Score
  • 17. Relevance of [ad+keyword] impacts Quality ScoreDiversity of Sales PitchesSelection: All Shades of Blue WidgetsSavings: Save 20% on Blue WidgetsQuality: Eco-Friendly Blue WidgetsAvailability: Blue Widgets Shipped Overnight! Brand: Official Site ACME® Blue Widgets Savings: Save 20% on Blue WidgetsWill you sell more widgets if you are allowed to use 5 great sales pitches or if you are limited to just 1 of of those pitches?
  • 18. Ad Set OptimizationHow a few well-performing ads can outperform the single best ad in an ad group.
  • 19. The Value of Ad Message DiversitySelection: All Shades of Blue WidgetsSavings: Save 20% on Blue WidgetsQuality: Eco-Friendly Blue WidgetsAvailability: Blue Widgets Shipped Overnight! Brand: Official Site ACME® Blue Widgets Savings: Save 20% on Blue WidgetsSavings: Save 20% on Blue WidgetsSavings: Save 20% on Blue WidgetsSavings: Save 20% on Blue WidgetsSavings: Save 20% on Blue WidgetsWouldn’t it be a bit annoying for a salesperson to harp on the same thing 5 times in a row?
  • 20. Beginning of a Testing Cycle
  • 21. The Results Start Coming In
  • 23. Down to the FinalsWithout the other ads and repeat searches, you can expect that impressions, clicks and CTR performance changes in unexpected ways.
  • 24. Should YouDeclare a Winner?Yes? No? Don’t Know?
  • 25. Assuming the Worst CaseYou get the same # of visitors, clicks, but CTR declines.Why? Perhaps people who like to save money assume ECO means more expensive, and don’t bother clicking.
  • 26. What would happen if you kept both ads online?
  • 27. Multiple Searches Changes ThingsWith two ads left online, it becomes highly likely that a person will encounter the ad they prefer. 1 search: 50% (either ad A or ad B) 2 searches: 75% (AA, AB, BA, BB) 3 searches: 87.5% (etc...) 4 searches: 93.75%Since we know that people will search multiple times, anywhere from 2-20 times over the course of a search session, it becomes almost certain they will see both ads.
  • 28. Implementing the Van Wagner Ad Sets Optimization ModelUse A/B Testing to narrow out to well-performing ads. Don’t try to reduce to one winning ad.Instead of Reducing to a single ad, test more combinations.Ad Sets can mask the performance of poorly performing ad groups. You still have to optimize your ad groups and watch your search queries.Set Ad Rotation to even – at all times.
  • 29. New (Old) Google Keyword Match TypeBroad Match Modifier - More control than broad match - More flexible than phrase match - shuts down expanded broad matchUses + sign in front of a broad match keyword - Will match queries only when that it contains BMM includes misspellings, singular/plural forms, abbreviations, acronyms, and stemming variations. - Will not pick up close synonyms or related searches.Available soon in US. Now in active beta in Canada & UK