SlideShare a Scribd company logo
Marketers take control
September 2017
Augustine Fou, PhD.
acfou [at] mktsci.com
212. 203 .7239
September 2017 / Page 1marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Chase: 99% reach had no impact
“JPMorgan had already decided
last year to oversee its own
programmatic buying operation.
Advertisements for JPMorgan
Chase were appearing on about
400,000 websites a month. [But]
only 12,000, or 3 percent, led to
activity beyond an impression.
[Then, Chase] limited its display
ads to about 5,000 websites. We
haven’t seen any deterioration on
our performance metrics,” Ms.
Lemkau said.”
“99% reduction in ‘reach’ … Same Results.”
Source: NYTimes, March 29, 2017
(because it wasn’t real, human reach)
September 2017 / Page 2marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
P&G: $140M in digital, no impact
“Procter & Gamble's concerns
about where its ads were
showing up online contributed
to a $140 million cutback in
the company's digital ad
spending last quarter, the
company said Thursday. That
helped the world's biggest
advertiser beat earnings
expectations. Perhaps even
more noteworthy, however,
organic sales outperformed
both analyst forecasts and key
rivals at 2% growth despite
the drop in ad support.
Source: AdAge, July 2017
September 2017 / Page 3marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Restoration Hardware: cut all keywords
“[W]e’ve found out that 98%
of our business was coming
from 22 words. So, wait, we’re
buying 3,200 words and 98%
of the business is coming from
22 words. What are the 22
words? And they said, well, it’s
the word Restoration
Hardware and the 21 ways to
spell it wrong, okay?
Immediately the next day, we
cancelled all the words,
including our own name.”
Source: BusinessInsider, Sept 2017
September 2017 / Page 4marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Uber Sues Mobile Agency for Ad Fraud
“Between 2015 and the first quarter of 2017,
Uber paid more than $82.5 million for the ad
effort coordinated by Fetch, court documents
show.
Uber alleges to have found… a Fetch
transparency report that showed the number of
weekly reported clicks on Uber ads on one
website was nearly equal to the site’s monthly
active users.
Uber was spending millions of dollars a week on
mobile ad inventory that was “purportedly
attributable to hundreds of thousands (even
millions) of Uber App installs per week,”
according to the complaint. However, when the
mobile ad effort was suspended, Uber said it
saw “no material drop in total installations.”
Source: WSJ, Sept 2017
If you don’t have 100%
measurement or very detailed
reports… you’re NOT
getting what you paid for.
September 2017 / Page 6marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Thought you bought ESPN? Nope
publisherA.com
ALL fake inventory because, PublisherA
does NOT sell any ads on any exchanges!
“Fake sites must pretend to be mainstream
ones in order to sell inventory.”
September 2017 / Page 7marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Thought you bought reach? Nope
$1 CPM
Top 10 sites = 66% of imps
$5 CPM
Top 10 sites = 74% of imps
$0.50 CPM
Top 5 sites = 100% of imps
$10 CPM
Top 10 sites = 71% of imps
Majority of your ads ran on 5-10 sites/apps
September 2017 / Page 8marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
98% impressions blown out in 1 hr
Most of budget wasted
between 12a – 4a; to bots
98% impressions blown
in 1st hour (12a-1a)
HOURLY CHART
September 2017 / Page 9marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Fraud filters don’t work. At. All.
1. Fraud filters are no better
than manual blacklists
2. In some cases it’s worse
when filter is on
3. Using fraud filters adds 20
– 24% to costs; manual
blacklists are free
September 2017 / Page 10marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Paid extra for geotargeting; 100% faked
Not Normal – in both campaigns
1. 100% mobile apps; 100% Android; same top 15 apps in both markets
2. 100% of impressions generated between 4a – 5a local time
3. 100% fake devices; 15 unique devices generated top 95% impressions
4. 100% data center traffic, randomized through residential proxies
September 2017 / Page 11marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Paid extra for targeting, no effect
“Verified Bots” “Verified Humans”
“Fraud-free Apps”Control: No Targeting
+$0.25 data CPM
+$0.25 data CPM+$0.25 data CPM
September 2017 / Page 12marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Targeting recent purchasers, didn’t work
“Frequent Buyers” “Heavy Buyers”
“Recent Purchaser - Books”Control: No Targeting
+$1.00 data CPM
+$1.00 data CPM+$1.75 data CPM
September 2017 / Page 13marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
90-99% of geolocation bad or faked
Source: Placed
Source: SafeGraph
September 2017 / Page 14marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
9% of apps caused 80% of fake impressions
1 (52% of impressions) 2 (48% of impr)
66% avg fraud
18% avg fraud
1. 9% of the apps caused 52% of impressions; 66% outright fraud
2. Remaining 91% of apps caused 48% of impressions, 18% outright fraud
September 2017 / Page 15marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
3 bad apps eat 75% of mobile budget
com.jiubang com.flashlight com.latininput
75% of the
dark red
September 2017 / Page 16marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
34 Mobile Networks >50% Fraud
Source: June 2017, Tune
average 20% fraud
100% fraud
> 50% fraud
September 2017 / Page 17marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Some ads are called without webpages
“Naked ad calls” are ad impressions
served without webpages
September 2017 / Page 18marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
About the Author
September 2017
Augustine Fou, PhD.
acfou [@] mktsci.com
212. 203 .7239
September 2017 / Page 19marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Dr. Augustine Fou – Independent Ad Fraud Researcher
2013
2014
Follow me on LinkedIn (click) and on Twitter
@acfou (click)
Further reading:
http://www.slideshare.net/augustinefou/presentations
https://www.linkedin.com/today/author/augustinefou
2016
2015

More Related Content

PPTX
Fraud Detection Filter Effectiveness Study
PPTX
You're Not Getting What You Bought
PPTX
PPTX
State of Digital Ad Fraud Q2 2017 by Augustine Fou
PDF
July 2017 - Viewability Study by Augustine Fou
PPTX
100% Fake Geolocation Mobile Fraud
PPTX
Display Ad Click Through Rate Benchmarks vs Search Ads
Fraud Detection Filter Effectiveness Study
You're Not Getting What You Bought
State of Digital Ad Fraud Q2 2017 by Augustine Fou
July 2017 - Viewability Study by Augustine Fou
100% Fake Geolocation Mobile Fraud
Display Ad Click Through Rate Benchmarks vs Search Ads

What's hot (20)

PPTX
Fraud Detection is Easily Fooled
PPTX
May 2017 - Mobile Display Fraud Case Study
PPTX
Sept 2017 - Ad Fraud Pricepoints Study
PPTX
State of Digital Ad Fraud August 2017
PPTX
Procurement to Help Fight Ad Fraud
PPTX
Mobile Ad Fraud - Betcha Didn't Know
PPTX
PPTX
60 Cents per Dollar Goes to Working Digital Media
PPTX
At-Scale Ad Fraud Absorbs Most Digital Dollars
PPTX
PPTX
Most popular browsers mimicked by fraud bots
PPTX
PPTX
Good Publishers Will Save Digital
PPTX
August 2017 - Naked Ad Calls Study
PPTX
Chase example of reducing reach by 99 percent
PPTX
Better Media Means Better Outcomes and ROI Augustine Fou
PPTX
Procurement to Help Reduce Ad Fraud
PPTX
Low-Cost, No-Tech Ways to Fight Fraud vMiMA
PPTX
Publishers Experiments on Supply Chain Inefficiencies
PPTX
Fraud Diverts Ad Spend to Bad Guys
Fraud Detection is Easily Fooled
May 2017 - Mobile Display Fraud Case Study
Sept 2017 - Ad Fraud Pricepoints Study
State of Digital Ad Fraud August 2017
Procurement to Help Fight Ad Fraud
Mobile Ad Fraud - Betcha Didn't Know
60 Cents per Dollar Goes to Working Digital Media
At-Scale Ad Fraud Absorbs Most Digital Dollars
Most popular browsers mimicked by fraud bots
Good Publishers Will Save Digital
August 2017 - Naked Ad Calls Study
Chase example of reducing reach by 99 percent
Better Media Means Better Outcomes and ROI Augustine Fou
Procurement to Help Reduce Ad Fraud
Low-Cost, No-Tech Ways to Fight Fraud vMiMA
Publishers Experiments on Supply Chain Inefficiencies
Fraud Diverts Ad Spend to Bad Guys
Ad

Similar to Marketers Take Control Run Experiments (20)

PPTX
DMA_PPT_Analytics FINAL Sept 2017
PPTX
Digital Ad Fraud - Betcha Didn't Know
PDF
Digital ad fraud impact on class action notice industry
PDF
Not dirty LITTLE secret but Elephant in the Room
PDF
A Visual History of Google Algorithm Updates [Infographic]
PDF
Ad fraud update for publishers Feb 2020
PDF
How Brands are Solving Ad Fraud Themselves
PDF
Your current digital just plain sucks, why?
PDF
Good Publishers Will Save Digital Marketing v2019
PPTX
How Ad Fraud Impacts Good Publishers
PDF
Optimization Tips: The Ad to Landing Page to Conversion Flow
PPTX
State of Ad Fraud Ad Blocking Q1 2016 Update Augustine Fou
PDF
Unintended Consequences for Publishers using Adtech
PDF
Facebook Advertising
PPTX
State of Digital Ad Fraud Q2 2018
PDF
Marketers' Playbook Questions to Ask Verification Vendors
PDF
2021 update on ad fraud brand safety privacy
PDF
Still nothing but ad fraud 2021 dr augustine fou
PPTX
The Next Era of Web Marketing: 2019 & Beyond
DMA_PPT_Analytics FINAL Sept 2017
Digital Ad Fraud - Betcha Didn't Know
Digital ad fraud impact on class action notice industry
Not dirty LITTLE secret but Elephant in the Room
A Visual History of Google Algorithm Updates [Infographic]
Ad fraud update for publishers Feb 2020
How Brands are Solving Ad Fraud Themselves
Your current digital just plain sucks, why?
Good Publishers Will Save Digital Marketing v2019
How Ad Fraud Impacts Good Publishers
Optimization Tips: The Ad to Landing Page to Conversion Flow
State of Ad Fraud Ad Blocking Q1 2016 Update Augustine Fou
Unintended Consequences for Publishers using Adtech
Facebook Advertising
State of Digital Ad Fraud Q2 2018
Marketers' Playbook Questions to Ask Verification Vendors
2021 update on ad fraud brand safety privacy
Still nothing but ad fraud 2021 dr augustine fou
The Next Era of Web Marketing: 2019 & Beyond
Ad

More from Dr. Augustine Fou - Independent Ad Fraud Researcher (20)

PDF
Forensic Auditing of Digital Media.pdf
PDF
Q1 2022 Update on ad fraud for AMM
PDF
PDF
Digital ad dollars trickle down chart
PDF
Bad guys optimize ad fraud efficiency
PDF
Alternative to ANA's end to end supply chain transparency study v final
PDF
Impact of Loss of 3P Cookies on Publishers' Ad Revenue
PDF
Entire ecosystem supporting ad fraud 2018
PPTX
Digital Media Trust Collaborative
PDF
Programmatic reach analysis 2021
PDF
PDF
Checking abnormal referrer traffic in google analytics
PDF
History and Impact of Digital Ad Fraud
PDF
Digital Fraud Viewability Benchmarks Q4 2020
PDF
What CFEs can do about digital ad fraud
PDF
Four types of digital ad spend updated august 2020
PDF
How to Use FouAnalytics For Marketers
PDF
FouAnalytics DIY site media analytics fraud detection baked in
PDF
Investigating digital ad fraud spi virtual meeting
Forensic Auditing of Digital Media.pdf
Q1 2022 Update on ad fraud for AMM
Digital ad dollars trickle down chart
Bad guys optimize ad fraud efficiency
Alternative to ANA's end to end supply chain transparency study v final
Impact of Loss of 3P Cookies on Publishers' Ad Revenue
Entire ecosystem supporting ad fraud 2018
Digital Media Trust Collaborative
Programmatic reach analysis 2021
Checking abnormal referrer traffic in google analytics
History and Impact of Digital Ad Fraud
Digital Fraud Viewability Benchmarks Q4 2020
What CFEs can do about digital ad fraud
Four types of digital ad spend updated august 2020
How to Use FouAnalytics For Marketers
FouAnalytics DIY site media analytics fraud detection baked in
Investigating digital ad fraud spi virtual meeting

Recently uploaded (20)

PPTX
"Best Healthcare Digital Marketing Ideas
PPTX
Presentation - GreenPantry – Instagram-First Home Kitchen Brand.pptx
PDF
AFCAT Syllabus 2026 Guide by Best Defence Academy in Lucknow.pdf
PPTX
Assignment 2 Task 1 - How Consumers Use Technology and Its Impact on Their Lives
PDF
You Need SEO for Your Business. Here’s Why..pdf
PDF
UNIT 1 -4 Profile of Rural Consumers (1).pdf
PDF
Best digital marketing company in Mumbai
PPTX
Fixing-AI-Hallucinations-The-NeuroRanktm-Approach.pptx
PPTX
UNIT 3 - 5 INDUSTRIAL PRICING.ppt x
PDF
exceptionalinsights.group visitor traffic statistics 08-08-25
PDF
5 free to use google tools to understand your customers online behavior in 20...
PPTX
Tea and different types of tea in India
PDF
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
PPTX
Best Digital marketing service provider in Chandigarh.pptx
PPTX
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
PPTX
Ranking a Webpage with SEO (And Tracking It with the Right Attribution Type a...
PDF
Hidden gems in Microsoft ads with Navah Hopkins
PPTX
Your score increases as you pick a category, fill out a long description and ...
PPTX
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
PPT
Market research before Marketing Research .PPT
"Best Healthcare Digital Marketing Ideas
Presentation - GreenPantry – Instagram-First Home Kitchen Brand.pptx
AFCAT Syllabus 2026 Guide by Best Defence Academy in Lucknow.pdf
Assignment 2 Task 1 - How Consumers Use Technology and Its Impact on Their Lives
You Need SEO for Your Business. Here’s Why..pdf
UNIT 1 -4 Profile of Rural Consumers (1).pdf
Best digital marketing company in Mumbai
Fixing-AI-Hallucinations-The-NeuroRanktm-Approach.pptx
UNIT 3 - 5 INDUSTRIAL PRICING.ppt x
exceptionalinsights.group visitor traffic statistics 08-08-25
5 free to use google tools to understand your customers online behavior in 20...
Tea and different types of tea in India
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
Best Digital marketing service provider in Chandigarh.pptx
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
Ranking a Webpage with SEO (And Tracking It with the Right Attribution Type a...
Hidden gems in Microsoft ads with Navah Hopkins
Your score increases as you pick a category, fill out a long description and ...
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
Market research before Marketing Research .PPT

Marketers Take Control Run Experiments

  • 1. Marketers take control September 2017 Augustine Fou, PhD. acfou [at] mktsci.com 212. 203 .7239
  • 2. September 2017 / Page 1marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Chase: 99% reach had no impact “JPMorgan had already decided last year to oversee its own programmatic buying operation. Advertisements for JPMorgan Chase were appearing on about 400,000 websites a month. [But] only 12,000, or 3 percent, led to activity beyond an impression. [Then, Chase] limited its display ads to about 5,000 websites. We haven’t seen any deterioration on our performance metrics,” Ms. Lemkau said.” “99% reduction in ‘reach’ … Same Results.” Source: NYTimes, March 29, 2017 (because it wasn’t real, human reach)
  • 3. September 2017 / Page 2marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou P&G: $140M in digital, no impact “Procter & Gamble's concerns about where its ads were showing up online contributed to a $140 million cutback in the company's digital ad spending last quarter, the company said Thursday. That helped the world's biggest advertiser beat earnings expectations. Perhaps even more noteworthy, however, organic sales outperformed both analyst forecasts and key rivals at 2% growth despite the drop in ad support. Source: AdAge, July 2017
  • 4. September 2017 / Page 3marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Restoration Hardware: cut all keywords “[W]e’ve found out that 98% of our business was coming from 22 words. So, wait, we’re buying 3,200 words and 98% of the business is coming from 22 words. What are the 22 words? And they said, well, it’s the word Restoration Hardware and the 21 ways to spell it wrong, okay? Immediately the next day, we cancelled all the words, including our own name.” Source: BusinessInsider, Sept 2017
  • 5. September 2017 / Page 4marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Uber Sues Mobile Agency for Ad Fraud “Between 2015 and the first quarter of 2017, Uber paid more than $82.5 million for the ad effort coordinated by Fetch, court documents show. Uber alleges to have found… a Fetch transparency report that showed the number of weekly reported clicks on Uber ads on one website was nearly equal to the site’s monthly active users. Uber was spending millions of dollars a week on mobile ad inventory that was “purportedly attributable to hundreds of thousands (even millions) of Uber App installs per week,” according to the complaint. However, when the mobile ad effort was suspended, Uber said it saw “no material drop in total installations.” Source: WSJ, Sept 2017
  • 6. If you don’t have 100% measurement or very detailed reports… you’re NOT getting what you paid for.
  • 7. September 2017 / Page 6marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Thought you bought ESPN? Nope publisherA.com ALL fake inventory because, PublisherA does NOT sell any ads on any exchanges! “Fake sites must pretend to be mainstream ones in order to sell inventory.”
  • 8. September 2017 / Page 7marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Thought you bought reach? Nope $1 CPM Top 10 sites = 66% of imps $5 CPM Top 10 sites = 74% of imps $0.50 CPM Top 5 sites = 100% of imps $10 CPM Top 10 sites = 71% of imps Majority of your ads ran on 5-10 sites/apps
  • 9. September 2017 / Page 8marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 98% impressions blown out in 1 hr Most of budget wasted between 12a – 4a; to bots 98% impressions blown in 1st hour (12a-1a) HOURLY CHART
  • 10. September 2017 / Page 9marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Fraud filters don’t work. At. All. 1. Fraud filters are no better than manual blacklists 2. In some cases it’s worse when filter is on 3. Using fraud filters adds 20 – 24% to costs; manual blacklists are free
  • 11. September 2017 / Page 10marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Paid extra for geotargeting; 100% faked Not Normal – in both campaigns 1. 100% mobile apps; 100% Android; same top 15 apps in both markets 2. 100% of impressions generated between 4a – 5a local time 3. 100% fake devices; 15 unique devices generated top 95% impressions 4. 100% data center traffic, randomized through residential proxies
  • 12. September 2017 / Page 11marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Paid extra for targeting, no effect “Verified Bots” “Verified Humans” “Fraud-free Apps”Control: No Targeting +$0.25 data CPM +$0.25 data CPM+$0.25 data CPM
  • 13. September 2017 / Page 12marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Targeting recent purchasers, didn’t work “Frequent Buyers” “Heavy Buyers” “Recent Purchaser - Books”Control: No Targeting +$1.00 data CPM +$1.00 data CPM+$1.75 data CPM
  • 14. September 2017 / Page 13marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 90-99% of geolocation bad or faked Source: Placed Source: SafeGraph
  • 15. September 2017 / Page 14marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 9% of apps caused 80% of fake impressions 1 (52% of impressions) 2 (48% of impr) 66% avg fraud 18% avg fraud 1. 9% of the apps caused 52% of impressions; 66% outright fraud 2. Remaining 91% of apps caused 48% of impressions, 18% outright fraud
  • 16. September 2017 / Page 15marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 3 bad apps eat 75% of mobile budget com.jiubang com.flashlight com.latininput 75% of the dark red
  • 17. September 2017 / Page 16marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 34 Mobile Networks >50% Fraud Source: June 2017, Tune average 20% fraud 100% fraud > 50% fraud
  • 18. September 2017 / Page 17marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Some ads are called without webpages “Naked ad calls” are ad impressions served without webpages
  • 19. September 2017 / Page 18marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou About the Author September 2017 Augustine Fou, PhD. acfou [@] mktsci.com 212. 203 .7239
  • 20. September 2017 / Page 19marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Dr. Augustine Fou – Independent Ad Fraud Researcher 2013 2014 Follow me on LinkedIn (click) and on Twitter @acfou (click) Further reading: http://www.slideshare.net/augustinefou/presentations https://www.linkedin.com/today/author/augustinefou 2016 2015