SlideShare a Scribd company logo
FOR
Powered by
MACHINE LEARNING
Hello!
Andrew Van Aken
Consultant,
OgilvyOne Worldwide
Laurie Close
Global Brand Partnerships,
OgilvyRED
Michael McCarthy
Senior Consultant,
OgilvyOne Worldwide
What’s the weather like in your city?
Tell us where you’re dialing in from!
Want this deck?
It will be available for download shortly after
the webinar on: slideshare.net/socialogilvy
Ogilvy staff: It’s also on The Market!
themarket.ogilvy.com
Are you on the go? You can join our webinars on mobile, too!
Download the GoToWebinar app from the App Store or Google Play
This Talk
• We will demystify machine learning (ML) and artificial intelligence (AI)
• Why now for ML and AI?
• Ogilvy case studies
What is Machine Learning
Machine learning gives “computers the ability to learn without being
explicitly programmed.”
-Arthur Samuel, 1959
Any Type of Data
Machine Learning Concept
• Machine learning takes an input
• to an output: David Ogilvy
How does it do it?
x1 x2 x3 y
23 146 1 91
x1 x2 x3 y
23 146 68 163
Another David Ogilvy
Panda or Gibbon?
Soccer/Football Example
Visitor Goals
Score
Visitor Goals
Allowed
Home Goals
Scored
Home Goals
Allowed
Outcome
2 3 1 4 0
3 3 1 2 1
5 6 2 1 1
Tree Based Approach
Tree Based Approach
All Models are Wrong
• After the tree has been built, a calculation is done to show how
accurate your model is
• The algorithm will try its best to minimize the error
Adding Complexity
New Example
Visitor Goals
Score
Visitor Goals
Allowed
Home Goals
Scored
Home Goals
Allowed
Outcome
1 2 4 2 ?
4 3 1 4 ?
3 4 1 1 ?
What is Artificial Intelligence
“Artificial intelligence is whatever hasn't been done yet”
-Larry Tesler, 1970
Is This AI?
• A program that can beat anyone in chess?
• A software service that can tell you the answer to almost any
question?
• A digital assistant?
• C3PO?
Is This AI?
Is This AI?
Is This AI?
Is This AI?
Is This AI?
• While not a universal definition, at Ogilvy we consider a main differentiation
of AI versus Machine Learning to be the ability to “self-learn” or “self-
update”
• This is in terms of analytics techniques, while a different criteria might be
applied to interactive marketing tools like ChatBots, etc.
What is an Example of AI?
• Example 1: Autonomous Media Buying
What is an Example of AI?
• Example 2: AI Generated Content
What is AI
WHY NOW?
Why Now
• Big Data
• Compute
Google Trends - Machine Learning
Corporations
Why Now?
“90% of the data in the world has been created in the past two years”
-IBM, 2017
Big Data
Data = Accuracy
Accuracy
Amount	of	Data
Data	vs	Accuracy
Enormous Data
But CPU’s are Slowing
Enter GPUs
Enter GPUs
But at a Cost
• A single GPU can cost up to $10,000 and uses tremendous amounts
of power
• Facebook recently used 256 GPUs to train 40,000 images a second
• Can rent on the cloud for cheaper
Where Next?
• Do we just keep adding data and power?
• Do we need new methods?
What do we Think!
• It’s complicated…
CASE STUDIES
Text Mining -> Chatbot
Text mining analysis to provide insights into best use of Chatbot
functionality
The Challenge - Utility Client
Social media customer
service is a significant cost
expenditure and usage
continues to rise
Competitors and businesses
are implementing Chatbots,
which are crucial to scaling
customer service and making
brand engagement more
interactive
Existing data around
customer service
conversations was
insufficient to examine
cost-effectiveness and
feasibility of a Chatbot
Business Case Landscape Existing Data
The Ask
Process Social Media Data
Analyze Recommend
Utilize Machine Learning to
Extract Key Topics from Text Data
Provide Recommendations
on Deploying a Chatbot
The Data
CONVERSATIONS BY TYPE CONVERSATIONS BY SENTIMENT
AVERAGE CONVERSATION LENGTH AVERAGE WORDS PER CONVERSATION
4.5
messages
~50
The Solution
Topic Modeling (Non-Negative Matrix Factorization)
Programming
Language
Data Science
Platform
Machine Learning
Package
In-line Coding and
Visualizations
Data Science Toolkit
Matrix
Representation
d1 d2 d3
bi1 1 0 1
bi2 0 2 0
bi3 0 1 4
Text
Conversations
-----
---
------
Matrix Factorisation to
Derive Topic Vectors
-----
---
------
Summarize Key Topics
1
2
..
3
Identifying Viral Tweets
Text mining analysis revealed 28% of conservation activity could be
directed away from customer care, with 6% related to viral or
marketing activity.
Revealed an opportunity for a heuristic or machine
learning model to flag these tweets algorithmically.
# # # # #
Extracting Key Phrases by Sentiment
Pulling out the top phrases by positive and negative
customer service conversations gave insight into potential
flags for a Chatbot to either continue chatting or divert a
customer to a representative.
Summarizing Customer Service Topics
customer service,
poor customer,
service today,
excellent
customer,
shocking
customer, service
advisor, worst
customer
Customer Service Seekers
email address,
change email, old
email, send
email, address
received, details
follows, got right,
technical error
Contact Us
power cut, post
code, red
triangle, pls help,
Saturday night,
fuse box, know
long, tell long,
gets sorted,
getting address
Help Seekers
A total of 9 topics were generated from the data through unsupervised
topic modeling. Three key topics (below) show a diversity of customer
service conversations not previously categorized by agents.
Evaluating Chatbot Usage
customer service… email address… power cut…
Sentiment: 70% negative
Complexity: ↑ average
Recommendation: divert
away from Chatbot
Sentiment: 60% negative
Complexity: ↑ average
Recommendation: divert
away from Chatbot
Sentiment: 66% positive
Complexity: ↓ average
Recommendation: potential to
utilize Chatbot
Customer Service Seekers Contact Us Help Seekers
Client Recommendations
1. Brand and Viral comments could be diverted to a Chatbot with machine learning
algorithm
2. Negative and positive sentiment are distinguishable by key phrases, allowing for
direction to Chatbot or human where necessary
3. After applying non-negative matrix factorization, we can determine which
conversation types are suitable for a Chatbot based on conversation complexity and
sentiment
Customer Lifetime Value
Scalable machine learning applied to millions of members
LTV Challenge
• Build reproducible, production level lifetime value model which scales to
millions of users
• Writes to database and allows others to use
• Refreshes every month
What did we Predict?
• Revenue - a regression problem
• Cost of goods sold - logistic problem
• Coupons redeemed - Bayesian
LTV = Revenue – COGS - Coupons
Prediction Error
-$40
$160
$360
$560
$760
$960
$1,160
$1,360
1
5
9
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
Predicted CLV($) Actual Net Revenue($)
Data Pipeline
Data-
warehouse
Stored Procedure
Trains Model
Trains Model
Trains Model
Stored Procedure
Predicts
Predicts
PRedicts
Writes Error Metrics
Data-
warehouse
Writes Scores
User User
User*Process takes less than an hour
Going Forward
• Develop a model to find what drives LTV
• Will sending more emails affect LTV
• What’s the optimal number of coupons to serve?
• Segmenting users around LTV
• What do we do with the most valuable
• Do we do anything at all?
• How do we engage users to spend more?
Want to Stay Present?
• We write weekly on machine learning, artificial intelligence, cloud
computing and other technology
• Cloudy with a Chance of AI - Subscribe today!
Questions?
Andrew Van Aken
Consultant,
OgilvyOne Worldwide
Laurie Close
Global Brand Partnerships,
OgilvyRED
Michael McCarthy
Senior Consultant,
OgilvyOne Worldwide

More Related Content

PDF
What's Next: State of Social 8
PDF
What's Next: Cloudy with a chance of AI 2
PDF
What's Next for The Mobile Landscape
PDF
What's Next for Social Listening
PDF
What's Next: A closer look at Amazon
PDF
What's Next: State of Social 9
PDF
What's Next: The World of Fake News
PDF
What's Next for Creativity & Technology: Applied Innovation
What's Next: State of Social 8
What's Next: Cloudy with a chance of AI 2
What's Next for The Mobile Landscape
What's Next for Social Listening
What's Next: A closer look at Amazon
What's Next: State of Social 9
What's Next: The World of Fake News
What's Next for Creativity & Technology: Applied Innovation

What's hot (20)

PPTX
Keeping Up With SEO in 2017 & Beyond
PDF
Account-based Marketing
PDF
What's Next: Marketing Maturity & How To Achieve It
PDF
What's Next: Highlights from Facebook F8 2018
PDF
What's Next: State of Social 7
PDF
Mobile Search Moments Understanding How Mobile Drives Conversions 3 2013
PDF
What's the ROI of Social Media?
PDF
What's Next: The Holistic Content Studio
PDF
Social value benchmark
PPT
2015 Trends
PDF
State of Messengers in Asia
PDF
State of Demand 2013
PDF
What's Next: Moment Marketing
PDF
Argyle CMO Summit, Boston 2015
PPTX
25 Disruptive Technology Trends 2015 - 2016
PDF
120 Awesome Marketing Stats, Charts and Graphs
PDF
Systematically Rising Above the Noise
PDF
What's Next: The New Shades of Loyalty
PDF
Digital marketing trends in 2018
PPTX
Marketing fact vs Marketing fantasy
Keeping Up With SEO in 2017 & Beyond
Account-based Marketing
What's Next: Marketing Maturity & How To Achieve It
What's Next: Highlights from Facebook F8 2018
What's Next: State of Social 7
Mobile Search Moments Understanding How Mobile Drives Conversions 3 2013
What's the ROI of Social Media?
What's Next: The Holistic Content Studio
Social value benchmark
2015 Trends
State of Messengers in Asia
State of Demand 2013
What's Next: Moment Marketing
Argyle CMO Summit, Boston 2015
25 Disruptive Technology Trends 2015 - 2016
120 Awesome Marketing Stats, Charts and Graphs
Systematically Rising Above the Noise
What's Next: The New Shades of Loyalty
Digital marketing trends in 2018
Marketing fact vs Marketing fantasy
Ad

Similar to Whats Next for Machine Learning (20)

PDF
What's Next: Ogilvy x Google Chatbots Partnership
PDF
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
PPTX
Algorithm Marketplace and the new "Algorithm Economy"
PDF
Generative AI leverages algorithms to create various forms of content
PDF
Cocolevio AI Chatbot 9.20.19
PDF
Big Data LDN 2018: HOW AUTOMATION CAN ACCELERATE THE DELIVERY OF MACHINE LEAR...
PDF
AI Orange Belt - Session 2
PDF
FROM BI TO APPLIED AI
PDF
Cognitive Automation - Your AI Coworker
PDF
From models to systems (Machine Learning in Production)
PDF
AI Talks Live - ML.NET and NLP (with ONNX)
PDF
Understanding the New World of Cognitive Computing
PDF
Generative AI - The New Reality: How Key Players Are Progressing
PPTX
Generative AI and Large Language Models (LLMs)
PPTX
The implementation of Big Data and AI on Digital Marketing
PPTX
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
PDF
EDW 2015 cognitive computing panel session
PPTX
The Era of AI is here - How to leverage AI for your benefit
PDF
AI 2023.pdf
PDF
GDG Harare - Devfest 2024 Combined Speaker Slides
What's Next: Ogilvy x Google Chatbots Partnership
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
Algorithm Marketplace and the new "Algorithm Economy"
Generative AI leverages algorithms to create various forms of content
Cocolevio AI Chatbot 9.20.19
Big Data LDN 2018: HOW AUTOMATION CAN ACCELERATE THE DELIVERY OF MACHINE LEAR...
AI Orange Belt - Session 2
FROM BI TO APPLIED AI
Cognitive Automation - Your AI Coworker
From models to systems (Machine Learning in Production)
AI Talks Live - ML.NET and NLP (with ONNX)
Understanding the New World of Cognitive Computing
Generative AI - The New Reality: How Key Players Are Progressing
Generative AI and Large Language Models (LLMs)
The implementation of Big Data and AI on Digital Marketing
WSO2Con 2025 - Building AI Applications in the Enterprise (Part 1)
EDW 2015 cognitive computing panel session
The Era of AI is here - How to leverage AI for your benefit
AI 2023.pdf
GDG Harare - Devfest 2024 Combined Speaker Slides
Ad

More from Ogilvy Consulting (20)

PDF
How to Win in Marketplaces
PDF
The Return to Growth in Turbulent Times
PDF
Using Brand to Drive M&A Value
PDF
Influencing our New Reality
PDF
Nudgestock 2020 – Necessity is the Mother of Reinvention
PDF
What's Next: How brands can capture value, mindset and experiences on their o...
PDF
What's Next: Celebrating Eid in a time of isolation
PDF
What's Next: Unlocking a powerful corporate culture in turbulent times and be...
PDF
What's Next: Now, Next & Beyond - Preparing people to return to the workplace
PDF
What's Next: Rapidly adjusting your customer experience strategy for the "new...
PDF
What's Next: Using technology to engage employees & build businesses
PDF
What's Next: Health & Wellness - Disruption & Adapting for the Rebound
PDF
What's Next: Using technology to engage employees and build businesses
PDF
What's Next: Steering Brands through COVID-19
PDF
What's Next: The Next Frontier in Automotive Industry
PDF
What's Next: Social Commerce - from transaction to truly social
PDF
What's Next: The Role of Brands in the Booming Original Content Business
PDF
What's Next: Trends for 2020
PDF
What's Next: Social Media Trends 2020
PDF
What's Next: Michael Frohlich talks to us about the woes from a CEO during a ...
How to Win in Marketplaces
The Return to Growth in Turbulent Times
Using Brand to Drive M&A Value
Influencing our New Reality
Nudgestock 2020 – Necessity is the Mother of Reinvention
What's Next: How brands can capture value, mindset and experiences on their o...
What's Next: Celebrating Eid in a time of isolation
What's Next: Unlocking a powerful corporate culture in turbulent times and be...
What's Next: Now, Next & Beyond - Preparing people to return to the workplace
What's Next: Rapidly adjusting your customer experience strategy for the "new...
What's Next: Using technology to engage employees & build businesses
What's Next: Health & Wellness - Disruption & Adapting for the Rebound
What's Next: Using technology to engage employees and build businesses
What's Next: Steering Brands through COVID-19
What's Next: The Next Frontier in Automotive Industry
What's Next: Social Commerce - from transaction to truly social
What's Next: The Role of Brands in the Booming Original Content Business
What's Next: Trends for 2020
What's Next: Social Media Trends 2020
What's Next: Michael Frohlich talks to us about the woes from a CEO during a ...

Recently uploaded (20)

PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PDF
Approach and Philosophy of On baking technology
PDF
Modernizing your data center with Dell and AMD
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Electronic commerce courselecture one. Pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Machine learning based COVID-19 study performance prediction
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Per capita expenditure prediction using model stacking based on satellite ima...
“AI and Expert System Decision Support & Business Intelligence Systems”
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Mobile App Security Testing_ A Comprehensive Guide.pdf
Reach Out and Touch Someone: Haptics and Empathic Computing
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Dropbox Q2 2025 Financial Results & Investor Presentation
NewMind AI Weekly Chronicles - August'25 Week I
Approach and Philosophy of On baking technology
Modernizing your data center with Dell and AMD
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Electronic commerce courselecture one. Pdf
Encapsulation_ Review paper, used for researhc scholars
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Review of recent advances in non-invasive hemoglobin estimation
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Machine learning based COVID-19 study performance prediction
Digital-Transformation-Roadmap-for-Companies.pptx
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf

Whats Next for Machine Learning

  • 2. Hello! Andrew Van Aken Consultant, OgilvyOne Worldwide Laurie Close Global Brand Partnerships, OgilvyRED Michael McCarthy Senior Consultant, OgilvyOne Worldwide
  • 3. What’s the weather like in your city? Tell us where you’re dialing in from!
  • 4. Want this deck? It will be available for download shortly after the webinar on: slideshare.net/socialogilvy Ogilvy staff: It’s also on The Market! themarket.ogilvy.com Are you on the go? You can join our webinars on mobile, too! Download the GoToWebinar app from the App Store or Google Play
  • 5. This Talk • We will demystify machine learning (ML) and artificial intelligence (AI) • Why now for ML and AI? • Ogilvy case studies
  • 6. What is Machine Learning Machine learning gives “computers the ability to learn without being explicitly programmed.” -Arthur Samuel, 1959
  • 7. Any Type of Data
  • 8. Machine Learning Concept • Machine learning takes an input • to an output: David Ogilvy
  • 9. How does it do it? x1 x2 x3 y 23 146 1 91 x1 x2 x3 y 23 146 68 163
  • 12. Soccer/Football Example Visitor Goals Score Visitor Goals Allowed Home Goals Scored Home Goals Allowed Outcome 2 3 1 4 0 3 3 1 2 1 5 6 2 1 1
  • 15. All Models are Wrong • After the tree has been built, a calculation is done to show how accurate your model is • The algorithm will try its best to minimize the error
  • 17. New Example Visitor Goals Score Visitor Goals Allowed Home Goals Scored Home Goals Allowed Outcome 1 2 4 2 ? 4 3 1 4 ? 3 4 1 1 ?
  • 18. What is Artificial Intelligence “Artificial intelligence is whatever hasn't been done yet” -Larry Tesler, 1970
  • 19. Is This AI? • A program that can beat anyone in chess? • A software service that can tell you the answer to almost any question? • A digital assistant? • C3PO?
  • 24. Is This AI? • While not a universal definition, at Ogilvy we consider a main differentiation of AI versus Machine Learning to be the ability to “self-learn” or “self- update” • This is in terms of analytics techniques, while a different criteria might be applied to interactive marketing tools like ChatBots, etc.
  • 25. What is an Example of AI? • Example 1: Autonomous Media Buying
  • 26. What is an Example of AI? • Example 2: AI Generated Content
  • 29. Why Now • Big Data • Compute
  • 30. Google Trends - Machine Learning
  • 32. Why Now? “90% of the data in the world has been created in the past two years” -IBM, 2017
  • 36. But CPU’s are Slowing
  • 39. But at a Cost • A single GPU can cost up to $10,000 and uses tremendous amounts of power • Facebook recently used 256 GPUs to train 40,000 images a second • Can rent on the cloud for cheaper
  • 40. Where Next? • Do we just keep adding data and power? • Do we need new methods?
  • 41. What do we Think! • It’s complicated…
  • 43. Text Mining -> Chatbot Text mining analysis to provide insights into best use of Chatbot functionality
  • 44. The Challenge - Utility Client Social media customer service is a significant cost expenditure and usage continues to rise Competitors and businesses are implementing Chatbots, which are crucial to scaling customer service and making brand engagement more interactive Existing data around customer service conversations was insufficient to examine cost-effectiveness and feasibility of a Chatbot Business Case Landscape Existing Data
  • 45. The Ask Process Social Media Data Analyze Recommend Utilize Machine Learning to Extract Key Topics from Text Data Provide Recommendations on Deploying a Chatbot
  • 46. The Data CONVERSATIONS BY TYPE CONVERSATIONS BY SENTIMENT AVERAGE CONVERSATION LENGTH AVERAGE WORDS PER CONVERSATION 4.5 messages ~50
  • 47. The Solution Topic Modeling (Non-Negative Matrix Factorization) Programming Language Data Science Platform Machine Learning Package In-line Coding and Visualizations Data Science Toolkit Matrix Representation d1 d2 d3 bi1 1 0 1 bi2 0 2 0 bi3 0 1 4 Text Conversations ----- --- ------ Matrix Factorisation to Derive Topic Vectors ----- --- ------ Summarize Key Topics 1 2 .. 3
  • 48. Identifying Viral Tweets Text mining analysis revealed 28% of conservation activity could be directed away from customer care, with 6% related to viral or marketing activity. Revealed an opportunity for a heuristic or machine learning model to flag these tweets algorithmically. # # # # #
  • 49. Extracting Key Phrases by Sentiment Pulling out the top phrases by positive and negative customer service conversations gave insight into potential flags for a Chatbot to either continue chatting or divert a customer to a representative.
  • 50. Summarizing Customer Service Topics customer service, poor customer, service today, excellent customer, shocking customer, service advisor, worst customer Customer Service Seekers email address, change email, old email, send email, address received, details follows, got right, technical error Contact Us power cut, post code, red triangle, pls help, Saturday night, fuse box, know long, tell long, gets sorted, getting address Help Seekers A total of 9 topics were generated from the data through unsupervised topic modeling. Three key topics (below) show a diversity of customer service conversations not previously categorized by agents.
  • 51. Evaluating Chatbot Usage customer service… email address… power cut… Sentiment: 70% negative Complexity: ↑ average Recommendation: divert away from Chatbot Sentiment: 60% negative Complexity: ↑ average Recommendation: divert away from Chatbot Sentiment: 66% positive Complexity: ↓ average Recommendation: potential to utilize Chatbot Customer Service Seekers Contact Us Help Seekers
  • 52. Client Recommendations 1. Brand and Viral comments could be diverted to a Chatbot with machine learning algorithm 2. Negative and positive sentiment are distinguishable by key phrases, allowing for direction to Chatbot or human where necessary 3. After applying non-negative matrix factorization, we can determine which conversation types are suitable for a Chatbot based on conversation complexity and sentiment
  • 53. Customer Lifetime Value Scalable machine learning applied to millions of members
  • 54. LTV Challenge • Build reproducible, production level lifetime value model which scales to millions of users • Writes to database and allows others to use • Refreshes every month
  • 55. What did we Predict? • Revenue - a regression problem • Cost of goods sold - logistic problem • Coupons redeemed - Bayesian LTV = Revenue – COGS - Coupons
  • 57. Data Pipeline Data- warehouse Stored Procedure Trains Model Trains Model Trains Model Stored Procedure Predicts Predicts PRedicts Writes Error Metrics Data- warehouse Writes Scores User User User*Process takes less than an hour
  • 58. Going Forward • Develop a model to find what drives LTV • Will sending more emails affect LTV • What’s the optimal number of coupons to serve? • Segmenting users around LTV • What do we do with the most valuable • Do we do anything at all? • How do we engage users to spend more?
  • 59. Want to Stay Present? • We write weekly on machine learning, artificial intelligence, cloud computing and other technology • Cloudy with a Chance of AI - Subscribe today!
  • 60. Questions? Andrew Van Aken Consultant, OgilvyOne Worldwide Laurie Close Global Brand Partnerships, OgilvyRED Michael McCarthy Senior Consultant, OgilvyOne Worldwide