A journey to
meaningful
measurement
Stats that matter
Beth Granter
April 2014
@bethgranter
brilliantnoise.com
A journey to meaningful measurement
-  How to achieve live integrated dashboards
framed by customer decision journey
-  From a starting point of multiple spreadsheets,
ad-hoc reporting
-  Organisational implementation
-  Challenges
-  What’s next?
Customer journeys
Forrester engagement framework
IAB framework
The customer (or campaigner, or
fundraiser) decision journey
Model first published Harvard Business Review
Mckinsey & Co’s Consumer Decision Journey Model
(or take campaign action,
or donate)
Awareness Action Advocacy
Traffi
c
Bounce-rate
View
s
Uniques
Sign-ups
Com
m
ents
Dow
nloads
Tim
e
w
atching
In-bound
links
Recom
m
endations
M
entions
Positive
sentim
ent
Engagement
Scale and control
Returns
Purchases
M
edia
uploads
Fans&
follow
ers
Blog
posts
Engagement
Low effort / cost High effort / cost
The three As
Multi channel
integrated
dashboards
Multi channel integrated dashboards
-  Multiple users
-  Live data
-  Meaningful as connected to KPIs
-  Actionable as each metric challenged
-  CDJ simplified (Awareness, Actions, Advocacy)
-  Customer focused not platform/channel focused
Integrated dashboards
Awareness
Beth Granter stats that matter workshop - 23 april 2014
Beth Granter stats that matter workshop - 23 april 2014
From
spreadsheets...
Where many start their journey
-  No measurement framework
-  Ad-hoc digital stats reporting
-  Multiple spreadsheets
-  Reporting not tied to KPIs
-  KPIs not tied to objectives
First steps
-  Connect KPIs to objectives
-  E.g.
Objective: increase reach of brand content
KPI: website visits, Facebook reach, Twitter followers,
email opens
-  E.g.
Objective: increase advocacy
KPI: NPS, Facebook shares, retweets
Multi-channel
Report metrics in context of awareness, action and
advocacy stages of CDJ
Multi-channel
Multi-channel
Social insights
Additional, separate monthly social report based on
Brandwatch data, provided as PDF document
Mid level progress
-  Partial measurement framework
-  KPIs tied to objectives
-  Integrated multi-channel spreadsheets (sales,
membership, email, social, website)
-  Monthly stats and insights reporting
-  Reporting still not tied to KPIs and not all actionable
Towards
actionable
metrics
4
Actionable metrics
-  Ask the question, “what action should I take as a
result of this metric going down?”
-  If unknown, what is the purpose of reporting on the
metric?
-  What knowledge will you gain about customer
behaviour as a result of knowing about that stat?
-  Many stats don’t tell a clear story e.g. bounce rate
Rationalising metrics
-  What stage of the CDJ are we measuring?
-  What channel are we measuring?
-  What is the metric?
-  Do you need daily/weekly/monthly data points?
-  Where does the data come from?
Rationalising metrics
-  Is there an API where you can get the data from?
-  What will this metric tell us?
-  Is this metric covered by another metric you’re
already reporting on?
-  How often do you need to look at this metric?
Rationalising metrics
-  What action could you take as a result of this metric
going down (or up)?
-  What impact would that action have on the
organisation?
-  Based on all of the above, what’s the value of this
metric out of 5?
-  Would this metric be useful to others in the
organisation, not just centrally?
Picturehouse Cinemas: rationalising metrics
-  Start with the customer decision journey
-  Define organisational objectives based on CDJ
-  Derive departmental objectives from organisational
-  Define KPIs from objectives
-  Check relevance
rationalising
metrics
Action focused
measurement
framework
our
branch
branch
branch
branch
branch
branch
Live data, daily data points
-  Live data means you can be more responsive. Monthly
reports sometimes provide the information when it’s
too late to act.
-  Daily data points mean you can see exactly when
something happened, rather than a broad trend. This
makes it easier to understand why numbers changed.
Customer before platform
-  Presenting reports with data grouped by phase of the
customer decision journey rather than by channel
better reflects the user experience
-  Makes recommendations / actions customer focused
-  Makes your organisation customer focused
Advanced measurement & reporting
(reminder)
-  Multi-channel integrated dashboards
-  Multiple users (building a culture of data)
-  Live data
-  Meaningful as connected to KPIs
-  Actionable as each metric challenged (avoid vanity metrics!)
-  CDJ simplified (Awareness, Actions, Advocacy)
-  Customer focused not platform/channel focused
Detail remains in platform specific tools
Common
challenges
5
Common challenges
-  Multiple reports remain
-  Competing priorities of different reports, limited time
-  Priority of social/digital culturally (“what’s the impact
on the bottom line?”)
Goals
-  Create a unified dashboard: incorporate sales data
with website, social, online
-  Prove (some of) the value of social (attribution
modelling), to increase priority of social/digital
culturally, and improve engagement with data
-  Regularly re-evaluate how actionable the insights
really are around each metric
Some final thoughts…
-  In itself, reporting is unlikely to drive a cultural change
-  Make data/stats central to people’s roles and reviews
-  Ensure reports are highly valuable and actionable, not just
box checking
-  Less is more – start with minimum essential metrics to get
reporting embedded
-  Keep metrics framed in context of why they’re important
e.g. what organisational objective do they relate to?
Summary
-  Start with the customer decision journey
-  Define organisational objectives based on CDJ
-  Derive departmental objectives from organisational ones
-  Define KPIs from objectives
-  Present data in terms of CDJ (customer focused not platform
focused)
-  Integrate channel data where possible
-  Check relevance – what are you going to do about it? If unsure, cross
reference with assumed ideal actions (but don’t start with these)
-  Keep detail in channel specific tools
Attribution
modelling
6
Tentative steps in attribution modelling
-  Consider impact of
online on offline
sales (voucher
codes)
-  Google Analytics:
multiple touch
points not just last
visit conversion
Tentative steps in attribution modelling
Google Analytics: multiple touch points not just last
visit conversion
Tentative steps in attribution modelling
Tentative steps in attribution modelling
Tentative steps in attribution modelling
The end!
Questions?
Stats that matter
Beth Granter
April 2014
@bethgranter
brilliantnoise.com

More Related Content

PPTX
Media/PR - meaningful measurement. Stats that matter workshop.
PPTX
Integrated KPIs. Stats that matter workshop.
PDF
Indian Healthcare Re-Engineered V1
PPTX
4A's Measurement Task Force Update_Rgagnon media measurement task force
PDF
Measuring the Impact of Your Nonprofit
PPTX
Smack - Social Media Analytics by Calvin Klein
PPT
Introduction to Impact Measurement
 
PDF
Mobile patient engagement for private pay physicians attract, engage, care,...
Media/PR - meaningful measurement. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.
Indian Healthcare Re-Engineered V1
4A's Measurement Task Force Update_Rgagnon media measurement task force
Measuring the Impact of Your Nonprofit
Smack - Social Media Analytics by Calvin Klein
Introduction to Impact Measurement
 
Mobile patient engagement for private pay physicians attract, engage, care,...

What's hot (10)

PPT
Updated sbs
PPTX
Measuring the Impact of Your Nonprofit
PDF
4th Enhancing Customer Experience ,Loyalty and Retention in Telecom 4th-5th A...
PPTX
CREATING A CUSTOMER SUCCESS PROGRAM TO BOOST ROI WHILE SCALING SUPPORT
PPTX
Strategically Evaluating your Association's Global Readiness, Intro
PPT
LIBR 230 Week 3 Fall 2012
PPTX
Building Your Champion Network
PDF
Product and Technology
PPTX
Measuring The Modern Shopper - Lewis Lenssen, Rakuten Attribution
PDF
Business Models work for Libraries Too!
Updated sbs
Measuring the Impact of Your Nonprofit
4th Enhancing Customer Experience ,Loyalty and Retention in Telecom 4th-5th A...
CREATING A CUSTOMER SUCCESS PROGRAM TO BOOST ROI WHILE SCALING SUPPORT
Strategically Evaluating your Association's Global Readiness, Intro
LIBR 230 Week 3 Fall 2012
Building Your Champion Network
Product and Technology
Measuring The Modern Shopper - Lewis Lenssen, Rakuten Attribution
Business Models work for Libraries Too!
Ad

Viewers also liked (6)

PPTX
Website - meaningful measurement. Stats that matter workshop.
PDF
Start with strategy to measure what matters - Stats that matter conference
PPT
Social media - meaningful measurement. Stats that matter workshop
PPT
Asking the right questions - making the most of research - Stats that matter ...
PPT
Brand monitoring. Stats that matter workshop.
PDF
Effective Brand Communications
Website - meaningful measurement. Stats that matter workshop.
Start with strategy to measure what matters - Stats that matter conference
Social media - meaningful measurement. Stats that matter workshop
Asking the right questions - making the most of research - Stats that matter ...
Brand monitoring. Stats that matter workshop.
Effective Brand Communications
Ad

Similar to Beth Granter stats that matter workshop - 23 april 2014 (20)

PDF
Your smarter data analytics strategy - Social Media Strategies Summit (SMSS) ...
PPTX
How to Pick the Right Metrics with Josh Vincent of Transparent Partners
PPTX
LDD Summer Seminar 2013 - DC Storm you can't manage what you can't measure
PDF
How Brands Are Making Better Digital Marketing Decisions - With Data - Neil P...
PPTX
Our Integrated Future
PDF
How Brands Are Making Better Digital Marketing Decisions - Neil Pursey, Measu...
PDF
4 ways to improve your customer performance measurement
DOCX
iVIaster ClassHow do you w o r k lmith the CEO or CiVIOt.docx
PPTX
How to Prove Marketing ROI: Overcoming Digital Marketing Challenges
PDF
Qualtrics_3 steps to turn CX insights into business impact.pdf
PPTX
Customer journey attribution, a question of science & art
PPSX
Small Business Analytics and Metrics: How and What Do you Measure Up?
PDF
Measuring engagement and revenue throughout the customer lifecycle by Silverpop
PPTX
Lean Analytics & Analytics Dashboards
PDF
Integrated communications dashboards june 2018
PDF
Marketing's True Impact by BECKON
PPTX
Why, What, and of How Marketing Measurement
PPTX
Data Framework Fundamentals
PDF
Dash Process
PDF
Marketing Measurement Mastery Webcast Slides by BECKON
Your smarter data analytics strategy - Social Media Strategies Summit (SMSS) ...
How to Pick the Right Metrics with Josh Vincent of Transparent Partners
LDD Summer Seminar 2013 - DC Storm you can't manage what you can't measure
How Brands Are Making Better Digital Marketing Decisions - With Data - Neil P...
Our Integrated Future
How Brands Are Making Better Digital Marketing Decisions - Neil Pursey, Measu...
4 ways to improve your customer performance measurement
iVIaster ClassHow do you w o r k lmith the CEO or CiVIOt.docx
How to Prove Marketing ROI: Overcoming Digital Marketing Challenges
Qualtrics_3 steps to turn CX insights into business impact.pdf
Customer journey attribution, a question of science & art
Small Business Analytics and Metrics: How and What Do you Measure Up?
Measuring engagement and revenue throughout the customer lifecycle by Silverpop
Lean Analytics & Analytics Dashboards
Integrated communications dashboards june 2018
Marketing's True Impact by BECKON
Why, What, and of How Marketing Measurement
Data Framework Fundamentals
Dash Process
Marketing Measurement Mastery Webcast Slides by BECKON

More from CharityComms (20)

PDF
The science behind fake news and misinformation: lessons for effective charit...
PDF
How to find the heart of your story and truly connect with your audience
PDF
Testing stories in the real world: a case study breakdown with Unicef and Cat...
PDF
Shifting public perceptions of childhood obesity as part of a long-term appro...
PDF
Golden rules for changing hearts and minds in divided times
PDF
How framing is changing the rules of charity comms
PDF
Applying behavioural insights to comms
PDF
Why it's so hard to change minds
PDF
What if we thought right outside the box?
PDF
Creating a new sea story - a first aid kit for ocean communications
PDF
Trends in a turbulent world
PDF
What defines us? The importance of authentic communicators and the misconcept...
PDF
What has our brand got to do with our gossip culture?
PDF
How to identify or develop a values framework and apply it to your audiences
PDF
Embedding social research insights into your communications and culture
PDF
20 Voices for 2020: Using supporter-generated content to share personal stories
PDF
Crisis at Christmas: Sharing real-life stories at the point of support
PDF
How Bowel Cancer UK maximise case studies during Bowel Cancer Awareness Month
PDF
Crisis communications isn't always about the negative
PDF
What opportunities does the new parliament offer charities?
The science behind fake news and misinformation: lessons for effective charit...
How to find the heart of your story and truly connect with your audience
Testing stories in the real world: a case study breakdown with Unicef and Cat...
Shifting public perceptions of childhood obesity as part of a long-term appro...
Golden rules for changing hearts and minds in divided times
How framing is changing the rules of charity comms
Applying behavioural insights to comms
Why it's so hard to change minds
What if we thought right outside the box?
Creating a new sea story - a first aid kit for ocean communications
Trends in a turbulent world
What defines us? The importance of authentic communicators and the misconcept...
What has our brand got to do with our gossip culture?
How to identify or develop a values framework and apply it to your audiences
Embedding social research insights into your communications and culture
20 Voices for 2020: Using supporter-generated content to share personal stories
Crisis at Christmas: Sharing real-life stories at the point of support
How Bowel Cancer UK maximise case studies during Bowel Cancer Awareness Month
Crisis communications isn't always about the negative
What opportunities does the new parliament offer charities?

Recently uploaded (20)

PDF
Session 11 - Data Visualization Storytelling (2).pdf
PPTX
CHAPTER-2-THE-ACCOUNTING-PROCESS-2-4.pptx
PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
PPTX
IMPACT OF LANDSLIDE.....................
PPTX
chuitkarjhanbijunsdivndsijvndiucbhsaxnmzsicvjsd
PDF
©️ 02_SKU Automatic SW Robotics for Microsoft PC.pdf
PPTX
machinelearningoverview-250809184828-927201d2.pptx
PPT
statistic analysis for study - data collection
PPTX
DATA MODELING, data model concepts, types of data concepts
PPTX
Machine Learning and working of machine Learning
PDF
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
PPTX
recommendation Project PPT with details attached
PPTX
DS-40-Pre-Engagement and Kickoff deck - v8.0.pptx
PPTX
SET 1 Compulsory MNH machine learning intro
PPT
PROJECT CYCLE MANAGEMENT FRAMEWORK (PCM).ppt
PPTX
indiraparyavaranbhavan-240418134200-31d840b3.pptx
PPTX
chrmotography.pptx food anaylysis techni
PPTX
Business_Capability_Map_Collection__pptx
PPTX
FMIS 108 and AISlaudon_mis17_ppt_ch11.pptx
PPT
Image processing and pattern recognition 2.ppt
Session 11 - Data Visualization Storytelling (2).pdf
CHAPTER-2-THE-ACCOUNTING-PROCESS-2-4.pptx
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
IMPACT OF LANDSLIDE.....................
chuitkarjhanbijunsdivndsijvndiucbhsaxnmzsicvjsd
©️ 02_SKU Automatic SW Robotics for Microsoft PC.pdf
machinelearningoverview-250809184828-927201d2.pptx
statistic analysis for study - data collection
DATA MODELING, data model concepts, types of data concepts
Machine Learning and working of machine Learning
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
recommendation Project PPT with details attached
DS-40-Pre-Engagement and Kickoff deck - v8.0.pptx
SET 1 Compulsory MNH machine learning intro
PROJECT CYCLE MANAGEMENT FRAMEWORK (PCM).ppt
indiraparyavaranbhavan-240418134200-31d840b3.pptx
chrmotography.pptx food anaylysis techni
Business_Capability_Map_Collection__pptx
FMIS 108 and AISlaudon_mis17_ppt_ch11.pptx
Image processing and pattern recognition 2.ppt

Beth Granter stats that matter workshop - 23 april 2014

  • 1. A journey to meaningful measurement Stats that matter Beth Granter April 2014 @bethgranter brilliantnoise.com
  • 2. A journey to meaningful measurement -  How to achieve live integrated dashboards framed by customer decision journey -  From a starting point of multiple spreadsheets, ad-hoc reporting -  Organisational implementation -  Challenges -  What’s next?
  • 6. The customer (or campaigner, or fundraiser) decision journey Model first published Harvard Business Review Mckinsey & Co’s Consumer Decision Journey Model (or take campaign action, or donate)
  • 7. Awareness Action Advocacy Traffi c Bounce-rate View s Uniques Sign-ups Com m ents Dow nloads Tim e w atching In-bound links Recom m endations M entions Positive sentim ent Engagement Scale and control Returns Purchases M edia uploads Fans& follow ers Blog posts Engagement Low effort / cost High effort / cost The three As
  • 9. Multi channel integrated dashboards -  Multiple users -  Live data -  Meaningful as connected to KPIs -  Actionable as each metric challenged -  CDJ simplified (Awareness, Actions, Advocacy) -  Customer focused not platform/channel focused
  • 14. Where many start their journey -  No measurement framework -  Ad-hoc digital stats reporting -  Multiple spreadsheets -  Reporting not tied to KPIs -  KPIs not tied to objectives
  • 15. First steps -  Connect KPIs to objectives -  E.g. Objective: increase reach of brand content KPI: website visits, Facebook reach, Twitter followers, email opens -  E.g. Objective: increase advocacy KPI: NPS, Facebook shares, retweets
  • 16. Multi-channel Report metrics in context of awareness, action and advocacy stages of CDJ
  • 19. Social insights Additional, separate monthly social report based on Brandwatch data, provided as PDF document
  • 20. Mid level progress -  Partial measurement framework -  KPIs tied to objectives -  Integrated multi-channel spreadsheets (sales, membership, email, social, website) -  Monthly stats and insights reporting -  Reporting still not tied to KPIs and not all actionable
  • 22. Actionable metrics -  Ask the question, “what action should I take as a result of this metric going down?” -  If unknown, what is the purpose of reporting on the metric? -  What knowledge will you gain about customer behaviour as a result of knowing about that stat? -  Many stats don’t tell a clear story e.g. bounce rate
  • 23. Rationalising metrics -  What stage of the CDJ are we measuring? -  What channel are we measuring? -  What is the metric? -  Do you need daily/weekly/monthly data points? -  Where does the data come from?
  • 24. Rationalising metrics -  Is there an API where you can get the data from? -  What will this metric tell us? -  Is this metric covered by another metric you’re already reporting on? -  How often do you need to look at this metric?
  • 25. Rationalising metrics -  What action could you take as a result of this metric going down (or up)? -  What impact would that action have on the organisation? -  Based on all of the above, what’s the value of this metric out of 5? -  Would this metric be useful to others in the organisation, not just centrally?
  • 26. Picturehouse Cinemas: rationalising metrics -  Start with the customer decision journey -  Define organisational objectives based on CDJ -  Derive departmental objectives from organisational -  Define KPIs from objectives -  Check relevance rationalising metrics
  • 28. Live data, daily data points -  Live data means you can be more responsive. Monthly reports sometimes provide the information when it’s too late to act. -  Daily data points mean you can see exactly when something happened, rather than a broad trend. This makes it easier to understand why numbers changed.
  • 29. Customer before platform -  Presenting reports with data grouped by phase of the customer decision journey rather than by channel better reflects the user experience -  Makes recommendations / actions customer focused -  Makes your organisation customer focused
  • 30. Advanced measurement & reporting (reminder) -  Multi-channel integrated dashboards -  Multiple users (building a culture of data) -  Live data -  Meaningful as connected to KPIs -  Actionable as each metric challenged (avoid vanity metrics!) -  CDJ simplified (Awareness, Actions, Advocacy) -  Customer focused not platform/channel focused
  • 31. Detail remains in platform specific tools
  • 33. Common challenges -  Multiple reports remain -  Competing priorities of different reports, limited time -  Priority of social/digital culturally (“what’s the impact on the bottom line?”)
  • 34. Goals -  Create a unified dashboard: incorporate sales data with website, social, online -  Prove (some of) the value of social (attribution modelling), to increase priority of social/digital culturally, and improve engagement with data -  Regularly re-evaluate how actionable the insights really are around each metric
  • 35. Some final thoughts… -  In itself, reporting is unlikely to drive a cultural change -  Make data/stats central to people’s roles and reviews -  Ensure reports are highly valuable and actionable, not just box checking -  Less is more – start with minimum essential metrics to get reporting embedded -  Keep metrics framed in context of why they’re important e.g. what organisational objective do they relate to?
  • 36. Summary -  Start with the customer decision journey -  Define organisational objectives based on CDJ -  Derive departmental objectives from organisational ones -  Define KPIs from objectives -  Present data in terms of CDJ (customer focused not platform focused) -  Integrate channel data where possible -  Check relevance – what are you going to do about it? If unsure, cross reference with assumed ideal actions (but don’t start with these) -  Keep detail in channel specific tools
  • 38. Tentative steps in attribution modelling -  Consider impact of online on offline sales (voucher codes) -  Google Analytics: multiple touch points not just last visit conversion
  • 39. Tentative steps in attribution modelling Google Analytics: multiple touch points not just last visit conversion
  • 40. Tentative steps in attribution modelling
  • 41. Tentative steps in attribution modelling
  • 42. Tentative steps in attribution modelling
  • 43. The end! Questions? Stats that matter Beth Granter April 2014 @bethgranter brilliantnoise.com