SlideShare a Scribd company logo
How to Analyse and
Monitor the Health of
Your Customer Base
@CarmenMardiros
This is how it all started
.
What is a “cohort”?
first_order_month customers
Jan 2016 7325
Feb 2016 2344
March 2016 2355

. 
.
My first cohort analysis at navabi...
My two CEOs were not impressed: “The data is wrong”
Aha moment - I hadn’t “equalised” customers
2013 customers had 3 extra years of lifetime vs 2016 customers!
ANY metric will look better for older customers.
A fairer comparison painting a truer picture.
Cohort performance is capped at X weeks of age
An emerging
trend?
Should we be
worried?
How cohorts are doing at 8 weeks of age
A truly fair comparison that reflects reality.
Only cohorts at least X weeks old are eligible
How cohorts are doing at 8 weeks of age
What age is best to measure cohort behaviour at?
Long term view sacrifices visibility into recent cohorts
but gives better insight into lifetime behaviour.
On-the-fly age capping is best depending on the purpose.
March
Cohort
July
Cohort
Key takeaway #1
Always, always “equalise” customers
prior to analysis to avoid false alarms.
What metrics best reflect cohort health?
Leading indicators of LTV
Orders per Customer (or other actions)
Discount Rate (promos, sales etc)
Revenue per Customer
Return/Cancellation Rate
Marketing Cost per Customer (acquisition and retention)
Profit per Customer (actual and forecast)
Always capped at age X. Never measured for cohort as a whole.
Other leading indicators: website visits, products added to basket/wishlist, newsletters clicked on,
customer service tickets/complaints
“Per customer” metrics can be very misleading
Cohorts are rarely normally
distributed and the average can
be misleading. So:
Use median to calculate “per
customer” instead of mean, if
feasible.
Measure milestones reached.
What metrics best reflect cohort health?
Milestones reached
% Cohort reached 2nd order
% Cohort migrated from 2nd to 3rd order (3rd to 4th etc)
Digital equivalents: % User Cohort added product to basket within 3/7 days etc
% Cohort with discount rate over y% / avg price paid over €z
% Cohort reached profitability
(measures to what extent profitable customers subsidise the rest of the cohort!)
% Cohort reached VIP status (high LTV value)
Always capped at age X. Cross-reference with acquisition channel
for invaluable nuggets of insight.
Key takeaway #2
Use “milestones reached” as health
checkpoints for a wide range of cohort
behaviours.
Combine “calendar time” with “cohort time”
Activity in week X comes from customers at different ages. Understanding
“what works for whom” is challenging without analysing the mix.
Response is relative to Active Customer Base
# Active Customer base = Anyone active in previous 57 weeks
% Reorder Rate = Anyone active in previous 57 weeks and active again this week
Why Active Customer Base and not Total?
Removes the effect of
churned customers
Total Customer Base keeps going up and up. But it also includes an
increasingly high segment of churned customers.
A much greater re-order rate would have to happen in order to register as
strongly if we calculated Reorder Rate relative to the total customer base.
Removes the effect of
new customers
Total Customer Base usually also counts customers acquired that week.
This can muddy the picture significantly.
Key takeaway #3
Identify the customer segments your
organisation most depends on and monitor
their size and response like a hawk.
Questions?
@CarmenMardiros

More Related Content

PDF
Consumer Snapshot April 2013
PDF
Consumer Snapshot May 2015
PDF
Consumer Snapshot - May 2016
PDF
Consumer Snapshot August 2015
PDF
Consumer Snapshot - June 2016
PDF
Consumer Snapshot June 2014
PDF
Consumer Snapshot June 2015
PDF
Key Factors to upgrade suppliers
Consumer Snapshot April 2013
Consumer Snapshot May 2015
Consumer Snapshot - May 2016
Consumer Snapshot August 2015
Consumer Snapshot - June 2016
Consumer Snapshot June 2014
Consumer Snapshot June 2015
Key Factors to upgrade suppliers

Viewers also liked (19)

PDF
You Don't Have to Be a Data Scientist to Do Data Science
PDF
The Lego Data Layer
PDF
How to Sharpen Your Investigative Analysis with PowerPivot
PDF
Contribution Modelling using Conversion Path Coverage
PDF
Using Lifecycle Scores for Marketing Optimisation
PDF
Visitor Intent: Smart clues for understanding customer journeys
PPTX
PDF
Phils Session cards @ Measurecamp
PPTX
Hacia la construcciĂłn de nuestro mapa socioterritorial
PPTX
Đ”ĐŸĐœĐ°Đ»ŃŒĐŽ ĐąŃ€Đ°ĐŒĐż
PDF
DNSăźé‹ç”šă‚’è€ƒăˆă‚‹
 
DOCX
T1 Prima 2017 Season 4 Driver list
PDF
Morphing GA into an Affiliate Analytics Monster
PDF
Les culées des ponts
PDF
Shoot the Shit - EstĂșdio Criativo de Comunicação
PDF
Common mistakes with media tagging (utm tags) and how to fix them!
PPSX
Revista - La Edad Media
PDF
Getting to the People Behind The Keywords
You Don't Have to Be a Data Scientist to Do Data Science
The Lego Data Layer
How to Sharpen Your Investigative Analysis with PowerPivot
Contribution Modelling using Conversion Path Coverage
Using Lifecycle Scores for Marketing Optimisation
Visitor Intent: Smart clues for understanding customer journeys
Phils Session cards @ Measurecamp
Hacia la construcciĂłn de nuestro mapa socioterritorial
Đ”ĐŸĐœĐ°Đ»ŃŒĐŽ ĐąŃ€Đ°ĐŒĐż
DNSăźé‹ç”šă‚’è€ƒăˆă‚‹
 
T1 Prima 2017 Season 4 Driver list
Morphing GA into an Affiliate Analytics Monster
Les culées des ponts
Shoot the Shit - EstĂșdio Criativo de Comunicação
Common mistakes with media tagging (utm tags) and how to fix them!
Revista - La Edad Media
Getting to the People Behind The Keywords
Ad

Similar to How to Analyse and Monitor the Health of Your Customer Base (20)

PDF
How to Build an Effective Customer Health Model
PPTX
Customer Health Scores; Best Practices
PDF
Measuring the Effectiveness of Customer Health Model
PDF
The Evolution of Clarabridge's Customer Health Program
PDF
Metrics that matter
PDF
Designing an Actionable Customer Health Model
PDF
Metrics that matter
PDF
How to Build a Predictive Customer Health Model
PPTX
5 Ways to Retain & Grow Customers through Customer Success
PDF
Consumer health experience radar 2015
 
PDF
Using R for customer segmentation
PPTX
Personal Health Management
 
PPTX
Day 1 (Lecture 2): Business Analytics
PDF
Customer Analytics Best Practice
PPTX
The Customer Success Metrics That Matter
PDF
Customer Health Scoring Best Practices
PDF
Summer Lindman. "The phases of building out a robust customer health score"
PPTX
Customer activation Predictive model
PPTX
Cohort analysis on Google Analytics
PDF
Health Datapalooza 2013: Transforming Benefits Design - Sherri Zink
How to Build an Effective Customer Health Model
Customer Health Scores; Best Practices
Measuring the Effectiveness of Customer Health Model
The Evolution of Clarabridge's Customer Health Program
Metrics that matter
Designing an Actionable Customer Health Model
Metrics that matter
How to Build a Predictive Customer Health Model
5 Ways to Retain & Grow Customers through Customer Success
Consumer health experience radar 2015
 
Using R for customer segmentation
Personal Health Management
 
Day 1 (Lecture 2): Business Analytics
Customer Analytics Best Practice
The Customer Success Metrics That Matter
Customer Health Scoring Best Practices
Summer Lindman. "The phases of building out a robust customer health score"
Customer activation Predictive model
Cohort analysis on Google Analytics
Health Datapalooza 2013: Transforming Benefits Design - Sherri Zink
Ad

Recently uploaded (20)

PPTX
A Complete Guide to Streamlining Business Processes
PPTX
Topic 5 Presentation 5 Lesson 5 Corporate Fin
PPTX
DS-40-Pre-Engagement and Kickoff deck - v8.0.pptx
PDF
Introduction to the R Programming Language
PDF
Introduction to Data Science and Data Analysis
PPTX
Qualitative Qantitative and Mixed Methods.pptx
PDF
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
PPTX
Leprosy and NLEP programme community medicine
PDF
[EN] Industrial Machine Downtime Prediction
PDF
Optimise Shopper Experiences with a Strong Data Estate.pdf
PPTX
STERILIZATION AND DISINFECTION-1.ppthhhbx
PPT
DU, AIS, Big Data and Data Analytics.ppt
PPT
ISS -ESG Data flows What is ESG and HowHow
DOCX
Factor Analysis Word Document Presentation
PPTX
IMPACT OF LANDSLIDE.....................
PDF
Votre score augmente si vous choisissez une catégorie et que vous rédigez une...
PPTX
sac 451hinhgsgshssjsjsjheegdggeegegdggddgeg.pptx
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PDF
Tetra Pak Index 2023 - The future of health and nutrition - Full report.pdf
 
PDF
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
A Complete Guide to Streamlining Business Processes
Topic 5 Presentation 5 Lesson 5 Corporate Fin
DS-40-Pre-Engagement and Kickoff deck - v8.0.pptx
Introduction to the R Programming Language
Introduction to Data Science and Data Analysis
Qualitative Qantitative and Mixed Methods.pptx
Jean-Georges Perrin - Spark in Action, Second Edition (2020, Manning Publicat...
Leprosy and NLEP programme community medicine
[EN] Industrial Machine Downtime Prediction
Optimise Shopper Experiences with a Strong Data Estate.pdf
STERILIZATION AND DISINFECTION-1.ppthhhbx
DU, AIS, Big Data and Data Analytics.ppt
ISS -ESG Data flows What is ESG and HowHow
Factor Analysis Word Document Presentation
IMPACT OF LANDSLIDE.....................
Votre score augmente si vous choisissez une catégorie et que vous rédigez une...
sac 451hinhgsgshssjsjsjheegdggeegegdggddgeg.pptx
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
Tetra Pak Index 2023 - The future of health and nutrition - Full report.pdf
 
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...

How to Analyse and Monitor the Health of Your Customer Base

  • 1. How to Analyse and Monitor the Health of Your Customer Base @CarmenMardiros
  • 2. This is how it all started
. What is a “cohort”? first_order_month customers Jan 2016 7325 Feb 2016 2344 March 2016 2355 
. 
.
  • 3. My first cohort analysis at navabi... My two CEOs were not impressed: “The data is wrong”
  • 4. Aha moment - I hadn’t “equalised” customers 2013 customers had 3 extra years of lifetime vs 2016 customers! ANY metric will look better for older customers.
  • 5. A fairer comparison painting a truer picture. Cohort performance is capped at X weeks of age An emerging trend? Should we be worried? How cohorts are doing at 8 weeks of age
  • 6. A truly fair comparison that reflects reality. Only cohorts at least X weeks old are eligible How cohorts are doing at 8 weeks of age
  • 7. What age is best to measure cohort behaviour at? Long term view sacrifices visibility into recent cohorts but gives better insight into lifetime behaviour. On-the-fly age capping is best depending on the purpose. March Cohort July Cohort
  • 8. Key takeaway #1 Always, always “equalise” customers prior to analysis to avoid false alarms.
  • 9. What metrics best reflect cohort health? Leading indicators of LTV Orders per Customer (or other actions) Discount Rate (promos, sales etc) Revenue per Customer Return/Cancellation Rate Marketing Cost per Customer (acquisition and retention) Profit per Customer (actual and forecast) Always capped at age X. Never measured for cohort as a whole. Other leading indicators: website visits, products added to basket/wishlist, newsletters clicked on, customer service tickets/complaints
  • 10. “Per customer” metrics can be very misleading Cohorts are rarely normally distributed and the average can be misleading. So: Use median to calculate “per customer” instead of mean, if feasible. Measure milestones reached.
  • 11. What metrics best reflect cohort health? Milestones reached % Cohort reached 2nd order % Cohort migrated from 2nd to 3rd order (3rd to 4th etc) Digital equivalents: % User Cohort added product to basket within 3/7 days etc % Cohort with discount rate over y% / avg price paid over €z % Cohort reached profitability (measures to what extent profitable customers subsidise the rest of the cohort!) % Cohort reached VIP status (high LTV value) Always capped at age X. Cross-reference with acquisition channel for invaluable nuggets of insight.
  • 12. Key takeaway #2 Use “milestones reached” as health checkpoints for a wide range of cohort behaviours.
  • 13. Combine “calendar time” with “cohort time” Activity in week X comes from customers at different ages. Understanding “what works for whom” is challenging without analysing the mix.
  • 14. Response is relative to Active Customer Base # Active Customer base = Anyone active in previous 57 weeks % Reorder Rate = Anyone active in previous 57 weeks and active again this week
  • 15. Why Active Customer Base and not Total? Removes the effect of churned customers Total Customer Base keeps going up and up. But it also includes an increasingly high segment of churned customers. A much greater re-order rate would have to happen in order to register as strongly if we calculated Reorder Rate relative to the total customer base. Removes the effect of new customers Total Customer Base usually also counts customers acquired that week. This can muddy the picture significantly.
  • 16. Key takeaway #3 Identify the customer segments your organisation most depends on and monitor their size and response like a hawk.