SlideShare a Scribd company logo
Net Promoter Score®:
Science or Pseudoscience?
Daniel Kinal - @dktpm
Product Anonymous – Sep 2019
How Loyalty Leads to Business Success
Deliver Great Products/Experiences
↑ Trial and adoption
↓ Customer Acq’n Cost
↑ Customer Referral
↑ Customer Loyalty
More
customers
↑ Customer Retention
↑ Repeat Purchases
↑ Cust. Lifetime Value
↓ Price Elasticity
↑ Prices & GP
Make more $
Spend less $
That Question Again
How likely is it that you would recommend
[Company X] to a friend or colleague?
0 1 2 3 4 5 6 7 8 9 10
Not at all
likely
Extremely
likelyNeutral
Detractors Passives Promoters
And some other reasons it’s not great science 1/2
“Simply irrelevant” in some industries*
Not predictive in monopoly or near-monopoly
conditions*
Data analysed was historical, not future.
Unconvincing replication studies†
* Fred Reichheld, HBR, 2003
† See Jeff Sauro’s study, 2018
And some other reasons it’s not great science 2/2
Highly volatile measure
Obscures critical information
Some compelling qualities of the NPS
Cheap
Fast
Simple
Accepted
How to make NPS as valuable as possible
Measure brand or “full product experience” rather than
feature or interaction
Measure longitudinally and conduct trend rather than
point-in-time analysis
Keep it as scientific as you can
(randomisation, third-party research)
Compare your NPS to direct competitors
Remember what you are measuring (loyalty and
propensity to evangelise, not product satisfaction)
Analyse qualitative feedback and NPS makeup
But... ask yourself and your stakeholders:
Is loyalty a significant contributor to
our product’s success?
Is word of mouth important?
Are friends/colleagues going to be key
influencers or customers?
Is repeat purchase important?
Will loyalty reduce price elasticity?
Think about what NPS really means for your product
It is always going to be a proxy measure.
Is it even a proxy for something you care about (pdt/mkt fit)?
Does the loyalty model even hold true for your products?
Number of degrees of separation from what you actually care about?
Net Promoter
Score®
Net Promoter
Score®
Self-assessed
propensity to
recommend
Self-assessed
propensity to
recommend
‘Real’ loyalty‘Real’ loyalty
Referrals
Rpt purchases
Price insensitivity
Referrals
Rpt purchases
Price insensitivity
Future growth
(Bus. success)
Future growth
(Bus. success)
Only partial
contribution
Not always
applicable
Unreliable
measure
Volatility and
obscurity
Numerous
contributing factors
... but collect actionable data as well
Non-survey / telemetry measures
Customer Satisfaction (CSAT)
Phrase questions carefully
How satisfied were you with X to help you achieve Y?
What do you like about X and where do you think we could do better?
Some best practice tips
Don’t focus on a single number
Mean, median, mode, SD, % Satisfied, % Unsatisfied
Align with goals to determine your ‘north star’
Treasure verbatims and analyse them
Try to understand why

More Related Content

PDF
Everything You Need To Know About The Employee Net Promoter Score
PDF
How to Measure Customer Loyalty with Net Promoter Score in Salesforce
PDF
What is the Customer Effort Score (CES)?
PDF
How to run a perfect Net Promoter Score campaign [Webinar]
PDF
Net Promoter Score PowerPoint Presentation Slides
PDF
AskNicely - more valuable customers with NPS
PDF
How to Close Customer Feedback with NPS®?
PPTX
Nps Romania Benchmark Study
Everything You Need To Know About The Employee Net Promoter Score
How to Measure Customer Loyalty with Net Promoter Score in Salesforce
What is the Customer Effort Score (CES)?
How to run a perfect Net Promoter Score campaign [Webinar]
Net Promoter Score PowerPoint Presentation Slides
AskNicely - more valuable customers with NPS
How to Close Customer Feedback with NPS®?
Nps Romania Benchmark Study

What's hot (19)

PPT
Nps building guest loyalty
PPTX
Net Promoter Score presentation
PPSX
10 Things to Know about Net Promoter ScoresPRES
PPTX
How Customer Feedback (and The Net Promoter Score) Can Bring "Gold" To Your B...
PPTX
CustomerGauge B2b Net Promoter Score Measurement
PDF
The 1-2-3 of the Net Promoter System
PPTX
Net Promoter Score
PDF
2015_Using-NPS-Successfully
PPT
Customer Service
PDF
Nilfisk – Net Promoter Score® Experience
PDF
PPT
Dr Robert East: Net Promoter Score - is there a better alternative?
PDF
How to Measure Net Promoter Score (NPS)
PDF
Advantages & disadvantages of nps
PPTX
Net Promoter Score
PPTX
Ensure Customer Success with Voice of the Customer
PDF
Oh, It Ain't My Fault: Building Successful Marketing Relationships
PPT
Faster, Better, Consolidated Progress: How to Capture Employee Wisdom through...
PDF
The Online Suggestion Box: A Robust Tool for Customers and Employees
Nps building guest loyalty
Net Promoter Score presentation
10 Things to Know about Net Promoter ScoresPRES
How Customer Feedback (and The Net Promoter Score) Can Bring "Gold" To Your B...
CustomerGauge B2b Net Promoter Score Measurement
The 1-2-3 of the Net Promoter System
Net Promoter Score
2015_Using-NPS-Successfully
Customer Service
Nilfisk – Net Promoter Score® Experience
Dr Robert East: Net Promoter Score - is there a better alternative?
How to Measure Net Promoter Score (NPS)
Advantages & disadvantages of nps
Net Promoter Score
Ensure Customer Success with Voice of the Customer
Oh, It Ain't My Fault: Building Successful Marketing Relationships
Faster, Better, Consolidated Progress: How to Capture Employee Wisdom through...
The Online Suggestion Box: A Robust Tool for Customers and Employees
Ad

Similar to NPS (Net Promoter Score) - Science or Pseudoscience (20)

PPTX
Oh God, Not Another Survey: Building Extraordinary Teams and Improving Processes
PPT
1224691062 kotler mm_13e_basic_05
PPT
1224691062 kotler mm_13e_basic_05
PDF
Integrated communications dashboards june 2018
PPTX
So you want to be customer centric?
DOCX
P l e a s e n o t e t h a t g ra y a re a s re f l e c t .docx
PPT
Doing Business in Hard Times
PPTX
So you want to be customer centric?
PDF
Msms2015 adopting holistic customer insight public
PPSX
Doing Business In Hard Times
PPT
TechBA roadshow 2008 V3
PDF
Measuring Donor Loyalty: Key Reasons Why Net Promoter Score (NPS) Is Not The Way
PPTX
B2B Value - Your salespeople are leaving money on the table
PPT
Importance Of Being Competitive
PDF
An introduction to NPS - Net Promoter Score
PDF
The Challenger ™ Sale – How to take control of the sales process
PPT
Brand loyalty management
PDF
Handout Do Your Own Market Research
PPTX
Ayat Shukairy (Co-Founder, Invesp) - Why "Customer First" Fails, And What To ...
PPTX
Market probe barcelona presentation
Oh God, Not Another Survey: Building Extraordinary Teams and Improving Processes
1224691062 kotler mm_13e_basic_05
1224691062 kotler mm_13e_basic_05
Integrated communications dashboards june 2018
So you want to be customer centric?
P l e a s e n o t e t h a t g ra y a re a s re f l e c t .docx
Doing Business in Hard Times
So you want to be customer centric?
Msms2015 adopting holistic customer insight public
Doing Business In Hard Times
TechBA roadshow 2008 V3
Measuring Donor Loyalty: Key Reasons Why Net Promoter Score (NPS) Is Not The Way
B2B Value - Your salespeople are leaving money on the table
Importance Of Being Competitive
An introduction to NPS - Net Promoter Score
The Challenger ™ Sale – How to take control of the sales process
Brand loyalty management
Handout Do Your Own Market Research
Ayat Shukairy (Co-Founder, Invesp) - Why "Customer First" Fails, And What To ...
Market probe barcelona presentation
Ad

More from Product Anonymous (20)

PDF
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
PDF
Helping Product Teams Do Product - Product Anonymous
PDF
Making Retention Fun - How Games Get Players Coming Back For More.pdf
PDF
Product-Led In Practice
PDF
Product Anonymous - Level Up with a Bespoke Product Management Capability Fra...
PDF
Moving into product leadership
PDF
Products don’t last forever by Ana Rowe
PPTX
Product Led Transformation - Steve Bauer
PPTX
Stakeholder engagement - Eadaoin Doherty
PPTX
Borrowing from Wardley: how PM's can leverage this tool - Craig Brown
PDF
Managing folk in a workshop - Nosh Dabari
PDF
Product manager interview tips - Jen Leibhart
PDF
How to design powerful experiments - Ying Zhang
PDF
Learnings from a lockdown hobby - Ambily Menon
PPTX
Customer feedback: practical advice
PDF
Using Continuous Discovery IRL
PDF
How to overcome floccinaucinihilipilification
PPTX
Prioritisation: the ultimate hamster wheel
PPTX
Product Anon - Marketing does USP's part II
PPTX
Product Anon - Marketing does USPs part I
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
Helping Product Teams Do Product - Product Anonymous
Making Retention Fun - How Games Get Players Coming Back For More.pdf
Product-Led In Practice
Product Anonymous - Level Up with a Bespoke Product Management Capability Fra...
Moving into product leadership
Products don’t last forever by Ana Rowe
Product Led Transformation - Steve Bauer
Stakeholder engagement - Eadaoin Doherty
Borrowing from Wardley: how PM's can leverage this tool - Craig Brown
Managing folk in a workshop - Nosh Dabari
Product manager interview tips - Jen Leibhart
How to design powerful experiments - Ying Zhang
Learnings from a lockdown hobby - Ambily Menon
Customer feedback: practical advice
Using Continuous Discovery IRL
How to overcome floccinaucinihilipilification
Prioritisation: the ultimate hamster wheel
Product Anon - Marketing does USP's part II
Product Anon - Marketing does USPs part I

Recently uploaded (20)

PPTX
MYSQL Presentation for SQL database connectivity
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
PPTX
Spectroscopy.pptx food analysis technology
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Electronic commerce courselecture one. Pdf
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Encapsulation theory and applications.pdf
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Empathic Computing: Creating Shared Understanding
MYSQL Presentation for SQL database connectivity
Diabetes mellitus diagnosis method based random forest with bat algorithm
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Digital-Transformation-Roadmap-for-Companies.pptx
Video forgery: An extensive analysis of inter-and intra-frame manipulation al...
Spectroscopy.pptx food analysis technology
Spectral efficient network and resource selection model in 5G networks
Electronic commerce courselecture one. Pdf
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Encapsulation theory and applications.pdf
Group 1 Presentation -Planning and Decision Making .pptx
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
NewMind AI Weekly Chronicles - August'25-Week II
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Assigned Numbers - 2025 - Bluetooth® Document
Encapsulation_ Review paper, used for researhc scholars
Dropbox Q2 2025 Financial Results & Investor Presentation
Per capita expenditure prediction using model stacking based on satellite ima...
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Empathic Computing: Creating Shared Understanding

NPS (Net Promoter Score) - Science or Pseudoscience

  • 1. Net Promoter Score®: Science or Pseudoscience? Daniel Kinal - @dktpm Product Anonymous – Sep 2019
  • 2. How Loyalty Leads to Business Success Deliver Great Products/Experiences ↑ Trial and adoption ↓ Customer Acq’n Cost ↑ Customer Referral ↑ Customer Loyalty More customers ↑ Customer Retention ↑ Repeat Purchases ↑ Cust. Lifetime Value ↓ Price Elasticity ↑ Prices & GP Make more $ Spend less $
  • 3. That Question Again How likely is it that you would recommend [Company X] to a friend or colleague? 0 1 2 3 4 5 6 7 8 9 10 Not at all likely Extremely likelyNeutral Detractors Passives Promoters
  • 4. And some other reasons it’s not great science 1/2 “Simply irrelevant” in some industries* Not predictive in monopoly or near-monopoly conditions* Data analysed was historical, not future. Unconvincing replication studies† * Fred Reichheld, HBR, 2003 † See Jeff Sauro’s study, 2018
  • 5. And some other reasons it’s not great science 2/2 Highly volatile measure Obscures critical information
  • 6. Some compelling qualities of the NPS Cheap Fast Simple Accepted
  • 7. How to make NPS as valuable as possible Measure brand or “full product experience” rather than feature or interaction Measure longitudinally and conduct trend rather than point-in-time analysis Keep it as scientific as you can (randomisation, third-party research) Compare your NPS to direct competitors Remember what you are measuring (loyalty and propensity to evangelise, not product satisfaction) Analyse qualitative feedback and NPS makeup
  • 8. But... ask yourself and your stakeholders: Is loyalty a significant contributor to our product’s success? Is word of mouth important? Are friends/colleagues going to be key influencers or customers? Is repeat purchase important? Will loyalty reduce price elasticity?
  • 9. Think about what NPS really means for your product It is always going to be a proxy measure. Is it even a proxy for something you care about (pdt/mkt fit)? Does the loyalty model even hold true for your products? Number of degrees of separation from what you actually care about? Net Promoter Score® Net Promoter Score® Self-assessed propensity to recommend Self-assessed propensity to recommend ‘Real’ loyalty‘Real’ loyalty Referrals Rpt purchases Price insensitivity Referrals Rpt purchases Price insensitivity Future growth (Bus. success) Future growth (Bus. success) Only partial contribution Not always applicable Unreliable measure Volatility and obscurity Numerous contributing factors
  • 10. ... but collect actionable data as well Non-survey / telemetry measures Customer Satisfaction (CSAT) Phrase questions carefully How satisfied were you with X to help you achieve Y? What do you like about X and where do you think we could do better?
  • 11. Some best practice tips Don’t focus on a single number Mean, median, mode, SD, % Satisfied, % Unsatisfied Align with goals to determine your ‘north star’ Treasure verbatims and analyse them Try to understand why