SlideShare a Scribd company logo
What Users Want: How and Why to Build
Knowledge into Your Product
Nils Davis Hannah Flynn
With: Moderated by:
TO USE YOUR COMPUTER'S AUDIO:
When the webinar begins, you will be connected to audio
using your computer's microphone and speakers (VoIP). A
headset is recommended.
Webinar will begin:
11:00 am, PST
TO USE YOUR TELEPHONE:
If you prefer to use your phone, you must select "Use
Telephone" after joining the webinar and call in using the
numbers below.
United States: +1 (562) 247-8321
Access Code: 893-828-629
Audio PIN: Shown after joining the webinar
--OR--
Revulytics gives any software producers deep and actionable insight into
who is using their software products and how they are being used, and the
out-of-box analytics that enable them to grow incremental revenue, convert
and retain customers, and make decisions about licensing and cloud
transformation strategies.
Click on the Questions panel to
interact with the presenters
www.productmanagementtoday.com/webinar-series/analytics-in-action
www.projectmanagementupdate.com/webinar-series/analytics-in-action
www.businessinnovationbrief.com/webinar-series/analytics-in-action
About Nils Davis
I think I was born to be a product manager. I like to have my fingers in everything, and I love working with people
and teams to help them achieve great things. I started doing enterprise software product management in that long
ago time when there were no classes or books on PM. I always wished I had the “secret” handbook about product
management to help me get over the humps. Instead, I was lucky to work with excellent mentors across my career,
who taught me about finding marketing problems, driving the creation of solutions, and taking the solutions to
market effectively. In my new book, The Secret Product Management Handbook, I’ve shared a lot of what I learned
on how best to achieve this.
About Hannah Flynn
Hannah went to The University of Chicago, where she majored in Environmental Studies with a concentration in
Economics and Policy. She now works with Aggregage on social media strategy and webinar production on sites such
as Product Management Today, B2B Marketing Zone, and Customer Experience Update.
5
• The actual baseball glove used by
Yasiel Puig, the Dodgers’ great
outfielder
• You can buy it from Wilson for $360
• Why would you buy a glove
endorsed by a baseball celebrity?
What Is This?
6
Agenda
• What do people want?
• How we can help them get it?
• The role of analytics
7
Poll: What do you
find most
challenging?
8
• We need whatever edge we can get
• And using our hero’s equipment,
maybe it gives us that edge
• But seriously – Puig chose that glove
and uses it
• It must be OK
• “No one ever got fired for buying IBM”
Become A Little More
Like Your Hero
9
• Do I know enough?
• Can I do it?
• Will I understand it?
• Is this the right choice?
• How complicated is it?
• What do I do next?
We’re All Worried
10
• Why do I have to do this?
• Not this again
• Oh, that’s annoying
• Don’t screw it up this time, ok
computer?
• Why doesn’t it just…?
And We Have Better Stuff
To Do With Our Time
11
• Good products take care of their
users
• Good products don’t require users to be
experts
• Users want us to be the experts
• Good products make things easy
• Good products reduce our perception of
risk
• Good products embody knowledge, not just
capabilities
Good Products Address
Our Fears and
Frustrations
12
• Take yourself back to
2010…
• Every iPhone photo app
was…
• A bunch of sliders
• Easy to mess up, best for
experts
• Then came Instagram
• No sliders
• Pre-made professional,
expert filters
• Your photos always looked
great!
What Does
This Look Like?
13
Why Does
This Work?
Time For Some Math!
14
𝑉 ≫ 𝑃 + 𝑅 + 𝐶 + 𝑂
• V is the value customer gets when their problem is solved
• P is the price – how much they pay you
• R is a risk factor – (their perception of) how likely the solution is to fail
• C is the change management cost of migrating from status quo to your solution
• O is the opportunity cost of solving this problem versus some other problem
The Value Inequality
14
15
In Pictures
15
Price Risk Change
Mgmt
Opportunity
Cost
Not Enough
Value
16
• Make V (value) bigger
• Reduce R (risk)
• Reduce C (change management)
• Make sure you’re not competing with O (opportunity cost)
How To Make P (Price) Bigger
16
17
Knowledge Increases Value
And Reduces Both Risk And
Change Management
18
In Pictures
The Secret Product Manager Handbook 18
Price Risk Change
Mgmt
Opportunity
Cost
Excellent
Value
19
Poll: Do you see an
opportunity to build
knowledge (or additional
knowledge) in your
product?
20
Where Can
You Add
Knowledge?
• Opportunities abound, even
in well-covered spaces, like
• Photo management
• Email management
• Project management
20
21
• What do normal people (struggle
to) do now with your app?
• What do experts do?
• Think small
• You can differentiate with a very small
amount of knowledge
• Get out of “spreadsheet thinking”
Opportunities To Add
Knowledge
21
22
• All photo apps added filters
• No longer a differentiator
• Instagram barely even has them anymore
What Worked Before Won’t
Work Now
23
The Analytics
of Knowledge
Tying It Together
24
The Analytics Of
Knowledge
• How do you measure how
“knowledge” is being used?
• How do you measure the
value of Bryce Harper’s
signature on your glove?
24
25
• Sometimes the most important feature
isn’t used much
• BMW’s performance features
• Accept 360 strategies and analytical
prioritization
• Instagram filters
Important For Sales? Yes
26
• What if you want customers to use the
feature?
• Instagram filters
• Should Instagram try to increase usage of
filters?
• Are Instagram filters still important?
• Accept360 example
• Understand circumstances
• What’s most important from customer’s
perspective?
Important For Sales? Yes
Important For Usage?
27
• What do I think will happen?
• What if I don’t find that?
• If I do find it, what does it mean?
• Was my hypothesis right?
• If I don’t find it, what does it mean?
• Lean Startup
• p = 0.05 still means 5% of tests will have a false result
“Scientific Method” – You Need A Hypothesis
27
28
• Rule 1: Data does not tell a story
• Rule 2: Use data to support your story
• Rule 3: 10% is not interesting. 20% is not interesting. 100% is moderately
interesting. 10x is very interesting.
• NetIQ example: 20% uptime improvement == 100x downtime reduction
• (80% uptime  99.9% = 20%; 20% downtime  < 0.2% = 10,000% = 100x
• Rule 4: Personal wins and unexpected (positive) outcomes are very
interesting
How To Use Data To Tell Your Product’s Story
28
29
• “What’s Measured Improves” – famous, and misunderstood, Peter Drucker quote
• Example of CompStat, the NYC crime tracking app
• Check out the “Crime Machine” episodes (#127 and #128) of the Reply All podcast
• Many technology shops and enterprises have been brought low by measuring the
wrong thing
• Harder to do with usage metrics
• But easy to measure things that don’t matter
What Happens If You Measure (and Incentivize)
The Wrong Thing?
29
30
• The Secret Product Manager Handbook, available on Amazon in paperback
and Kindle
• Or secretpmhandbook.com
• YouTube
• http://www.youtube.com/c/TheSecretProductManagerHandbook
• Twitter: nilsie
• Blog: secretpmhandbook.com/blog
More From Me
Q&A
Hannah Flynn
With: Moderated by:
Principal, NPD Associates
Linkedin page: linkedin.com/in/nilsdavis/
Twitter ID: @nilsie
Website: secretpmhandbook.com
Nils Davis
Site editor, Product Management Today
Linkedin page: linkedin.com/in/hannahmflynn
Twitter ID: @prodmgmttoday
Email: hannah@aggregage.com
Website: productmanagementtoday.com
www.productmanagementtoday.com/webinar-series/analytics-in-action
www.projectmanagementupdate.com/webinar-series/analytics-in-action
www.businessinnovationbrief.com/webinar-series/analytics-in-action

More Related Content

PDF
Data-driven product management
PDF
Product Anti-pattern: Becoming Better Product Manager
PDF
Testing Your MVP
PPTX
Intro to Product Management
PPTX
Mentlo Berkeley 2015
PDF
Conversion Optimization with Peep Laja
PDF
The 1 Week Minimum Viable Product (MVP)
PDF
What is Product Management?
Data-driven product management
Product Anti-pattern: Becoming Better Product Manager
Testing Your MVP
Intro to Product Management
Mentlo Berkeley 2015
Conversion Optimization with Peep Laja
The 1 Week Minimum Viable Product (MVP)
What is Product Management?

What's hot (13)

PDF
How to Solve any Problems?
PPTX
Agile product development
PDF
Shannon Kelly: #MOC with VWO
 
PDF
Product Management 101 for Data and Analytics
PDF
Lean startup workshop: practical ways to turn your idea into a successful pro...
PDF
Optimize Everything : A framework for solving your BIGGEST Problems Through O...
PPTX
Minimum Viable Product
PDF
Product Thinking
PDF
Opticon SF - Customer Innovation Showcase
PPTX
UX Analytics and Experimentation for eCommerce Growth
 
PDF
What does the Business need from DevOps?
PDF
Startup Glossary - Exec I/O
PDF
MVP - What is Minimum Viable Product really
How to Solve any Problems?
Agile product development
Shannon Kelly: #MOC with VWO
 
Product Management 101 for Data and Analytics
Lean startup workshop: practical ways to turn your idea into a successful pro...
Optimize Everything : A framework for solving your BIGGEST Problems Through O...
Minimum Viable Product
Product Thinking
Opticon SF - Customer Innovation Showcase
UX Analytics and Experimentation for eCommerce Growth
 
What does the Business need from DevOps?
Startup Glossary - Exec I/O
MVP - What is Minimum Viable Product really
Ad

Similar to Analytics in Action: What Users Want: How and Why to Build Knowledge into Your Product (20)

KEY
Be a Great Product Leader (HBS ICE 2012)
PDF
Product Manager / Owner scrum-po_agile30_oct28_Workshop
PDF
Product Management 101
PDF
The Product Growth Engine
PDF
Be A Great Product Leader (Carvana 2018)
PDF
Power of the Platform: A PM's Path to a Winning Product Experience
PDF
BoSON23 | Jim Morris | Designing and Running Customer Interviews that Work
PDF
Nine Novel Tactics for Software Product Managment in the New Digital Age
PDF
Innovation Incorporated 2018
PDF
insurjio_the_product_folks.pdf
PDF
Product Management Management
PDF
Product Management Guide - A Work In Progress
PPTX
Product manager jyoti
PDF
Building the RIGHT PRODUCT for the RIGHT CUSTOMER - ProductCamp LA 2014
PPTX
Overcoming the Barriers To Building Great Products
PDF
Empowering Product Teams: Leverage Your Organization for Best Product Decisions
PDF
Empowering Product Teams: Leverage Your Organization for Best Product Decisions
PPTX
7 myths of business innovation
DOCX
information need for paperWhy Is This ImportantProduc.docx
PDF
Deliver Awesome Product Experiences
Be a Great Product Leader (HBS ICE 2012)
Product Manager / Owner scrum-po_agile30_oct28_Workshop
Product Management 101
The Product Growth Engine
Be A Great Product Leader (Carvana 2018)
Power of the Platform: A PM's Path to a Winning Product Experience
BoSON23 | Jim Morris | Designing and Running Customer Interviews that Work
Nine Novel Tactics for Software Product Managment in the New Digital Age
Innovation Incorporated 2018
insurjio_the_product_folks.pdf
Product Management Management
Product Management Guide - A Work In Progress
Product manager jyoti
Building the RIGHT PRODUCT for the RIGHT CUSTOMER - ProductCamp LA 2014
Overcoming the Barriers To Building Great Products
Empowering Product Teams: Leverage Your Organization for Best Product Decisions
Empowering Product Teams: Leverage Your Organization for Best Product Decisions
7 myths of business innovation
information need for paperWhy Is This ImportantProduc.docx
Deliver Awesome Product Experiences
Ad

More from Aggregage (20)

PDF
Staying Ahead of UFLPA Enforcement: Best Practices for Retail Supply Chains
PDF
Making the Moment: The Art of Creating Events That Drive Results
PDF
Maximizing Profit And Productivity: The New Era Of AI-Powered Accounting
PPTX
From Rigid To Resilient: Why Enterprises Need Modular Commerce Now
PDF
How to Achieve High-Accuracy Results When Using LLMs
PDF
AI for Paralegals: Everything You Need to Know (and How to Use It Safely)
PPTX
Beyond the Blast: How to Pitch with Purpose and Build Lasting Media Relations...
PDF
Next-Level Fraud Prevention: Strategies for Today’s Threat Landscape
PDF
Cash Flow Secrets Every Upskilled CPA Should Know
PDF
The Great Disruption: Leveraging AI To Better Your Benefits Strategy
PDF
AI in Marketing & Sales: Today’s Tools, Tomorrow’s Potential
PDF
Navigating Payroll Compliance: Future-Proofing Payroll in an Evolving Regulat...
PDF
AP Automation: The Competitive Advantage Your Business Needs
PPTX
Campaigns that Click: Practical Personalization Strategies to Boost ROI
PDF
The Constructor's Digital Transformation Playbook: Reducing Risk With Technology
PDF
The Future Of Finance: How To Manage Spend The Right Way
PDF
The Evolving Retailers Fulfillment Strategy: Meeting Demands with Agility
PDF
The New Way CPAs are Delivering Value: Aligning Automation with Client Success
PDF
The 2nd Generation of Innovation Management: A Survival Guide
PPTX
Case Closed: How to Optimize Your Legal Intake Process for Efficiency
Staying Ahead of UFLPA Enforcement: Best Practices for Retail Supply Chains
Making the Moment: The Art of Creating Events That Drive Results
Maximizing Profit And Productivity: The New Era Of AI-Powered Accounting
From Rigid To Resilient: Why Enterprises Need Modular Commerce Now
How to Achieve High-Accuracy Results When Using LLMs
AI for Paralegals: Everything You Need to Know (and How to Use It Safely)
Beyond the Blast: How to Pitch with Purpose and Build Lasting Media Relations...
Next-Level Fraud Prevention: Strategies for Today’s Threat Landscape
Cash Flow Secrets Every Upskilled CPA Should Know
The Great Disruption: Leveraging AI To Better Your Benefits Strategy
AI in Marketing & Sales: Today’s Tools, Tomorrow’s Potential
Navigating Payroll Compliance: Future-Proofing Payroll in an Evolving Regulat...
AP Automation: The Competitive Advantage Your Business Needs
Campaigns that Click: Practical Personalization Strategies to Boost ROI
The Constructor's Digital Transformation Playbook: Reducing Risk With Technology
The Future Of Finance: How To Manage Spend The Right Way
The Evolving Retailers Fulfillment Strategy: Meeting Demands with Agility
The New Way CPAs are Delivering Value: Aligning Automation with Client Success
The 2nd Generation of Innovation Management: A Survival Guide
Case Closed: How to Optimize Your Legal Intake Process for Efficiency

Recently uploaded (20)

PDF
Lecture1 pattern recognition............
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
Qualitative Qantitative and Mixed Methods.pptx
PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PDF
annual-report-2024-2025 original latest.
PPTX
Computer network topology notes for revision
PPTX
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPT
ISS -ESG Data flows What is ESG and HowHow
PPTX
Business Acumen Training GuidePresentation.pptx
PPTX
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PPTX
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PPT
Quality review (1)_presentation of this 21
PDF
Business Analytics and business intelligence.pdf
PPTX
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
PPTX
1_Introduction to advance data techniques.pptx
Lecture1 pattern recognition............
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
Qualitative Qantitative and Mixed Methods.pptx
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
annual-report-2024-2025 original latest.
Computer network topology notes for revision
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
Data_Analytics_and_PowerBI_Presentation.pptx
ISS -ESG Data flows What is ESG and HowHow
Business Acumen Training GuidePresentation.pptx
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
Quality review (1)_presentation of this 21
Business Analytics and business intelligence.pdf
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
1_Introduction to advance data techniques.pptx

Analytics in Action: What Users Want: How and Why to Build Knowledge into Your Product

  • 1. What Users Want: How and Why to Build Knowledge into Your Product Nils Davis Hannah Flynn With: Moderated by: TO USE YOUR COMPUTER'S AUDIO: When the webinar begins, you will be connected to audio using your computer's microphone and speakers (VoIP). A headset is recommended. Webinar will begin: 11:00 am, PST TO USE YOUR TELEPHONE: If you prefer to use your phone, you must select "Use Telephone" after joining the webinar and call in using the numbers below. United States: +1 (562) 247-8321 Access Code: 893-828-629 Audio PIN: Shown after joining the webinar --OR--
  • 2. Revulytics gives any software producers deep and actionable insight into who is using their software products and how they are being used, and the out-of-box analytics that enable them to grow incremental revenue, convert and retain customers, and make decisions about licensing and cloud transformation strategies.
  • 3. Click on the Questions panel to interact with the presenters www.productmanagementtoday.com/webinar-series/analytics-in-action www.projectmanagementupdate.com/webinar-series/analytics-in-action www.businessinnovationbrief.com/webinar-series/analytics-in-action
  • 4. About Nils Davis I think I was born to be a product manager. I like to have my fingers in everything, and I love working with people and teams to help them achieve great things. I started doing enterprise software product management in that long ago time when there were no classes or books on PM. I always wished I had the “secret” handbook about product management to help me get over the humps. Instead, I was lucky to work with excellent mentors across my career, who taught me about finding marketing problems, driving the creation of solutions, and taking the solutions to market effectively. In my new book, The Secret Product Management Handbook, I’ve shared a lot of what I learned on how best to achieve this. About Hannah Flynn Hannah went to The University of Chicago, where she majored in Environmental Studies with a concentration in Economics and Policy. She now works with Aggregage on social media strategy and webinar production on sites such as Product Management Today, B2B Marketing Zone, and Customer Experience Update.
  • 5. 5 • The actual baseball glove used by Yasiel Puig, the Dodgers’ great outfielder • You can buy it from Wilson for $360 • Why would you buy a glove endorsed by a baseball celebrity? What Is This?
  • 6. 6 Agenda • What do people want? • How we can help them get it? • The role of analytics
  • 7. 7 Poll: What do you find most challenging?
  • 8. 8 • We need whatever edge we can get • And using our hero’s equipment, maybe it gives us that edge • But seriously – Puig chose that glove and uses it • It must be OK • “No one ever got fired for buying IBM” Become A Little More Like Your Hero
  • 9. 9 • Do I know enough? • Can I do it? • Will I understand it? • Is this the right choice? • How complicated is it? • What do I do next? We’re All Worried
  • 10. 10 • Why do I have to do this? • Not this again • Oh, that’s annoying • Don’t screw it up this time, ok computer? • Why doesn’t it just…? And We Have Better Stuff To Do With Our Time
  • 11. 11 • Good products take care of their users • Good products don’t require users to be experts • Users want us to be the experts • Good products make things easy • Good products reduce our perception of risk • Good products embody knowledge, not just capabilities Good Products Address Our Fears and Frustrations
  • 12. 12 • Take yourself back to 2010… • Every iPhone photo app was… • A bunch of sliders • Easy to mess up, best for experts • Then came Instagram • No sliders • Pre-made professional, expert filters • Your photos always looked great! What Does This Look Like?
  • 13. 13 Why Does This Work? Time For Some Math!
  • 14. 14 𝑉 ≫ 𝑃 + 𝑅 + 𝐶 + 𝑂 • V is the value customer gets when their problem is solved • P is the price – how much they pay you • R is a risk factor – (their perception of) how likely the solution is to fail • C is the change management cost of migrating from status quo to your solution • O is the opportunity cost of solving this problem versus some other problem The Value Inequality 14
  • 15. 15 In Pictures 15 Price Risk Change Mgmt Opportunity Cost Not Enough Value
  • 16. 16 • Make V (value) bigger • Reduce R (risk) • Reduce C (change management) • Make sure you’re not competing with O (opportunity cost) How To Make P (Price) Bigger 16
  • 17. 17 Knowledge Increases Value And Reduces Both Risk And Change Management
  • 18. 18 In Pictures The Secret Product Manager Handbook 18 Price Risk Change Mgmt Opportunity Cost Excellent Value
  • 19. 19 Poll: Do you see an opportunity to build knowledge (or additional knowledge) in your product?
  • 20. 20 Where Can You Add Knowledge? • Opportunities abound, even in well-covered spaces, like • Photo management • Email management • Project management 20
  • 21. 21 • What do normal people (struggle to) do now with your app? • What do experts do? • Think small • You can differentiate with a very small amount of knowledge • Get out of “spreadsheet thinking” Opportunities To Add Knowledge 21
  • 22. 22 • All photo apps added filters • No longer a differentiator • Instagram barely even has them anymore What Worked Before Won’t Work Now
  • 24. 24 The Analytics Of Knowledge • How do you measure how “knowledge” is being used? • How do you measure the value of Bryce Harper’s signature on your glove? 24
  • 25. 25 • Sometimes the most important feature isn’t used much • BMW’s performance features • Accept 360 strategies and analytical prioritization • Instagram filters Important For Sales? Yes
  • 26. 26 • What if you want customers to use the feature? • Instagram filters • Should Instagram try to increase usage of filters? • Are Instagram filters still important? • Accept360 example • Understand circumstances • What’s most important from customer’s perspective? Important For Sales? Yes Important For Usage?
  • 27. 27 • What do I think will happen? • What if I don’t find that? • If I do find it, what does it mean? • Was my hypothesis right? • If I don’t find it, what does it mean? • Lean Startup • p = 0.05 still means 5% of tests will have a false result “Scientific Method” – You Need A Hypothesis 27
  • 28. 28 • Rule 1: Data does not tell a story • Rule 2: Use data to support your story • Rule 3: 10% is not interesting. 20% is not interesting. 100% is moderately interesting. 10x is very interesting. • NetIQ example: 20% uptime improvement == 100x downtime reduction • (80% uptime  99.9% = 20%; 20% downtime  < 0.2% = 10,000% = 100x • Rule 4: Personal wins and unexpected (positive) outcomes are very interesting How To Use Data To Tell Your Product’s Story 28
  • 29. 29 • “What’s Measured Improves” – famous, and misunderstood, Peter Drucker quote • Example of CompStat, the NYC crime tracking app • Check out the “Crime Machine” episodes (#127 and #128) of the Reply All podcast • Many technology shops and enterprises have been brought low by measuring the wrong thing • Harder to do with usage metrics • But easy to measure things that don’t matter What Happens If You Measure (and Incentivize) The Wrong Thing? 29
  • 30. 30 • The Secret Product Manager Handbook, available on Amazon in paperback and Kindle • Or secretpmhandbook.com • YouTube • http://www.youtube.com/c/TheSecretProductManagerHandbook • Twitter: nilsie • Blog: secretpmhandbook.com/blog More From Me
  • 31. Q&A Hannah Flynn With: Moderated by: Principal, NPD Associates Linkedin page: linkedin.com/in/nilsdavis/ Twitter ID: @nilsie Website: secretpmhandbook.com Nils Davis Site editor, Product Management Today Linkedin page: linkedin.com/in/hannahmflynn Twitter ID: @prodmgmttoday Email: hannah@aggregage.com Website: productmanagementtoday.com www.productmanagementtoday.com/webinar-series/analytics-in-action www.projectmanagementupdate.com/webinar-series/analytics-in-action www.businessinnovationbrief.com/webinar-series/analytics-in-action