SlideShare a Scribd company logo
Rapid Experimentation at Every
Stage of Product Development
Tanya Koshy Brittany Shear
With: Moderated by:
TO USE YOUR COMPUTER'S AUDIO:
When the webinar begins, you will be connected to audio using
your computer's microphone and speakers (VoIP). A headset is
recommended.
Webinar will begin:
11:00 am, PST
TO USE YOUR TELEPHONE:
If you prefer to use your phone, you must select "Use Telephone"
after joining the webinar and call in using the numbers below.
United States: +1 (213) 929-4232
Access Code: 365-553-904
Audio PIN: Shown after joining the webinar
--OR--
Experiment Your Way to Product Success
Webinar Series
2
Experiment Your Way to Product Success
Webinar Series
Optimizely is the world’s leading experimentation platform, enabling
businesses to deliver continuous experimentation and personalization
across websites, mobile apps and connected devices. Optimizely
enables businesses to experiment deeply into their technology stack
and broadly across the entire customer experience. To learn more,
visit https://www.optimizely.com/
3
Experiment Your Way to Product Success
Webinar Series
Click on the Questions panel to
interact with the presenters
https://www.productmanagementtoday.com/webinar-s
eries/experiment-your-way-to-product-success/
4
Experiment Your Way to Product Success
Webinar Series
About Tanya Koshy
Tanya Koshy is the VP of Product at UserTesting, where she leads the product strategy and vison for
Usertesting's suite of products to build better solutions for testing products to improve user behavior.
Tanya helps product managers, designers and user researchers better understand their customers by
building tools that will connect businesses with their customers.
Tanya has worked with reputable software companies sucha as Facebook, Google, and Groupon,
among others. She holds an MBA from the Kellogg School of Management, and a BA from Stanford
University.
About Brittany Shear
Brittany went to Emmanuel College, where she majored in Writing, Editing, and Publishing and
minored in Marketing, Psychology, and Communications. She now works with Aggregage as an editor
and webinar host on sites including CTO Universe, Product Management Today, and Connected
Health Pulse.
Webinar Series
Rapid Experimentation at Every Stage
of Product Development
DEC 2019
6
Tanya Koshy
VP of Product, UserTesting
Tactics to build an understanding of your
customer
Fast
What You’ll Learn
Validate your ideas at every stage of
development. Don’t wait until launch!
8
Validate & experiment at every stage
Key Product Questions
Solution
What’s the best,
lightest solution I can
build for them?
Customer
Who is my
customer?
Problem
What is their
problem?
Why This Matters
● Minimizing time to customer value wins!
● Evidence based decisions win!
● Avoid the second-guessing, debating, & HIPPOs that plague / slow
down all PMs & Product Teams
I have an
idea for a
problem
area
I want to
learn more
about my
customers’
needs/pains
in this area
Do people
actually
have the
problem I
think they
have?
Are people
currently
unsatisfied
with their
experience
in this area?
How do
people solve
their
problem
today?
12
How often are you doing X?
Describe your most recent experience
doing X. What worked & what didn’t?
What made doing X easy?
Needs Discovery
Interview
Questions
What are their pain points doing
X? Great way to inspire new ideas
for products / features to build.
What made doing X frustrating/hard?
What did you use to do X?
How similar was your most recent
experience to how you typically do X?
How satisfied are you with X, in general? 1
= not at all, 5 = very
I have a better understanding of their overall experience and
their biggest needs/pain points.
Prioritization
Effort
Impact
Idea Idea Idea Idea
Idea Idea
Do people
understand the
purpose of the
solution? Do
they find it
valuable?
Does the
solution
actually solve
the problem?
Does it solve it
well?
16
Feature 1
1 - 2 sentence description
Feature 2
1 - 2 sentence description
Feature 3
1 - 2 sentence description
Template for Testing Product Ideas as a Landing Page
Your 1-Line Value Prop Here
17
Spend 1 - 2 mins reviewing the page, share
your thoughts out loud as you do.
What are your initial impressions?
In your own words, based on this page,
describe what this product does?
Great Interview
Questions
Going through the page section by section,
which one is most compelling to you? Why?
Which is least compelling to you? Why?
What must this product do, in addition to
anything you saw here, that would get you
to use it?
How likely would you be to use this
product?
We have a fine-tuned idea for a solution that customers find valuable.
Is the app easy
to use? What is
the first-time
user
experience
like? Is it
compelling?
What do we
need to
improve?
We have validated that our solution is usable and have
identified new areas for further improvement.
Tips for Maximum Efficiency
● Be transparent about key research questions, methodology, &
success/decision criteria before starting research.
● Then do the research & share the findings with your team &
stakeholders.
● Constantly reinforce an evidence-based approach to cut down on
second-guessing & debating.
● Timebox research activities to move fast. 1 - 2 weeks.
22
Experiment Your Way to Product Success
Webinar Series
Q&A
Brittany Shear
With: Moderated by:
Tanya Koshy
https://www.productmanagementtoday.com/webinar-series/exp
eriment-your-way-to-product-success/

More Related Content

PPTX
Product Marketing: Moving the Needle (ProductCamp Boston 2016)
PDF
The Future of Product Marketing
PDF
How HubSpot Launches Products - ProductCamp Boston
PDF
Roadmapping the Product Roadmap (ProductCamp Boston 2016)
PPTX
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
PPTX
How to Incubate and Launch Mobile-First Innovation to Increase Internal Effic...
PPT
An introduction to product development for book publishers
PDF
Mapping Human-Centric Product Vision (ProductCamp Boston 2016)
Product Marketing: Moving the Needle (ProductCamp Boston 2016)
The Future of Product Marketing
How HubSpot Launches Products - ProductCamp Boston
Roadmapping the Product Roadmap (ProductCamp Boston 2016)
Uncovering Need and Validating Ideas with UserTesting by Marieke McCloskey
How to Incubate and Launch Mobile-First Innovation to Increase Internal Effic...
An introduction to product development for book publishers
Mapping Human-Centric Product Vision (ProductCamp Boston 2016)

What's hot (11)

PDF
My recruit webinar user testing
PPTX
Product Management
PDF
Rapid prototyping and how to avoid building a product nobody wants
PDF
30-Day Google PM Interview Study Guide
PDF
Design Leadership at UXSEA Summit 2018
PDF
Mobile landscape in Bucharest & Mobile Academy courses
PPTX
Technology for speakers and trainers
PPT
User Experience and Product Management: Two Peas in the Same Pod?
PDF
Lets talk about user centered design
PDF
Personas: Where Product Meets User Needs
PPTX
7 tips on web development
My recruit webinar user testing
Product Management
Rapid prototyping and how to avoid building a product nobody wants
30-Day Google PM Interview Study Guide
Design Leadership at UXSEA Summit 2018
Mobile landscape in Bucharest & Mobile Academy courses
Technology for speakers and trainers
User Experience and Product Management: Two Peas in the Same Pod?
Lets talk about user centered design
Personas: Where Product Meets User Needs
7 tips on web development
Ad

Similar to Experiment Your Way to Product Success: Rapid Experimentation at Every Stage of Product Development (20)

PDF
The Product Growth Engine
PDF
Experiment Your Way to Product Success: The Science of High-Impact Experiment...
PDF
Setting the Customer's Journey: How to Take Action on Customer Discovery
PDF
How We Used Fast Customer Feedback to Build Product Insights - Michelle Huff...
PDF
Power of the Platform: A PM's Path to a Winning Product Experience
PPTX
Leveraging StoryVesting to Find Product-Market Fit
PDF
How to avoid 6 deadly mistakes when building a digital product 2018
PPTX
Agile product development
PDF
Know Your Users - Mini Workshop
PDF
Best Practices for Early Stage Product Development
PDF
Old Products, New Tricks: Driving Discovery and Experimentation in Your Organ...
PPTX
Old Products, New Tricks: Driving Discovery and Experimentation in Your Organ...
PDF
Setting the Customer's Journey: Organizing for Customer Centricity
PDF
PMI region globale - intro lean startup
PDF
PMI france lean startup for project management
PDF
UX Lead Product Management
PDF
What is Product Management ?
PPTX
Marketing, Branding & Planning
PDF
The Experimenter’s Guide to eCommerce Growth
 
PPTX
PDMA Event -- "User Experience: What's the Big Deal?" May 2014
The Product Growth Engine
Experiment Your Way to Product Success: The Science of High-Impact Experiment...
Setting the Customer's Journey: How to Take Action on Customer Discovery
How We Used Fast Customer Feedback to Build Product Insights - Michelle Huff...
Power of the Platform: A PM's Path to a Winning Product Experience
Leveraging StoryVesting to Find Product-Market Fit
How to avoid 6 deadly mistakes when building a digital product 2018
Agile product development
Know Your Users - Mini Workshop
Best Practices for Early Stage Product Development
Old Products, New Tricks: Driving Discovery and Experimentation in Your Organ...
Old Products, New Tricks: Driving Discovery and Experimentation in Your Organ...
Setting the Customer's Journey: Organizing for Customer Centricity
PMI region globale - intro lean startup
PMI france lean startup for project management
UX Lead Product Management
What is Product Management ?
Marketing, Branding & Planning
The Experimenter’s Guide to eCommerce Growth
 
PDMA Event -- "User Experience: What's the Big Deal?" May 2014
Ad

More from Aggregage (20)

PDF
Staying Ahead of UFLPA Enforcement: Best Practices for Retail Supply Chains
PDF
Making the Moment: The Art of Creating Events That Drive Results
PDF
Maximizing Profit And Productivity: The New Era Of AI-Powered Accounting
PPTX
From Rigid To Resilient: Why Enterprises Need Modular Commerce Now
PDF
How to Achieve High-Accuracy Results When Using LLMs
PDF
AI for Paralegals: Everything You Need to Know (and How to Use It Safely)
PPTX
Beyond the Blast: How to Pitch with Purpose and Build Lasting Media Relations...
PDF
Next-Level Fraud Prevention: Strategies for Today’s Threat Landscape
PDF
Cash Flow Secrets Every Upskilled CPA Should Know
PDF
The Great Disruption: Leveraging AI To Better Your Benefits Strategy
PDF
AI in Marketing & Sales: Today’s Tools, Tomorrow’s Potential
PDF
Navigating Payroll Compliance: Future-Proofing Payroll in an Evolving Regulat...
PDF
AP Automation: The Competitive Advantage Your Business Needs
PPTX
Campaigns that Click: Practical Personalization Strategies to Boost ROI
PDF
The Constructor's Digital Transformation Playbook: Reducing Risk With Technology
PDF
The Future Of Finance: How To Manage Spend The Right Way
PDF
The Evolving Retailers Fulfillment Strategy: Meeting Demands with Agility
PDF
The New Way CPAs are Delivering Value: Aligning Automation with Client Success
PDF
The 2nd Generation of Innovation Management: A Survival Guide
PPTX
Case Closed: How to Optimize Your Legal Intake Process for Efficiency
Staying Ahead of UFLPA Enforcement: Best Practices for Retail Supply Chains
Making the Moment: The Art of Creating Events That Drive Results
Maximizing Profit And Productivity: The New Era Of AI-Powered Accounting
From Rigid To Resilient: Why Enterprises Need Modular Commerce Now
How to Achieve High-Accuracy Results When Using LLMs
AI for Paralegals: Everything You Need to Know (and How to Use It Safely)
Beyond the Blast: How to Pitch with Purpose and Build Lasting Media Relations...
Next-Level Fraud Prevention: Strategies for Today’s Threat Landscape
Cash Flow Secrets Every Upskilled CPA Should Know
The Great Disruption: Leveraging AI To Better Your Benefits Strategy
AI in Marketing & Sales: Today’s Tools, Tomorrow’s Potential
Navigating Payroll Compliance: Future-Proofing Payroll in an Evolving Regulat...
AP Automation: The Competitive Advantage Your Business Needs
Campaigns that Click: Practical Personalization Strategies to Boost ROI
The Constructor's Digital Transformation Playbook: Reducing Risk With Technology
The Future Of Finance: How To Manage Spend The Right Way
The Evolving Retailers Fulfillment Strategy: Meeting Demands with Agility
The New Way CPAs are Delivering Value: Aligning Automation with Client Success
The 2nd Generation of Innovation Management: A Survival Guide
Case Closed: How to Optimize Your Legal Intake Process for Efficiency

Recently uploaded (20)

PPTX
Human resources management -job perception concept
PPTX
Mangeroal Finance for Strategic Management
PPTX
Strategic Plan 2023-2024 Presentation.pptx
PPTX
TCoE_IT_Concrete industry.why is it required
PDF
CISSP Domain 5: Identity and Access Management (IAM)
PDF
Organisational Behaviour And it's concepts
PPT
Claims and Adjustment Business_Communication.pptx.ppt
PPTX
Course Overview of the Course Titled.pptx
PPTX
Concluding Session_Wrapup-NA May 5 2024-Oct 10 2025 ZS.pptx
PPTX
Project Management Methods PERT-and-CPM.pptx
PPTX
Self-Awareness and Values Development presentation
PDF
Case study -Uber strategic plan and management
PPTX
BASIC H2S TRAINING for oil and gas industries
PPTX
Five S Training Program - Principles of 5S
PPTX
Empowering Project Management Through Servant Leadership - PMI UK.pptx
PDF
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
PDF
Leveraging Intangible Assets Through Campus Entrepreneurship and Tech Transfer
PPTX
Consulting on marketing-The needs wants and demands are a very important comp...
PDF
Equity at the Helm_ Guiding Schools Through Inclusive Leadership by Dr.pdf
PDF
MANAGEMENT LESSONS FROM ANCIENT KNOWLEDGE SYSTEM-ARTHASHASTRA AND THIRUKKURAL...
Human resources management -job perception concept
Mangeroal Finance for Strategic Management
Strategic Plan 2023-2024 Presentation.pptx
TCoE_IT_Concrete industry.why is it required
CISSP Domain 5: Identity and Access Management (IAM)
Organisational Behaviour And it's concepts
Claims and Adjustment Business_Communication.pptx.ppt
Course Overview of the Course Titled.pptx
Concluding Session_Wrapup-NA May 5 2024-Oct 10 2025 ZS.pptx
Project Management Methods PERT-and-CPM.pptx
Self-Awareness and Values Development presentation
Case study -Uber strategic plan and management
BASIC H2S TRAINING for oil and gas industries
Five S Training Program - Principles of 5S
Empowering Project Management Through Servant Leadership - PMI UK.pptx
CHAPTER 14 Manageement of Nursing Educational Institutions- planing and orga...
Leveraging Intangible Assets Through Campus Entrepreneurship and Tech Transfer
Consulting on marketing-The needs wants and demands are a very important comp...
Equity at the Helm_ Guiding Schools Through Inclusive Leadership by Dr.pdf
MANAGEMENT LESSONS FROM ANCIENT KNOWLEDGE SYSTEM-ARTHASHASTRA AND THIRUKKURAL...

Experiment Your Way to Product Success: Rapid Experimentation at Every Stage of Product Development

  • 1. Rapid Experimentation at Every Stage of Product Development Tanya Koshy Brittany Shear With: Moderated by: TO USE YOUR COMPUTER'S AUDIO: When the webinar begins, you will be connected to audio using your computer's microphone and speakers (VoIP). A headset is recommended. Webinar will begin: 11:00 am, PST TO USE YOUR TELEPHONE: If you prefer to use your phone, you must select "Use Telephone" after joining the webinar and call in using the numbers below. United States: +1 (213) 929-4232 Access Code: 365-553-904 Audio PIN: Shown after joining the webinar --OR-- Experiment Your Way to Product Success Webinar Series
  • 2. 2 Experiment Your Way to Product Success Webinar Series Optimizely is the world’s leading experimentation platform, enabling businesses to deliver continuous experimentation and personalization across websites, mobile apps and connected devices. Optimizely enables businesses to experiment deeply into their technology stack and broadly across the entire customer experience. To learn more, visit https://www.optimizely.com/
  • 3. 3 Experiment Your Way to Product Success Webinar Series Click on the Questions panel to interact with the presenters https://www.productmanagementtoday.com/webinar-s eries/experiment-your-way-to-product-success/
  • 4. 4 Experiment Your Way to Product Success Webinar Series About Tanya Koshy Tanya Koshy is the VP of Product at UserTesting, where she leads the product strategy and vison for Usertesting's suite of products to build better solutions for testing products to improve user behavior. Tanya helps product managers, designers and user researchers better understand their customers by building tools that will connect businesses with their customers. Tanya has worked with reputable software companies sucha as Facebook, Google, and Groupon, among others. She holds an MBA from the Kellogg School of Management, and a BA from Stanford University. About Brittany Shear Brittany went to Emmanuel College, where she majored in Writing, Editing, and Publishing and minored in Marketing, Psychology, and Communications. She now works with Aggregage as an editor and webinar host on sites including CTO Universe, Product Management Today, and Connected Health Pulse. Webinar Series
  • 5. Rapid Experimentation at Every Stage of Product Development DEC 2019
  • 6. 6 Tanya Koshy VP of Product, UserTesting
  • 7. Tactics to build an understanding of your customer Fast What You’ll Learn Validate your ideas at every stage of development. Don’t wait until launch!
  • 8. 8 Validate & experiment at every stage
  • 9. Key Product Questions Solution What’s the best, lightest solution I can build for them? Customer Who is my customer? Problem What is their problem?
  • 10. Why This Matters ● Minimizing time to customer value wins! ● Evidence based decisions win! ● Avoid the second-guessing, debating, & HIPPOs that plague / slow down all PMs & Product Teams
  • 11. I have an idea for a problem area I want to learn more about my customers’ needs/pains in this area Do people actually have the problem I think they have? Are people currently unsatisfied with their experience in this area? How do people solve their problem today?
  • 12. 12 How often are you doing X? Describe your most recent experience doing X. What worked & what didn’t? What made doing X easy? Needs Discovery Interview Questions What are their pain points doing X? Great way to inspire new ideas for products / features to build. What made doing X frustrating/hard? What did you use to do X? How similar was your most recent experience to how you typically do X? How satisfied are you with X, in general? 1 = not at all, 5 = very
  • 13. I have a better understanding of their overall experience and their biggest needs/pain points.
  • 15. Do people understand the purpose of the solution? Do they find it valuable? Does the solution actually solve the problem? Does it solve it well?
  • 16. 16 Feature 1 1 - 2 sentence description Feature 2 1 - 2 sentence description Feature 3 1 - 2 sentence description Template for Testing Product Ideas as a Landing Page Your 1-Line Value Prop Here
  • 17. 17 Spend 1 - 2 mins reviewing the page, share your thoughts out loud as you do. What are your initial impressions? In your own words, based on this page, describe what this product does? Great Interview Questions Going through the page section by section, which one is most compelling to you? Why? Which is least compelling to you? Why? What must this product do, in addition to anything you saw here, that would get you to use it? How likely would you be to use this product?
  • 18. We have a fine-tuned idea for a solution that customers find valuable.
  • 19. Is the app easy to use? What is the first-time user experience like? Is it compelling? What do we need to improve?
  • 20. We have validated that our solution is usable and have identified new areas for further improvement.
  • 21. Tips for Maximum Efficiency ● Be transparent about key research questions, methodology, & success/decision criteria before starting research. ● Then do the research & share the findings with your team & stakeholders. ● Constantly reinforce an evidence-based approach to cut down on second-guessing & debating. ● Timebox research activities to move fast. 1 - 2 weeks.
  • 22. 22 Experiment Your Way to Product Success Webinar Series Q&A Brittany Shear With: Moderated by: Tanya Koshy https://www.productmanagementtoday.com/webinar-series/exp eriment-your-way-to-product-success/