SlideShare a Scribd company logo
Thursday, May 28th, 2015
WE WILL BEGIN SHORTLY
questionpro.com | surveyanalytics.com
Learn How to Make Better Business Decisions
Conjoint Analysis Webinar : Will Begin Shortly….
Presenters
VIVEK BHASKARAN
Founder & CEO
SurveyAnalytics /
QuestionPro
ROB ASERON
Online Research Guru
(Former Director, Zynga)
NICO PERUZZI, Ph.D.
Partner
Outsource Research
Consulting
AGENDA
 What is Conjoint Analysis?
 How Gaming Giant, Zynga, Won
 Introducing an All-in-One Solution
 Questions and Answer Session
THE BASICS
Conjoint
Discrete Choice
Choice-Based ConjointDCM
CBC
Adaptive Conjoint
ACBC
ACA
Adaptive
Choice-Based
Conjoint
MaxDiff
MaxDiff
Scaling
MBC
Best-Worst
Scaling
Menu-Based
Choice
All these methods involve making trade-offs, and can be classified under
Choice Research
Bottom Line
THE BASICS
Bad news:
You just lost your job.
THE BASICS
Good news:
You have great skills
that give you options.
THE BASICS
Choice Example: Your Job Offers
Salary
(x current)
Travel
(%)
Vacation
(weeks)
Bonus
(%)
Position A 1.2 0 2 10
Position B 1.2 25 3 20
Position C 1.2 75 4 30
Position D 1.5 25 2 30
Position E 1.5 75 3 10
Position F 1.5 0 4 20
Position G 1.8 75 2 20
Position H 1.8 25 2 30
Position I 1.8 25 4 10
Salary
(x current)
Travel
(%)
Vacation
(weeks)
Bonus
(%)
Position A 1.2 0 2 10
Position B 1.2 25 3 20
Position C 1.2 75 4 30
Position D 1.5 25 2 30
Position E 1.5 75 3 10
Position F 1.5 0 4 20
Position G 1.8 75 2 20
Position H 1.8 25 2 30
Position I 1.8 25 4 10
THE BASICS
Your Choice
Why did you choose?
By what process did you choose?
THE BASICS
Why Choice Research Adds More Value
LITTLE DIFFERENTIATION
Asking buyers to rate the importance of, or preference for, a
bunch of features/attributes often gives...
THE BASICS
Why Choice Research Adds More Value
Buyers have to make difficult trade-
offs and concessions in real life.
We have a way to force respondents to
make trade-offs, just like real-world
buyers have to do.
THE BASICS
How many times have you seen this type of question?
THE BASICS
How many times have you seen this type of question?
Naturally we want it all.
How do you interpret the difference between a mean of 4.2 and 4.4 on a 5-point rating scale?
You know the futility of that exercise.
THE BASICS
…Or these types of questions?
 How much would you be willing to pay for this?
 At what price would you consider X “inexpensive,” “expensive,” “too expensive,”
and “too cheap?”
 But, these methods:
• Invite bargaining; can’t trust results; need to follow-up research
• Are overused and over-trusted; they feign precision
For a new product, with no idea of “what the market will bear,” this can get you near the ballpark.
THE BASICS
When we force respondents to make trade-offs, we get a
much better picture of the values of the product
attributes; we get better discrimination.
“What if... ?”
We also gain the opportunity to
simulate various product
configurations to figure out which
can lead to the best uptake.
We get to ask,
THE BASICS
Help Me Figure Out
The features that
will best optimize
my product
How many
customers will
pay for a new
features or
product
My brand
equity
Whether a new
product will
cannibalize
existing products
How much
demand will
change as we
change price
How will our product
will compete in the
current (and future)
competitive landscape
THE BASICS
Terminology
Attributes – the features of your product or service (e.g., price, color,
size, amount of storage, etc.)
Levels – the type or amount of an attribute (e.g., blue, red, or green
color, or 64 GB, 128 GB, or 256 GB)
Importance Scores – the maximum impact an attribute can have on
product choice
Utilities – the preference for a level of an attribute (technically called a
part-worth)
Share of Preference – interest in a product concept captured
through a market simulation
None Parameter – captures respondent propensity to not purchase
any of the choices in a simulation
THE BASICS
The Do’s and Don’ts
Don’t think importance scores will tell you what is “good”—they
only tell you where respondents’ attention was most focused.
Don’t compare utility scores across attributes—only consider
them relative gauges of level preference within each attribute
Do use simulations to answer your business questions
Do use a competitive set and a none parameter to provide
realism to your simulations
THE BASICS
The Big Difference
MaxDiff
deals with a single list of
attributes (brands, features,
messages, benefits, images,
copy, claims, etc.).
Conjoint
deals with attributes that have
various “levels” (degrees), and
that very often include price in a
product profile context.
THE BASICS
Bringing it All Together
MaxDiff
Conjoint
 Preference or
Importance of Items
 No Pricing
 Feature Configuration
 Product Optimization
 Competitive Scenarios
 Price Sensitivity
 Market Scenarios
 Product Demand
 Cannibalization
 Product Mix
Both MaxDiff and Conjoint can be used to feed Segmentation Analysis
CASE STUDY
How a Gaming Giant Won Using Max Diff & Conjoint
ROB ASERON
Online Research Guru
(Former Director, Zynga)
Product Naming Questions*
With Broad Applicability
1. What name will get a user to pause in the App Store environment?
2. Can we leverage brand halo and frame this new product as an extension of the
previous, related product?
3. What naming presentation appeals most to current user base?
4. What naming presentation has greatest attraction for expanding the user base?
5. Where will cross-promotion efforts have best traction?
* Example questions chosen because of relevance to many product types, not for representativeness to Zynga research concerns.
Naming the Game*
Question 1
* Hypothetical game name situation – never did ‘AntVille’ at Zynga.
Naming the Game*
Question 2
* Hypothetical game name situation – never did ‘AntVille’ at Zynga.
Naming Results*
Question 1
* Hypothetical game name, made up data.
Naming the Game*
Question 3 – Under the Radar
* Hypothetical game name situation – never did ‘AntVille’ at Zynga.
Max Diff Fits a Start Up’s Approach
Lightweight Implementation
– Immediately-understood response format -
complex judgment yet low cognitive load
– Minimally intrusive (inline responses)
– Appropriate for micro-rewards (panel)
Data, Data, Data
• Cut by play characteristics
• Cut by demographics
Efficient
– Respondent makes 2 judgments
• A is Most Preferred
• E Least Preferred
– We collect 7 data points (of possible10 )
• A > B, A > C, A > D, A > E
• B > E, C > E, D > E
– Concurrent consideration of pos/neg
Fast
– Overnight data-based directional read
– Iterate and re-field until finalized
ALL-IN-ONE SOLUTION
One Platform For All Your Conjoint Analysis Needs
VIVEK BHASKARAN
Founder & CEO
SurveyAnalytics /
QuestionPro
Choice-Based Conjoint
MaxDiff
Conjoint / Max Diff Setup : 1
Max Diff : Setup
Max Diff : Settings
Max Diff : Analysis : Share of Preference
Logit Model
Max Diff : Analysis : Filtering
Max Diff : Analysis : Comparisons
Conjoint Analysis : Setup
Conjoint Analysis : Settings
Conjoint : Design Model
Randomized D-Optimal Upload
Conjoint Analysis : Data Exploration
Attribute Importance
Profile Playboard
Market Segmentation
Simulator
Brand Equity
Retail Price
Equivalence
Price Elasticity &
Curve
Attribute Importance
Profile Playboard
Profile Playboard
Market Segmentation : Simulator
Brand Equity / Retail Price Equivalence
Price Elasticity
QUESTIONS
1 (800) 326-5570
E-mail:
sales-team@surveyanalytics.com
Online Inquiries:
www.surveyanaltics.com/contact
Nico Peruzzi, Ph.D.
1 (408) 202-1521
E-mail:
nperuzzi@orconsulting.com
Rob Aseron
E-mail:
rob@onlineresearch.guru

More Related Content

PPTX
How to Run Conjoint Analysis
PPTX
Ab testing 101
PPTX
A/B Testing Best Practices - Do's and Don'ts
PPTX
Conversion Optimization Willa Fogarty
PDF
Simplifying Personas
PPTX
Conjoint Analysis - Part 1/3
PDF
Why Customers Buy | Conjoint Analysis: Unlocking the Secret to What Your Cu...
PPTX
A Simple Tutorial on Conjoint and Cluster Analysis
How to Run Conjoint Analysis
Ab testing 101
A/B Testing Best Practices - Do's and Don'ts
Conversion Optimization Willa Fogarty
Simplifying Personas
Conjoint Analysis - Part 1/3
Why Customers Buy | Conjoint Analysis: Unlocking the Secret to What Your Cu...
A Simple Tutorial on Conjoint and Cluster Analysis

Similar to How to run conjoint analysis (20)

PPT
Innovation Intro to Conjoint
PPT
Prioritizing for Profit from AgilePalooza
PPT
Innovation-Intro-to-Conjoint (Some methods for analysis)
PPT
Learn how to do a conjoint analysis project in 1 hr
PPT
The twin goals of customer research: inspire designers, persuade stakeholders
PPTX
How to Run Discrete Choice Conjoint Analysis
PPT
Survey analytics conjointanalysis_1
PDF
Why We Win (Or Lose): Powering Your CI Program with Win/Loss Analysis
PDF
Chainsaw Conjoint
PPTX
QuestionPro Advanced Training Keys to Success - Discrete Conjoint Analysis 101
DOCX
Step by step guide.docx
PPT
Beyond Usability
PPTX
Testing & Optimization - A Deeper Look
PDF
Creating a culture that provokes failure and boosts improvement
PDF
Master the essentials of conversion optimization
PDF
How to Use Data to Inform Your Design and Drive Your Business
PPT
SurveyAnalytics:Conjoint Analysis
PPTX
Market analysis tools in npd (final)
PDF
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
Innovation Intro to Conjoint
Prioritizing for Profit from AgilePalooza
Innovation-Intro-to-Conjoint (Some methods for analysis)
Learn how to do a conjoint analysis project in 1 hr
The twin goals of customer research: inspire designers, persuade stakeholders
How to Run Discrete Choice Conjoint Analysis
Survey analytics conjointanalysis_1
Why We Win (Or Lose): Powering Your CI Program with Win/Loss Analysis
Chainsaw Conjoint
QuestionPro Advanced Training Keys to Success - Discrete Conjoint Analysis 101
Step by step guide.docx
Beyond Usability
Testing & Optimization - A Deeper Look
Creating a culture that provokes failure and boosts improvement
Master the essentials of conversion optimization
How to Use Data to Inform Your Design and Drive Your Business
SurveyAnalytics:Conjoint Analysis
Market analysis tools in npd (final)
[UserTesting Webinar] Design Thinking & Design Research at Credit Karma
Ad

More from QuestionPro (20)

PPTX
Qualitative Research vs Quantitative Research - a QuestionPro Academic Webinar
PPTX
QuestionPro - Introduction to Customer Experience Part 3: CX Benchmarking
PDF
The Future of Employee Engagement and Positivity at Workplace Webinar
PPTX
QuestionPro - Introduction to Customer Experience Part 2: Customer Journey Ma...
PDF
Qualitative Options with Online Communities
PPTX
QuestionPro TribeCX Webinar - Introduction to Customer Experience Part 1: CX ...
PPTX
QuestionPro Assessments Webinar - Trust, But Verify: The Evolution of Vendor ...
PDF
QuestionPro CX - Not Just a Number: Using NPS to Improve Customer Experience
PDF
QuestionPro Audience Webinar - How to Improve Data Quality For Your Research
PDF
How to Analyze Survey Data
PDF
Webinar - How to Create a Stellar Survey Through Brainstorming
PDF
Survey Design Webinar
PDF
Webinar - Deeper Insights Through Intelligent Community Engagement
PDF
Webinar - Return to editingThe Secret to Making HR Relevant Again
PDF
Webinar - The Ultimate Guide to Effective Online Surveys
PPTX
Webinar - How Mobile Innovation Is Changing the Face of Data Intelligence
PPTX
Webinar - A Beginners Guide to Choice-based Conjoint Analysis
PDF
Webinar Tutorial - A Beginners Guide To MaxDiff Scaling
PDF
Webinar - The Secret To Recruiting The Best Talent
PPTX
Webinar: Understanding Consumer Behavior for Online Purchases
Qualitative Research vs Quantitative Research - a QuestionPro Academic Webinar
QuestionPro - Introduction to Customer Experience Part 3: CX Benchmarking
The Future of Employee Engagement and Positivity at Workplace Webinar
QuestionPro - Introduction to Customer Experience Part 2: Customer Journey Ma...
Qualitative Options with Online Communities
QuestionPro TribeCX Webinar - Introduction to Customer Experience Part 1: CX ...
QuestionPro Assessments Webinar - Trust, But Verify: The Evolution of Vendor ...
QuestionPro CX - Not Just a Number: Using NPS to Improve Customer Experience
QuestionPro Audience Webinar - How to Improve Data Quality For Your Research
How to Analyze Survey Data
Webinar - How to Create a Stellar Survey Through Brainstorming
Survey Design Webinar
Webinar - Deeper Insights Through Intelligent Community Engagement
Webinar - Return to editingThe Secret to Making HR Relevant Again
Webinar - The Ultimate Guide to Effective Online Surveys
Webinar - How Mobile Innovation Is Changing the Face of Data Intelligence
Webinar - A Beginners Guide to Choice-based Conjoint Analysis
Webinar Tutorial - A Beginners Guide To MaxDiff Scaling
Webinar - The Secret To Recruiting The Best Talent
Webinar: Understanding Consumer Behavior for Online Purchases
Ad

Recently uploaded (20)

PDF
Pay-Per-Click Marketing: Strategies That Actually Work in 2025
PDF
How the Minnesota Vikings Used Community to Drive 170% Growth and Acquire 34K...
PDF
Future Retail Disruption Trends and Observations
DOCX
marketing plan starville............docx
PDF
Mastering Content Strategy in 2025 ss.pdf
PPTX
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
PDF
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
PDF
UNIT 2 - 5 DISTRIBUTION IN RURAL MARKETS.pdf
PPTX
hnk joint business plan for_Rooftop_Plan
PPTX
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
PDF
Building a strong social media presence.
PPTX
UNIT 3 - 5 INDUSTRIAL PRICING.ppt x
PPTX
"Best Healthcare Digital Marketing Ideas
PDF
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
PPTX
Ranking a Webpage with SEO (And Tracking It with the Right Attribution Type a...
DOCX
AL-ahly Sabbour un official strategic plan.docx
PDF
MARG’s Door & Window Hardware Catalogue | Trending Branding Digital Solutions
PDF
UNIT 1 -3 Factors Influencing RURAL CONSUMER BEHAVIOUR.pdf
PDF
Coleção Nature .
PDF
Prove and Prioritize Profitability in Every Marketing Campaign - Zach Sherrod...
Pay-Per-Click Marketing: Strategies That Actually Work in 2025
How the Minnesota Vikings Used Community to Drive 170% Growth and Acquire 34K...
Future Retail Disruption Trends and Observations
marketing plan starville............docx
Mastering Content Strategy in 2025 ss.pdf
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
RC 14001 Certification: Enhancing ISO 14001 with EHS & Security Standards
UNIT 2 - 5 DISTRIBUTION IN RURAL MARKETS.pdf
hnk joint business plan for_Rooftop_Plan
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
Building a strong social media presence.
UNIT 3 - 5 INDUSTRIAL PRICING.ppt x
"Best Healthcare Digital Marketing Ideas
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
Ranking a Webpage with SEO (And Tracking It with the Right Attribution Type a...
AL-ahly Sabbour un official strategic plan.docx
MARG’s Door & Window Hardware Catalogue | Trending Branding Digital Solutions
UNIT 1 -3 Factors Influencing RURAL CONSUMER BEHAVIOUR.pdf
Coleção Nature .
Prove and Prioritize Profitability in Every Marketing Campaign - Zach Sherrod...

How to run conjoint analysis

  • 1. Thursday, May 28th, 2015 WE WILL BEGIN SHORTLY questionpro.com | surveyanalytics.com Learn How to Make Better Business Decisions
  • 2. Conjoint Analysis Webinar : Will Begin Shortly….
  • 3. Presenters VIVEK BHASKARAN Founder & CEO SurveyAnalytics / QuestionPro ROB ASERON Online Research Guru (Former Director, Zynga) NICO PERUZZI, Ph.D. Partner Outsource Research Consulting
  • 4. AGENDA  What is Conjoint Analysis?  How Gaming Giant, Zynga, Won  Introducing an All-in-One Solution  Questions and Answer Session
  • 5. THE BASICS Conjoint Discrete Choice Choice-Based ConjointDCM CBC Adaptive Conjoint ACBC ACA Adaptive Choice-Based Conjoint MaxDiff MaxDiff Scaling MBC Best-Worst Scaling Menu-Based Choice All these methods involve making trade-offs, and can be classified under Choice Research Bottom Line
  • 6. THE BASICS Bad news: You just lost your job.
  • 7. THE BASICS Good news: You have great skills that give you options.
  • 8. THE BASICS Choice Example: Your Job Offers Salary (x current) Travel (%) Vacation (weeks) Bonus (%) Position A 1.2 0 2 10 Position B 1.2 25 3 20 Position C 1.2 75 4 30 Position D 1.5 25 2 30 Position E 1.5 75 3 10 Position F 1.5 0 4 20 Position G 1.8 75 2 20 Position H 1.8 25 2 30 Position I 1.8 25 4 10
  • 9. Salary (x current) Travel (%) Vacation (weeks) Bonus (%) Position A 1.2 0 2 10 Position B 1.2 25 3 20 Position C 1.2 75 4 30 Position D 1.5 25 2 30 Position E 1.5 75 3 10 Position F 1.5 0 4 20 Position G 1.8 75 2 20 Position H 1.8 25 2 30 Position I 1.8 25 4 10 THE BASICS Your Choice Why did you choose? By what process did you choose?
  • 10. THE BASICS Why Choice Research Adds More Value LITTLE DIFFERENTIATION Asking buyers to rate the importance of, or preference for, a bunch of features/attributes often gives...
  • 11. THE BASICS Why Choice Research Adds More Value Buyers have to make difficult trade- offs and concessions in real life. We have a way to force respondents to make trade-offs, just like real-world buyers have to do.
  • 12. THE BASICS How many times have you seen this type of question?
  • 13. THE BASICS How many times have you seen this type of question? Naturally we want it all. How do you interpret the difference between a mean of 4.2 and 4.4 on a 5-point rating scale? You know the futility of that exercise.
  • 14. THE BASICS …Or these types of questions?  How much would you be willing to pay for this?  At what price would you consider X “inexpensive,” “expensive,” “too expensive,” and “too cheap?”  But, these methods: • Invite bargaining; can’t trust results; need to follow-up research • Are overused and over-trusted; they feign precision For a new product, with no idea of “what the market will bear,” this can get you near the ballpark.
  • 15. THE BASICS When we force respondents to make trade-offs, we get a much better picture of the values of the product attributes; we get better discrimination. “What if... ?” We also gain the opportunity to simulate various product configurations to figure out which can lead to the best uptake. We get to ask,
  • 16. THE BASICS Help Me Figure Out The features that will best optimize my product How many customers will pay for a new features or product My brand equity Whether a new product will cannibalize existing products How much demand will change as we change price How will our product will compete in the current (and future) competitive landscape
  • 17. THE BASICS Terminology Attributes – the features of your product or service (e.g., price, color, size, amount of storage, etc.) Levels – the type or amount of an attribute (e.g., blue, red, or green color, or 64 GB, 128 GB, or 256 GB) Importance Scores – the maximum impact an attribute can have on product choice Utilities – the preference for a level of an attribute (technically called a part-worth) Share of Preference – interest in a product concept captured through a market simulation None Parameter – captures respondent propensity to not purchase any of the choices in a simulation
  • 18. THE BASICS The Do’s and Don’ts Don’t think importance scores will tell you what is “good”—they only tell you where respondents’ attention was most focused. Don’t compare utility scores across attributes—only consider them relative gauges of level preference within each attribute Do use simulations to answer your business questions Do use a competitive set and a none parameter to provide realism to your simulations
  • 19. THE BASICS The Big Difference MaxDiff deals with a single list of attributes (brands, features, messages, benefits, images, copy, claims, etc.). Conjoint deals with attributes that have various “levels” (degrees), and that very often include price in a product profile context.
  • 20. THE BASICS Bringing it All Together MaxDiff Conjoint  Preference or Importance of Items  No Pricing  Feature Configuration  Product Optimization  Competitive Scenarios  Price Sensitivity  Market Scenarios  Product Demand  Cannibalization  Product Mix Both MaxDiff and Conjoint can be used to feed Segmentation Analysis
  • 21. CASE STUDY How a Gaming Giant Won Using Max Diff & Conjoint ROB ASERON Online Research Guru (Former Director, Zynga)
  • 22. Product Naming Questions* With Broad Applicability 1. What name will get a user to pause in the App Store environment? 2. Can we leverage brand halo and frame this new product as an extension of the previous, related product? 3. What naming presentation appeals most to current user base? 4. What naming presentation has greatest attraction for expanding the user base? 5. Where will cross-promotion efforts have best traction? * Example questions chosen because of relevance to many product types, not for representativeness to Zynga research concerns.
  • 23. Naming the Game* Question 1 * Hypothetical game name situation – never did ‘AntVille’ at Zynga.
  • 24. Naming the Game* Question 2 * Hypothetical game name situation – never did ‘AntVille’ at Zynga.
  • 25. Naming Results* Question 1 * Hypothetical game name, made up data.
  • 26. Naming the Game* Question 3 – Under the Radar * Hypothetical game name situation – never did ‘AntVille’ at Zynga.
  • 27. Max Diff Fits a Start Up’s Approach Lightweight Implementation – Immediately-understood response format - complex judgment yet low cognitive load – Minimally intrusive (inline responses) – Appropriate for micro-rewards (panel) Data, Data, Data • Cut by play characteristics • Cut by demographics Efficient – Respondent makes 2 judgments • A is Most Preferred • E Least Preferred – We collect 7 data points (of possible10 ) • A > B, A > C, A > D, A > E • B > E, C > E, D > E – Concurrent consideration of pos/neg Fast – Overnight data-based directional read – Iterate and re-field until finalized
  • 28. ALL-IN-ONE SOLUTION One Platform For All Your Conjoint Analysis Needs VIVEK BHASKARAN Founder & CEO SurveyAnalytics / QuestionPro Choice-Based Conjoint MaxDiff
  • 29. Conjoint / Max Diff Setup : 1
  • 30. Max Diff : Setup
  • 31. Max Diff : Settings
  • 32. Max Diff : Analysis : Share of Preference Logit Model
  • 33. Max Diff : Analysis : Filtering
  • 34. Max Diff : Analysis : Comparisons
  • 37. Conjoint : Design Model Randomized D-Optimal Upload
  • 38. Conjoint Analysis : Data Exploration Attribute Importance Profile Playboard Market Segmentation Simulator Brand Equity Retail Price Equivalence Price Elasticity & Curve
  • 43. Brand Equity / Retail Price Equivalence
  • 45. QUESTIONS 1 (800) 326-5570 E-mail: sales-team@surveyanalytics.com Online Inquiries: www.surveyanaltics.com/contact Nico Peruzzi, Ph.D. 1 (408) 202-1521 E-mail: nperuzzi@orconsulting.com Rob Aseron E-mail: rob@onlineresearch.guru

Editor's Notes

  • #46: Accuracy: Quality and accuracy is higher and more reliable.