SlideShare a Scribd company logo
BUILDING A TESTING 
ROADMAP! 
Hazjier Pourkhalkhali! 
Strategic Optimization Consultant!
HAZJIER POURKHALKHALI! 
§ Work with clients on:! 
• Optimization strategy! 
• Operational management 
and processes! 
• Testing best practices! 
• Industry trends and 
research! 
Strategic Optimization 
Consultant, EMEA
CREATING AN OPTIMIZATION 
Structure Your 
Optimization Goals 
Manage Your 
Testing Roadmap 
Find Your 
Maximum 
ROADMAP!
STRUCTURE YOUR OPTIMIZATION 
GOALS!
SET BUSINESS GOALS! 
• What is the company-wide goal?! 
! 
• How does optimization play a part?! 
! 
• Think beyond conversions!!
SET BUSINESS GOALS! 
Conversions Revenue CTR
THINK BEYOND CONVERSIONS! 
Revenue 
Revenue 
Per Visitor 
Conversion 
Rate 
Visitors 
Average 
Order Value
Revenue 
Revenue 
Per Visitor 
Conversion 
Rate 
Length of 
Funnel 
Completion 
Rate 
Average 
Order Value 
Quantity Price 
Visitors 
Acquisition Retention
Completion 
Rate 
Emphasize 
the Primary 
Call to Action 
Wording / 
messaging 
Location / 
size 
Design / 
color / 
iconography 
Minimize 
Distractions 
Establish a 
visual 
hierarchy 
Remove non-critical 
content 
Limit number 
of choices 
Communicate 
Unique 
Selling Points 
Select/target 
the right 
USP’s 
Refine the 
messaging 
Communicate 
visually 
Design 
Intuitive 
Navigation 
Use a clear, 
consistent 
layout 
Structure the 
right tabs and 
order 
Use 
iconography 
Market 
Products 
Effectively 
Test ideal 
product 
visuals 
Use the right 
review 
systems 
Find ideal 
description 
text / length 
Build a Sense 
of Urgency 
Show 
quantity left 
Push 
temporary 
offers 
Promote 
buying before 
set times 
Goals 
Strategies 
Tactics
MANAGE YOUR TESTING ROADMAP!
DEVELOP A TESTING PROCESS! 
Ideate Research Refine Plan & Run Review
“Any time the Detroit Pistons score 100 
points and hold the other team below 
100 points, they almost always win.” 
-Doug Collins, NBA Coach!
REFINE YOUR HYPOTHESIS!
DEVELOP A TESTING PROCESS! 
Ideate Research Refine Plan & Run Review
DEVELOP A TESTING PROCESS! 
Ideate Research Refine Plan & Run Review
FIND YOUR MAXIMUM!
EXPLORE RADICAL OPTIONS!
CASE STUDY: ABC FAMILY / DISNEY!
REFINE YOUR WEBSITE!
“We’re going to turn this 
team around 360 degrees.” 
-Jason Kidd, NBA Player!
REFINE YOUR WEBSITE! 
ANALYTICS QUALITATIVE 
VOICE OF THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
REFINE YOUR WEBSITE! 
ANALYTICS QUALITATIVE 
VOICE OF THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
1. USE IN-PAGE ANALYTICS!
2. USE FUNNEL VISUALIZATION!
3. GET GRANULAR ABOUT CONVERSIONS! 
3.50%! 
3.00%! 
2.50%! 
2.00%! 
1.50%! 
1.00%! 
0.50%! 
0.00%! 
Industry Conversion Rate! 
Client Conversion Rate! 
25-34! 35-44! 45-54! 55-64! 65+! 25-34! 35-44! 45-54! 55-64! 65+! 
MEN! WOMEN!
REFINE YOUR WEBSITE! 
ANALYTICS QUALITATIVE 
VOICE OF THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
USING QUALITATIVE DATA! 
• Run consumer surveys! 
! 
• Analyze marketing reports! 
! 
• Perform user case studies! 
! 
• Record user sessions!
REFINE YOUR WEBSITE! 
ANALYTICS QUALITATIVE 
VOICE OF THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
HOME PAGE COMPARISON! 
§ Why should users prefer your website 
§ Who is your target audience? 
§ What are the three main page goals? 
§ Which content should users see first? 
§ What is your edge? Growth area? 
§ Which users should you also target? 
§ How effectively are they pushed? 
§ What content should be removed?
BOOKING PAGE COMPARISON! 
§ What steps should users complete? 
§ What information are you displaying? 
§ How do you visualize the flow? 
§ What is the ideal flow? 
§ When should you display information? 
§ How can the process be more intuitive?
REFINE YOUR WEBSITE! 
ANALYTICS QUALITATIVE 
VOICE OF THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
LOVEHOLIDAYS HOME PAGE! 
§ How many visual steps does it take a customer to see your Primary Call to Action? 
§ Are you emphasizing the right content with your visual layout? 
§ Is key content currently being underutilized due to the design?
LOVEHOLIDAYS BOOKINGS PAGE!
REFINE YOUR WEBSITE! 
ANALYTICS QUALITATIVE 
VOICE OF THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
LISTENING TO THE CUSTOMER! 
• Read the most used search queries, FAQ pages! 
! 
• Send customer surveys to specific segments! 
! 
• Use Net Promoter Scores or alternate metrics to assess 
performance by segment, product, or service! 
! 
• Call your customers yourself / shadow customer calls!
BUILD YOUR TESTING ROADMAP! 
Structure Your 
Optimization Goals 
Manage Your 
Testing Roadmap 
Find Your 
Maximum 
ANALYTICS QUALITATIVE 
VOICE O F THE 
CUSTOMER 
DATA 
HEATMAPS COMPETITIVE 
REVIEWS
Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

More Related Content

PDF
Website Usability
PPTX
Web success 2017-1-The 9 Essentials of Web Success Intro
PPTX
01 torsdag michael mokhberi apptus agile merchandising sebc
PPTX
Basics of analytics
PPTX
Case study on Web Conversion Optimization
PPT
Make Google AdWords More Effective
PDF
adwords training
PPTX
Machine Learning is Much More Than Product Recommendations
Website Usability
Web success 2017-1-The 9 Essentials of Web Success Intro
01 torsdag michael mokhberi apptus agile merchandising sebc
Basics of analytics
Case study on Web Conversion Optimization
Make Google AdWords More Effective
adwords training
Machine Learning is Much More Than Product Recommendations

What's hot (19)

PPTX
Website Health Check
PPT
How to optimize your Adwords PPC campaign
PDF
Enhancing the B2B Buying Experience with Personalization – Certona
PDF
How to win StartupWeekend
PPTX
Inside eCommerce - Design for Success - Micksgarage.com- Brendan McMahon
PPTX
The Marriage Between PPC & SEO
PPT
Top web company pakistan
PDF
Does Your Website Stink?
PDF
Seer_PPC 101
PPTX
Meetup presentation July 5th 2015 "The Number One Goal Of Every Website Sho...
PPTX
How to Create the Best Landing Pages Ever!
PPTX
Revenue Management
PPTX
Category Page Optimization
PDF
How to create a great pitch deck
PPTX
Conversion optimization 2.0 – how to maximize sales from your current traffic
PPTX
Audelyaustria research presentation
PPTX
Turning you into a brand
PDF
5 tips to increase your conversion rate
PPTX
Soso--SEM
Website Health Check
How to optimize your Adwords PPC campaign
Enhancing the B2B Buying Experience with Personalization – Certona
How to win StartupWeekend
Inside eCommerce - Design for Success - Micksgarage.com- Brendan McMahon
The Marriage Between PPC & SEO
Top web company pakistan
Does Your Website Stink?
Seer_PPC 101
Meetup presentation July 5th 2015 "The Number One Goal Of Every Website Sho...
How to Create the Best Landing Pages Ever!
Revenue Management
Category Page Optimization
How to create a great pitch deck
Conversion optimization 2.0 – how to maximize sales from your current traffic
Audelyaustria research presentation
Turning you into a brand
5 tips to increase your conversion rate
Soso--SEM
Ad

Viewers also liked (20)

PDF
Opticon 2015-10 Secrets to Building an Amazing Mobile Testing Roadmap
PPTX
The Top 5 Ecommerce Tests You Should Run Right Now
PPTX
eTail East 2014 - Developing an Email Testing Roadmap
PDF
Let Users Drive Product Roadmap - Strategy Meet User Research
PDF
Introductory Online Controlled Experiments
PPTX
PDF
Developing A Succesful UX Strategy
PPTX
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
PDF
User testing methodology
PDF
How to Build a Research Roadmap (avoiding tempting dead-ends)
PDF
Ab Testing
PDF
Recognizing Software Debt - Beyond Agile Puget Sound
PDF
Dollars and Dates are Killing Agile
PDF
Managing Software Debt - Quality Debt Focus for QASIG Seattle
PDF
Integrating Quality into Project Portfolio Management
PDF
Earned Value Management and Agile Tips for Success
PDF
2011 pmo symposium Bridging the Agile-to-PMO Communication Gap
PDF
Test Automation: A Roadmap For Sucesss
PDF
UX STRAT 2014: Tim Loo's Workshop - Experience Visioning & Roadmapping
PPT
UX Deliverables in Practice
Opticon 2015-10 Secrets to Building an Amazing Mobile Testing Roadmap
The Top 5 Ecommerce Tests You Should Run Right Now
eTail East 2014 - Developing an Email Testing Roadmap
Let Users Drive Product Roadmap - Strategy Meet User Research
Introductory Online Controlled Experiments
Developing A Succesful UX Strategy
Making Decisions with Data: Beyond Basic A/B Testing (ProductCamp Boston 2016)
User testing methodology
How to Build a Research Roadmap (avoiding tempting dead-ends)
Ab Testing
Recognizing Software Debt - Beyond Agile Puget Sound
Dollars and Dates are Killing Agile
Managing Software Debt - Quality Debt Focus for QASIG Seattle
Integrating Quality into Project Portfolio Management
Earned Value Management and Agile Tips for Success
2011 pmo symposium Bridging the Agile-to-PMO Communication Gap
Test Automation: A Roadmap For Sucesss
UX STRAT 2014: Tim Loo's Workshop - Experience Visioning & Roadmapping
UX Deliverables in Practice
Ad

Similar to Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014 (20)

PDF
Oren Cohen - Optimizely (All Things Data 2015)
PDF
Optimizing Your Website 2014 -Class #2 HubSpot Inbound Academy Certification
PDF
Optimizely Workshop: Personalization - Strategy Essentials
PPTX
Ultimate Guide to Bing Ads Remarketing by Christi Olson
PPTX
Audience Targeting: Strategy, Optimization, Expansion
PDF
Marketing Concepts - Go-to-Market Templates
PDF
Site search-bronto
PDF
Top Floor Technologies User Experience Forum 2013
PPTX
Website workout
PDF
Growth Hacking: Tools, Techniques & Case Study
PPTX
I Spy With My Little Eye - How to Determine KPIs and Drive Website Effectiveness
PDF
How to Select the Best Keyphrases for Your Marketing Campaigns - andy Headington
PDF
Definition of A/B testing and Case Studies by Optimizely
PPTX
How to Improve Your Website: The Role & Importance of SEO, Branding, Content,...
PDF
Marketing Strategies - Go-to-Market Plans
PDF
Plazabridge group Inbound Lead Generation Planning Guide
PDF
Writing a great blog - Webcast by Leading Results and ERPVAR
PPTX
Andys guideto pm
PDF
Marketing Process - Go-to-Market Plans
KEY
Conversion Optimization
Oren Cohen - Optimizely (All Things Data 2015)
Optimizing Your Website 2014 -Class #2 HubSpot Inbound Academy Certification
Optimizely Workshop: Personalization - Strategy Essentials
Ultimate Guide to Bing Ads Remarketing by Christi Olson
Audience Targeting: Strategy, Optimization, Expansion
Marketing Concepts - Go-to-Market Templates
Site search-bronto
Top Floor Technologies User Experience Forum 2013
Website workout
Growth Hacking: Tools, Techniques & Case Study
I Spy With My Little Eye - How to Determine KPIs and Drive Website Effectiveness
How to Select the Best Keyphrases for Your Marketing Campaigns - andy Headington
Definition of A/B testing and Case Studies by Optimizely
How to Improve Your Website: The Role & Importance of SEO, Branding, Content,...
Marketing Strategies - Go-to-Market Plans
Plazabridge group Inbound Lead Generation Planning Guide
Writing a great blog - Webcast by Leading Results and ERPVAR
Andys guideto pm
Marketing Process - Go-to-Market Plans
Conversion Optimization

More from Optimizely (20)

PDF
Clover Rings Up Digital Growth to Drive Experimentation
PPTX
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
PPTX
The Science of Getting Testing Right
PDF
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
PPTX
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
PPTX
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
PDF
The Future of Optimizely for Technical Teams
PPTX
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
PPTX
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
PDF
Building an Experiment Pipeline for GitHub’s New Free Team Offering
PPTX
AMC Networks Experiments Faster on the Server Side
PDF
Evolving Experimentation from CRO to Product Development
PDF
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
PPTX
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
PPTX
Making Your Hypothesis Work Harder to Inform Future Product Strategy
PPTX
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
PPTX
Experimentation through Clients' Eyes
PPTX
Shipping to Learn and Accelerate Growth with GitHub
PPTX
Test Everything: TrustRadius Delivers Customer Value with Experimentation
PDF
Optimizely Agent: Scaling Resilient Feature Delivery
Clover Rings Up Digital Growth to Drive Experimentation
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
The Science of Getting Testing Right
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
The Future of Optimizely for Technical Teams
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Building an Experiment Pipeline for GitHub’s New Free Team Offering
AMC Networks Experiments Faster on the Server Side
Evolving Experimentation from CRO to Product Development
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Experimentation through Clients' Eyes
Shipping to Learn and Accelerate Growth with GitHub
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely Agent: Scaling Resilient Feature Delivery

Recently uploaded (20)

PPTX
Impressionism_PostImpressionism_Presentation.pptx
PPTX
AcademyNaturalLanguageProcessing-EN-ILT-M02-Introduction.pptx
PPTX
PHIL.-ASTRONOMY-AND-NAVIGATION of ..pptx
PPTX
Sustainable Forest Management ..SFM.pptx
PDF
COLEAD A2F approach and Theory of Change
DOCX
ENGLISH PROJECT FOR BINOD BIHARI MAHTO KOYLANCHAL UNIVERSITY
PPTX
fundraisepro pitch deck elegant and modern
PPTX
Primary and secondary sources, and history
PPTX
worship songs, in any order, compilation
PPTX
The Effect of Human Resource Management Practice on Organizational Performanc...
PPTX
Effective_Handling_Information_Presentation.pptx
PPTX
ART-APP-REPORT-FINctrwxsg f fuy L-na.pptx
PDF
Tunisia's Founding Father(s) Pitch-Deck 2022.pdf
PPTX
Self management and self evaluation presentation
PPTX
Anesthesia and it's stage with mnemonic and images
PPTX
nose tajweed for the arabic alphabets for the responsive
PPT
First Aid Training Presentation Slides.ppt
PDF
Instagram's Product Secrets Unveiled with this PPT
PPTX
2025-08-10 Joseph 02 (shared slides).pptx
PPTX
Project and change Managment: short video sequences for IBA
Impressionism_PostImpressionism_Presentation.pptx
AcademyNaturalLanguageProcessing-EN-ILT-M02-Introduction.pptx
PHIL.-ASTRONOMY-AND-NAVIGATION of ..pptx
Sustainable Forest Management ..SFM.pptx
COLEAD A2F approach and Theory of Change
ENGLISH PROJECT FOR BINOD BIHARI MAHTO KOYLANCHAL UNIVERSITY
fundraisepro pitch deck elegant and modern
Primary and secondary sources, and history
worship songs, in any order, compilation
The Effect of Human Resource Management Practice on Organizational Performanc...
Effective_Handling_Information_Presentation.pptx
ART-APP-REPORT-FINctrwxsg f fuy L-na.pptx
Tunisia's Founding Father(s) Pitch-Deck 2022.pdf
Self management and self evaluation presentation
Anesthesia and it's stage with mnemonic and images
nose tajweed for the arabic alphabets for the responsive
First Aid Training Presentation Slides.ppt
Instagram's Product Secrets Unveiled with this PPT
2025-08-10 Joseph 02 (shared slides).pptx
Project and change Managment: short video sequences for IBA

Building a Testing Roadmap by Hazjier Pourkhalkhali - Optimizely Experience London 2014

  • 1. BUILDING A TESTING ROADMAP! Hazjier Pourkhalkhali! Strategic Optimization Consultant!
  • 2. HAZJIER POURKHALKHALI! § Work with clients on:! • Optimization strategy! • Operational management and processes! • Testing best practices! • Industry trends and research! Strategic Optimization Consultant, EMEA
  • 3. CREATING AN OPTIMIZATION Structure Your Optimization Goals Manage Your Testing Roadmap Find Your Maximum ROADMAP!
  • 5. SET BUSINESS GOALS! • What is the company-wide goal?! ! • How does optimization play a part?! ! • Think beyond conversions!!
  • 6. SET BUSINESS GOALS! Conversions Revenue CTR
  • 7. THINK BEYOND CONVERSIONS! Revenue Revenue Per Visitor Conversion Rate Visitors Average Order Value
  • 8. Revenue Revenue Per Visitor Conversion Rate Length of Funnel Completion Rate Average Order Value Quantity Price Visitors Acquisition Retention
  • 9. Completion Rate Emphasize the Primary Call to Action Wording / messaging Location / size Design / color / iconography Minimize Distractions Establish a visual hierarchy Remove non-critical content Limit number of choices Communicate Unique Selling Points Select/target the right USP’s Refine the messaging Communicate visually Design Intuitive Navigation Use a clear, consistent layout Structure the right tabs and order Use iconography Market Products Effectively Test ideal product visuals Use the right review systems Find ideal description text / length Build a Sense of Urgency Show quantity left Push temporary offers Promote buying before set times Goals Strategies Tactics
  • 11. DEVELOP A TESTING PROCESS! Ideate Research Refine Plan & Run Review
  • 12. “Any time the Detroit Pistons score 100 points and hold the other team below 100 points, they almost always win.” -Doug Collins, NBA Coach!
  • 14. DEVELOP A TESTING PROCESS! Ideate Research Refine Plan & Run Review
  • 15. DEVELOP A TESTING PROCESS! Ideate Research Refine Plan & Run Review
  • 18. CASE STUDY: ABC FAMILY / DISNEY!
  • 20. “We’re going to turn this team around 360 degrees.” -Jason Kidd, NBA Player!
  • 21. REFINE YOUR WEBSITE! ANALYTICS QUALITATIVE VOICE OF THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS
  • 22. REFINE YOUR WEBSITE! ANALYTICS QUALITATIVE VOICE OF THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS
  • 23. 1. USE IN-PAGE ANALYTICS!
  • 24. 2. USE FUNNEL VISUALIZATION!
  • 25. 3. GET GRANULAR ABOUT CONVERSIONS! 3.50%! 3.00%! 2.50%! 2.00%! 1.50%! 1.00%! 0.50%! 0.00%! Industry Conversion Rate! Client Conversion Rate! 25-34! 35-44! 45-54! 55-64! 65+! 25-34! 35-44! 45-54! 55-64! 65+! MEN! WOMEN!
  • 26. REFINE YOUR WEBSITE! ANALYTICS QUALITATIVE VOICE OF THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS
  • 27. USING QUALITATIVE DATA! • Run consumer surveys! ! • Analyze marketing reports! ! • Perform user case studies! ! • Record user sessions!
  • 28. REFINE YOUR WEBSITE! ANALYTICS QUALITATIVE VOICE OF THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS
  • 29. HOME PAGE COMPARISON! § Why should users prefer your website § Who is your target audience? § What are the three main page goals? § Which content should users see first? § What is your edge? Growth area? § Which users should you also target? § How effectively are they pushed? § What content should be removed?
  • 30. BOOKING PAGE COMPARISON! § What steps should users complete? § What information are you displaying? § How do you visualize the flow? § What is the ideal flow? § When should you display information? § How can the process be more intuitive?
  • 31. REFINE YOUR WEBSITE! ANALYTICS QUALITATIVE VOICE OF THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS
  • 32. LOVEHOLIDAYS HOME PAGE! § How many visual steps does it take a customer to see your Primary Call to Action? § Are you emphasizing the right content with your visual layout? § Is key content currently being underutilized due to the design?
  • 34. REFINE YOUR WEBSITE! ANALYTICS QUALITATIVE VOICE OF THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS
  • 35. LISTENING TO THE CUSTOMER! • Read the most used search queries, FAQ pages! ! • Send customer surveys to specific segments! ! • Use Net Promoter Scores or alternate metrics to assess performance by segment, product, or service! ! • Call your customers yourself / shadow customer calls!
  • 36. BUILD YOUR TESTING ROADMAP! Structure Your Optimization Goals Manage Your Testing Roadmap Find Your Maximum ANALYTICS QUALITATIVE VOICE O F THE CUSTOMER DATA HEATMAPS COMPETITIVE REVIEWS