SlideShare a Scribd company logo
Sumo Logic
Framework & Journey of
Website Testing/Optimization
Saad Hameed & Jithesh Ambalapad
Marketing, Operations, Analytics & technology team
LinkedIn: http://j.mp/SaadHameed
Twitter: @SaadVirtus https://twitter.com/SaadVirtus
LinkedIn: https://www.linkedin.com/in/apjithesh
○ Improve Navigation (IA)
○ Align Messaging
○ Improve Bounce Rate
Website Journey Phase 1: Create
Baseline of Web Visitor Engagement
○ Build taxonomy & foundational tools to measure &
optimize
• Google Tag Manager
• Google Analytics
• User Testing
• Optimizely
• CrazyEgg
○ Website Redesign & Continuous Improvement
• Major revamp of our website UI/UX
• Updated Content/Messaging
The How of Improving Baseline
Engagement for Website
Sumologic.com Site
Pre-Phase 1 (Aug 2015)
https://web.archive.org/web/20160405124254/https://www.sumologic.com/
Sumologic.com
Post-Phase 1 Refreshes:
May 2016
https://web.archive.org/web/20150814044927/https://www.sumologic.com/
• Results
○ Continued refreshes improved Bounce Rates from 65% to 40%
○ Improved free conversions + 10%
○ Improved Alexa Ranking (15% Improvement)
Nov 2015 May 2016
Results From The Phase 1 Refresh
○ Ongoing major initiative to optimize for engagement and conversion
○ Started with detailing a testing framework
○ Framework and testing is geared towards
• Improving Conversion
• Improving Engagement
Journey Phase 2: Web Optimization to
Improve Conversions
Improve Conversions & Engagement:
• Platinum (Free/Trial, Contact Us, Click to chat)
• Gold (Platinum + Gated content resources)
• Silver (Gold + Non-Gated content resources)
Define the different elements that we would need to test and have
a categorization (A/B Testing taxonomy)
Detailing out test stories, execute the tests, measure, &
communicate
Why?
Why to test
What?
What do we need
to test
How?
Process to test
The Why, What, and How of Web
Optimization & Testing
Information
Architecture
Content
● Components
○ Main Navigation
○ Utility Navigation
○ Footer
● Attributes
○ Size
○ Position
○ Verbiage
Images Content Modules Call to ActionsOffers
● Components
○ Spotlight
○ Logos
○ Icons
○ Product
● Attributes
○ Size
○ Position
○ Image types
(Human /Product)
● Components
○ Company Pitch
○ Product Pitch
○ Product Validators
○ Product Demos
○ Product Benefit
○ Customer Testimonial
○ Customer Logos
○ Pricing
● Attributes
○ Tone
○ Voice
○ Size
○ Position
● Components
○ Gated
○ Non-Gated
● Attributes
○ Title
○ Type (Blog, Podcast,
video, PDF, etc.)
○ Perceived Value of
offer
○ Relevance to phase
in buyer lifecycle
● Components
○ Free CTA
○ Video CTA
○ Download
● Attributes
○ Size
○ Position
○ Action/Verbiage
○ Color
○ Font
○ Image
Web Optimization & Testing Framework
Information
Architecture
● Components
○ Main Navigation
○ Utility Navigation
○ Footer
● Attributes
○ Size
○ Position
○ Verbiage
Size Position Verbiage
Main Nav Large or Small Change Position Nav Item Verbiage
Utility Nav Large or Small Top or Next to Main Item Verbiage
Footer Fat footer or Thin Footer Left or Center Item Verbiage
How to Leverage the Framework? Example:
• Definition and detailing of “What” becomes the essence
of testing ideas
• Map the ideas based on Impact to business & Ease of
implementation
• Prioritize and execute ideas
• Document & take action on Results
Creating a Funnel for Web Optimization &
Testing Experiments
Ease of Implementation
BusinessImpact
● New Offers
● Nav position
● Related content
position
● Offers A/B testing
with Audience data
● Contact us position
● Footer Link sizes
● Media download
positioning
● Positioning of Share
button
● Link out positioning
for external
references
● Position of Mobile
nav
● Enable/Disable link
to product demo
● Elevator pitch
message
● Hide/enable related
links
● Multivariate Testing
with customer quotes
● Spotlight size
● Demo Multi page
● CTA positioning
● Nav element
positioning
● Free CTA
● Nav text verbiage
● Login position
High
Medium
Low
Low
(Hard)
Medium High
(easy)
THIS IS A SAMPLE
NOT ACTUAL IDEAS
How to Prioritize the Web Optimization &
Testing Experiments?
Example of Web Experiment
Test Click and Conversion rate when button verbiage is changed
Example of Web Experiment
Web Experiment Results
The How (Process) of Web Optimization &
Testing

More Related Content

PDF
ホームページ制作 神奈川
PDF
Form Builder | Maximize Demosphere
PDF
Content Formatting
PDF
Welcome To WebWriter
PPTX
11 Tips for Optimising Sponsored Content on LinkedIn (Education)
DOC
Sample Test Plan
PDF
Best Practices for Effective Website Testing & Optimization (Webinar)
PDF
Trade up from cube to corner office - OpenText Optimost
ホームページ制作 神奈川
Form Builder | Maximize Demosphere
Content Formatting
Welcome To WebWriter
11 Tips for Optimising Sponsored Content on LinkedIn (Education)
Sample Test Plan
Best Practices for Effective Website Testing & Optimization (Webinar)
Trade up from cube to corner office - OpenText Optimost

Viewers also liked (6)

PDF
Adobe Summit 2016 - Cindy Lu - B2B Personalization
PPT
Testing types 2
PDF
Damir Plejić: Struktura i značaj kvalitativnih podataka u optimizaciji web st...
PDF
Sample test-plan-template
PPTX
An Overview of User Acceptance Testing (UAT)
PDF
Test plan on iit website
Adobe Summit 2016 - Cindy Lu - B2B Personalization
Testing types 2
Damir Plejić: Struktura i značaj kvalitativnih podataka u optimizaciji web st...
Sample test-plan-template
An Overview of User Acceptance Testing (UAT)
Test plan on iit website
Ad

Similar to Website testing & optimization framework & results (20)

PPTX
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
PPTX
Conversion Rate Optmization
PPTX
Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013
PDF
Conversion Optimization: Fighting the Most Common Roadblocks
PDF
Opticon 2015-Scaling Your Testing Program for Maximum Impact
PPT
Taming The HiPPO
PPTX
Website Experience Webinar Presentation .pptx
PPTX
Conversion Summit Slides - 1 Sep 2011 - Craig Sullivan
PPT
Radically Improve Conversion Rates - eMSF 2009
PDF
Workshop Stanford University - 28th July 2018 on Website Optimization
PDF
Build a Winning Conversion Optimization Strategy
PPT
Web Analytics: A Measurement System of Website
PDF
Conversion Optimization Framework to Build Sustainable and Repeat Growth
PPTX
A Brief History of Optimisation
PPTX
Optimization 12-03-2013
PDF
User Testing by Example
PDF
Advancing Testing Program Maturity in your organization
PPT
Data Driven Website Decisions for SEO and CRO
PDF
Little Things Mean a Lot - The Importance of Usability Testing
PPTX
Search Sessions - Preparing Your Website for Google's Page Experience Update
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
Conversion Rate Optmization
Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013
Conversion Optimization: Fighting the Most Common Roadblocks
Opticon 2015-Scaling Your Testing Program for Maximum Impact
Taming The HiPPO
Website Experience Webinar Presentation .pptx
Conversion Summit Slides - 1 Sep 2011 - Craig Sullivan
Radically Improve Conversion Rates - eMSF 2009
Workshop Stanford University - 28th July 2018 on Website Optimization
Build a Winning Conversion Optimization Strategy
Web Analytics: A Measurement System of Website
Conversion Optimization Framework to Build Sustainable and Repeat Growth
A Brief History of Optimisation
Optimization 12-03-2013
User Testing by Example
Advancing Testing Program Maturity in your organization
Data Driven Website Decisions for SEO and CRO
Little Things Mean a Lot - The Importance of Usability Testing
Search Sessions - Preparing Your Website for Google's Page Experience Update
Ad

Recently uploaded (20)

PDF
Mastering Content Strategy in 2025 ss.pdf
PDF
Digital Marketing - clear pictire of marketing
PDF
Building a strong social media presence.
PPTX
Mastering eCommerce SEO: Strategies to Boost Traffic and Maximize Conversions
PDF
Best digital marketing company in Mumbai
PDF
How a Travel Company Can Implement Content Marketing
PPTX
Sumit Saxena IIM J Project Market segmentation.pptx
PDF
Instagram Marketing Agency by IIS INDIA.pdf
PPTX
The evolution of the internet - its impacts on consumers
PDF
Fly Emirates SEO case study by Rakesh pathak.pdf
PDF
E_Book_Customer_Relation_Management_0.pdf
PDF
UNIT 2 - 2 AGRICULTURE MARKETING in INDIA.pdf
PPTX
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
PPTX
"Best Healthcare Digital Marketing Ideas
PDF
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
PPTX
Your score increases as you pick a category, fill out a long description and ...
PDF
Proven AI Visibility: From SEO Strategy To GEO Tactics
PDF
You Need SEO for Your Business. Here’s Why..pdf
PPTX
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
PPTX
Assignment 2 Task 1 - How Consumers Use Technology and Its Impact on Their Lives
Mastering Content Strategy in 2025 ss.pdf
Digital Marketing - clear pictire of marketing
Building a strong social media presence.
Mastering eCommerce SEO: Strategies to Boost Traffic and Maximize Conversions
Best digital marketing company in Mumbai
How a Travel Company Can Implement Content Marketing
Sumit Saxena IIM J Project Market segmentation.pptx
Instagram Marketing Agency by IIS INDIA.pdf
The evolution of the internet - its impacts on consumers
Fly Emirates SEO case study by Rakesh pathak.pdf
E_Book_Customer_Relation_Management_0.pdf
UNIT 2 - 2 AGRICULTURE MARKETING in INDIA.pdf
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
"Best Healthcare Digital Marketing Ideas
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
Your score increases as you pick a category, fill out a long description and ...
Proven AI Visibility: From SEO Strategy To GEO Tactics
You Need SEO for Your Business. Here’s Why..pdf
Ipsos+Protocols+Playbook+V1.2+(DEC2024)+final+IntClientUseOnly.pptx
Assignment 2 Task 1 - How Consumers Use Technology and Its Impact on Their Lives

Website testing & optimization framework & results

  • 1. Sumo Logic Framework & Journey of Website Testing/Optimization Saad Hameed & Jithesh Ambalapad Marketing, Operations, Analytics & technology team
  • 2. LinkedIn: http://j.mp/SaadHameed Twitter: @SaadVirtus https://twitter.com/SaadVirtus
  • 4. ○ Improve Navigation (IA) ○ Align Messaging ○ Improve Bounce Rate Website Journey Phase 1: Create Baseline of Web Visitor Engagement
  • 5. ○ Build taxonomy & foundational tools to measure & optimize • Google Tag Manager • Google Analytics • User Testing • Optimizely • CrazyEgg ○ Website Redesign & Continuous Improvement • Major revamp of our website UI/UX • Updated Content/Messaging The How of Improving Baseline Engagement for Website
  • 6. Sumologic.com Site Pre-Phase 1 (Aug 2015) https://web.archive.org/web/20160405124254/https://www.sumologic.com/
  • 7. Sumologic.com Post-Phase 1 Refreshes: May 2016 https://web.archive.org/web/20150814044927/https://www.sumologic.com/
  • 8. • Results ○ Continued refreshes improved Bounce Rates from 65% to 40% ○ Improved free conversions + 10% ○ Improved Alexa Ranking (15% Improvement) Nov 2015 May 2016 Results From The Phase 1 Refresh
  • 9. ○ Ongoing major initiative to optimize for engagement and conversion ○ Started with detailing a testing framework ○ Framework and testing is geared towards • Improving Conversion • Improving Engagement Journey Phase 2: Web Optimization to Improve Conversions
  • 10. Improve Conversions & Engagement: • Platinum (Free/Trial, Contact Us, Click to chat) • Gold (Platinum + Gated content resources) • Silver (Gold + Non-Gated content resources) Define the different elements that we would need to test and have a categorization (A/B Testing taxonomy) Detailing out test stories, execute the tests, measure, & communicate Why? Why to test What? What do we need to test How? Process to test The Why, What, and How of Web Optimization & Testing
  • 11. Information Architecture Content ● Components ○ Main Navigation ○ Utility Navigation ○ Footer ● Attributes ○ Size ○ Position ○ Verbiage Images Content Modules Call to ActionsOffers ● Components ○ Spotlight ○ Logos ○ Icons ○ Product ● Attributes ○ Size ○ Position ○ Image types (Human /Product) ● Components ○ Company Pitch ○ Product Pitch ○ Product Validators ○ Product Demos ○ Product Benefit ○ Customer Testimonial ○ Customer Logos ○ Pricing ● Attributes ○ Tone ○ Voice ○ Size ○ Position ● Components ○ Gated ○ Non-Gated ● Attributes ○ Title ○ Type (Blog, Podcast, video, PDF, etc.) ○ Perceived Value of offer ○ Relevance to phase in buyer lifecycle ● Components ○ Free CTA ○ Video CTA ○ Download ● Attributes ○ Size ○ Position ○ Action/Verbiage ○ Color ○ Font ○ Image Web Optimization & Testing Framework
  • 12. Information Architecture ● Components ○ Main Navigation ○ Utility Navigation ○ Footer ● Attributes ○ Size ○ Position ○ Verbiage Size Position Verbiage Main Nav Large or Small Change Position Nav Item Verbiage Utility Nav Large or Small Top or Next to Main Item Verbiage Footer Fat footer or Thin Footer Left or Center Item Verbiage How to Leverage the Framework? Example:
  • 13. • Definition and detailing of “What” becomes the essence of testing ideas • Map the ideas based on Impact to business & Ease of implementation • Prioritize and execute ideas • Document & take action on Results Creating a Funnel for Web Optimization & Testing Experiments
  • 14. Ease of Implementation BusinessImpact ● New Offers ● Nav position ● Related content position ● Offers A/B testing with Audience data ● Contact us position ● Footer Link sizes ● Media download positioning ● Positioning of Share button ● Link out positioning for external references ● Position of Mobile nav ● Enable/Disable link to product demo ● Elevator pitch message ● Hide/enable related links ● Multivariate Testing with customer quotes ● Spotlight size ● Demo Multi page ● CTA positioning ● Nav element positioning ● Free CTA ● Nav text verbiage ● Login position High Medium Low Low (Hard) Medium High (easy) THIS IS A SAMPLE NOT ACTUAL IDEAS How to Prioritize the Web Optimization & Testing Experiments?
  • 15. Example of Web Experiment Test Click and Conversion rate when button verbiage is changed
  • 16. Example of Web Experiment
  • 18. The How (Process) of Web Optimization & Testing