SlideShare a Scribd company logo
© AKAMAI - EDGE 2017
CONNECTING WEB PERFORMANCE
TO BUSINESS RESULTS
Enterprise Architect, Web Performance
Ken Harker
© AKAMAI - EDGE 2017
Agenda
• Your Motivation
• You Need a Plan
• Finding Direction
• Setting Targets
• Allocating Resources
• Expecting Success
• Where Do We Go Next?
© AKAMAI - EDGE 2017
Users Are Online More Than Ever
• Source: eMarketer
© AKAMAI - EDGE 2017
Mobile Commerce: 2016 Holidays
Just imagine
what it could
have been if
every user had
experienced
great
performance
Mobile
shopping carts
had a 56%
abandonment
rate – poor
performance is
one of the top
three reasons
Source: Slice Intelligence
© AKAMAI - EDGE 2017
Being Slow Can Be Worse Than Being Down
• Performance affects
the user perception
of site quality
• The effect persists
into the future
• This is hard to
appreciate fully
© AKAMAI - EDGE 2017
We Can Silence the Doubters
• https://wpostats.com/
© AKAMAI - EDGE 2017
Early History
• In 2006, Google published a
landmark study showing that
500 ms of delay reduced web
searches by 25%
• In 2009, Bing and Google
published joint experiments
• 200 ms was enough to measurably
change user engagement
• 500 ms was all it took to impact
revenue
© AKAMAI - EDGE 2017
More Recent Published Findings
• In 2013, Walmart revealed that
every 100 ms improvement in
page load time resulted in a
1% increase in revenue
• In 2017, Akamai publishes
biannual State of Online Retail
Performance report
• 100 ms delay in website load time can
hurt conversion rates by 7%
© AKAMAI - EDGE 2017
So You Need a Plan
1. Identify how performance is affecting your business
2. Have justifiable targets
3. Know where to focus your efforts
4. Predict Your Return on Investment
Akamai mPulse has the tools you need to execute your plan
© AKAMAI - EDGE 2017
Performance Is Not All That Matters To Your Customers
✓ Pricing
✓ Quality
✓ Incentives
✓ Marketing
✓ Ease of Use
…but more a responsive web experience
is definitely part of the solution
…and very small improvements in
performance can make a big difference
© AKAMAI - EDGE 2017
We Start with Measurements
• You need to know where you are starting from
• You need to be measuring with accuracy and
completeness
• You need to be able to monitor your progress
• You need to be able to identify success
© AKAMAI - EDGE 2017
The Ecosystem of Site Performance
Back-End
Monitoring the
Nuts and Bolts
of Your
Infrastructure
and Application
Synthetic
Probing for
Weakness
Web Analytics
Categorizing and
Understanding
Your Site Visitors
RUM
Revealing the
Customer
Experience
© AKAMAI - EDGE 2017
APM, Synthetic, and Analytics
APM
• ✗ No insight
into overall
visitor
experience
• ✗ Unable to
track
performance of
third-party
services
Synthetic
• ✗ No insight
into visitor
engagement
• ✗ No insight
into conversion
and revenue
Web Analytics
• ✗ Light, to no,
insights into
performance
© AKAMAI - EDGE 2017
Real User Measurements
• The Good
• Ground truth for
performance
• Covers all variety of site
visitors (geography,
device, connection)
• Captures both
performance and
business metric data at
the same time
• The Challenges
• Data sets can be
extremely large
• Data is noisy
• Distilling this data into
business intelligence
can be a challenge
© AKAMAI - EDGE 2017
Large Sites Should Use All Four Measurement Systems
Only RUM gives us the magic connection between
performance and business outcome
© AKAMAI - EDGE 2017
Akamai mPulse
World’s premier Real User Measurement platform
Acquired by Akamai in April 2017
© AKAMAI - EDGE 2017
Operational Dashboards
• Real-time
• Comprehensive
• Easy to filter
• Customizable
• Shareable
© AKAMAI - EDGE 2017
Data Science
• Analyze large
volumes of
historical data
• Data modeling
that can take
longer to
complete than
“real-time”
• Powerful
correlations and
other discovery
mechanisms
© AKAMAI - EDGE 2017
Triage and Diagnostics
• Details on
every resource
request of
every page
view
• Drill into front-
end
performance
issues
© AKAMAI - EDGE 2017
Real-Time Alerts
• Of course, you can alert
on performance events
• You can also alert on
business metrics
• Conversion Rate drops too
low
• Too many or too few page
views
© AKAMAI - EDGE 2017
But What About Business Insights?
• How Fast Do I Need
To Be?
• Where Should I Focus
My Limited Human
Capital?
• What Will My ROI
Look Like?
© AKAMAI - EDGE 2017
How Fast Do I Need To Be?
For a retail site, the answer to “How fast do I need to be?”
should be:
The performance level at which my conversion and
revenue are maximized
© AKAMAI - EDGE 2017
What Is Your Maximum Conversion Rate?
A key metric of business success,
conversion rate is the percentage of
user sessions (visits) that result in a
purchase during that session on your
site
Web site performance is almost
always going to affect your
conversion rate
© AKAMAI - EDGE 2017
Every Site is Different, Nothing is Quite the Same
Just because an industry
study says “2 seconds” does
not mean that your site needs
to be loading in 2 seconds all
the time
Not every kind of page is the
same
Mobile and Desktop can be
very different
© AKAMAI - EDGE 2017
Desktop vs. Mobile vs. Tablet • Different device types can have
radically different conversion
behavior
• Often, you need to treat each
class of visitors separately
© AKAMAI - EDGE 2017
Conversion Rate versus Page Load Time
• Discover the point of
diminishing returns for
performance
improvement
© AKAMAI - EDGE 2017
Break It Down by Page
• Not every page on your site will
show the same conversion peak
© AKAMAI - EDGE 2017
Also Consider Bounce Rate
• Show how poor performance is
driving potential customers away
© AKAMAI - EDGE 2017
Where Should I Focus My Efforts?
Even the largest retail
sites only have so many
developers and testers
You cannot optimize
everything at the same
time
Some pages on your site
are more important than
others
© AKAMAI - EDGE 2017
Avoid the Checkout Flow Trap
It is tempting to want to focus on the checkout flow as if it is
the primary point of abandonment
In our experience, this is a mistake
Users do not always flow through the site in the same sequence
Users often break their shopping across multiple sessions
© AKAMAI - EDGE 2017
Find the Links Between Performance and Conversion
Focus on the pages that show the highest
correlation to user engagement and conversion
Almost always, these will be pages prior
to the steps where a user has decided to make a purchase
© AKAMAI - EDGE 2017
Relative Conversion Impact Score
• Identify the pages on your site
whose performance could have the
most impact to the conversion rate
© AKAMAI - EDGE 2017
Relative Activity Impact Score • The best option for sites with a page
visit revenue generation model
• Also excellent for retail sites!
© AKAMAI - EDGE 2017
What is My Return on Investment?
Based on current site visitor behavior and current
site performance, we can try to predict the future
© AKAMAI - EDGE 2017
The What-If Dashboard
© AKAMAI - EDGE 2017
What-If Gives You a Running Start
• Investing in performance,
rather than features or
marketing or other initiatives,
can sometimes be a hard sell
inside organizations
• The data models behind the
What-If Dashboard help
justify an appropriate level of
investment in site
performance
© AKAMAI - EDGE 2017
Real-World Results
© AKAMAI - EDGE 2017
Summary
• Small changes in site performance can impact your
bottom line
• Target the page load time where your conversion rate is
maximized
• Focus on the pages that matter most to your conversion
and revenue
• Leverage real user measurements on your journey to
better results
© AKAMAI - EDGE 2017
Where Do We Go Next?
Continuity Metrics Consistency
© AKAMAI - EDGE 2017
Measuring the Continuous User Experience
• The future of Boomerang and
Akamai mPulse
• Capture Visually Ready and Time
to Interactive
• Capture in-page Interactions
• Framerate data and number of
LongTasks
• Just like with Page Load Time, we
will be able to correlate these to
the business outcome of the site
© AKAMAI - EDGE 2017
No More Anomalies!
Data models for more sophisticated analysis
© AKAMAI - EDGE 2017
The “Eighty Twenty” Rule
“80-90% of the end-user response time is spent on the
frontend. Start there.” – Steve Souders, 2003
“80-90% of the user experience on your web site
happens before the decision to purchase. Start there.”
– Ken Harker, 2017
© AKAMAI - EDGE 2017
© AKAMAI - EDGE 2017
Additional Reading
• Meyer, Marissa. “What Google Knows”. O’Reilly Web 2.0 Conference. 9 November 2006.
• Schurman, Eric and Brutlag, Jake. “The User and Business Impact of Server Delays, Additional
Bytes, and HTTP Chunking in Web Search”. O’Reilly Velocity Conference. 23 June 2009.
• “Just One Second Delay in Page Load Can Cause 7% Loss in Customer Conversions”. Tagman
and Glasses Direct. just-one-second-delay-in-page-load-can-cause-7-loss-in-customer-
conversions/. 2012.
• Crocker, Cliff; Kulick, Aaron; and Ram, Balaji “Real User Monitoring at Walmart”.
https://www.slideshare.net/devonauerswald/walmart-pagespeedslide. 2013.
• “Akamai Reveals 2 Seconds As The New Threshold Of Acceptability For ECommerce Web Page
Response Times”. https://www.akamai.com/us/en/about/news/press/2009-press/akamai-reveals-
2-seconds-as-the-new-threshold-of-acceptability-for-ecommerce-web-page-response-times.jsp. 4
September 2009.
• Jupiter Research. “Retail Web Site Performance: Consumer Reaction to a Poor Online Shopping
Experience.” https://www.akamai.com/us/en/multimedia/documents/report/akamai-site-
abandonment-final-report.pdf. 1 June 2006.

More Related Content

PDF
Forrester: Andy Hoar
PPTX
1. Screen Pages Ecommerce Forum May 2017 - Sarah Willcocks
PDF
MeasureWorks - Emerce eFinancials - Content is King, but Experience is your k...
PDF
[Webcast] The Shift for Driving Search Marketing Success - Part 2
PDF
The Shift For Driving Search Marketing Success [Webcast]
PPTX
7. Defining requirements for your website - Rob Peterkin Screen Pages - Scree...
PPTX
Mastering Flippa.com and Buying Websites in 2013
PPTX
Philadelphia SEO Meetup January 2015: Flippa Case Study:
Forrester: Andy Hoar
1. Screen Pages Ecommerce Forum May 2017 - Sarah Willcocks
MeasureWorks - Emerce eFinancials - Content is King, but Experience is your k...
[Webcast] The Shift for Driving Search Marketing Success - Part 2
The Shift For Driving Search Marketing Success [Webcast]
7. Defining requirements for your website - Rob Peterkin Screen Pages - Scree...
Mastering Flippa.com and Buying Websites in 2013
Philadelphia SEO Meetup January 2015: Flippa Case Study:

What's hot (20)

PPTX
01. Screen Pages latest news
PDF
Saat & Saat case study
PPTX
8. Search Marketing - Dan Richardson Not Just SEO - Screen Pages Ecommerce Fo...
PPTX
[Srijan Wednesday Webinars] Strategies to Convert Your Website Visitors to Leads
PDF
#SpeedMatters Web Performance Impacts on E-commerce
PPTX
Seo for electricians
PPTX
Brisbane Shopify Meetup - 1st December 2016
PPTX
Machine Learning is Much More Than Product Recommendations
PDF
Google Mobile Sites | We Got Certified so You Don't Have To
PPTX
Design For Conversion Part 1
PPTX
Product Optimization: Conversion, Engagement, and Happiness
PPT
Does Your Website Suck
PPTX
Beyond Page Views: Modern Analytics for Online Marketing
PPTX
11 eCommerce CRO Tips to Scale up Your Business Graph
PPTX
SEO Is Dead?
PPTX
Building A Data Driven Website – Taking the Guess Work Out of Your Website
PPTX
Effective Local SEO Strategies
PPTX
404 Moment of Truth -- David Zerlin (WIAD 2015)
PDF
RDA Illawarra How To Build A Website_180616 Kiama Small Business Forum - Slid...
PPTX
Public Webinar on KPIs
01. Screen Pages latest news
Saat & Saat case study
8. Search Marketing - Dan Richardson Not Just SEO - Screen Pages Ecommerce Fo...
[Srijan Wednesday Webinars] Strategies to Convert Your Website Visitors to Leads
#SpeedMatters Web Performance Impacts on E-commerce
Seo for electricians
Brisbane Shopify Meetup - 1st December 2016
Machine Learning is Much More Than Product Recommendations
Google Mobile Sites | We Got Certified so You Don't Have To
Design For Conversion Part 1
Product Optimization: Conversion, Engagement, and Happiness
Does Your Website Suck
Beyond Page Views: Modern Analytics for Online Marketing
11 eCommerce CRO Tips to Scale up Your Business Graph
SEO Is Dead?
Building A Data Driven Website – Taking the Guess Work Out of Your Website
Effective Local SEO Strategies
404 Moment of Truth -- David Zerlin (WIAD 2015)
RDA Illawarra How To Build A Website_180616 Kiama Small Business Forum - Slid...
Public Webinar on KPIs
Ad

Viewers also liked (15)

PPTX
App-solute Testing: Making App Testing with Akamai Easy
PPTX
Leveraging Akamai to Make Your Cloud Transformation Initiatives Successful
PPTX
How BAMTECH Media Delivers 50,000 Live Events via APIs
PPTX
From Development to Deployment - Use Akamai to Facilitate Workflow Automation
PPTX
Ad Monetization Technologies & Advanced Media Workflows
PPTX
Getting Real-Time Middle-Mile Visibility in Your CDN Behavior with DataStream
PPTX
Visualizing Cellular Audience for Streaming KPI's
PPTX
Performance and Scalability with the Application Load Balancer Cloudlet
PPTX
Secure DevOps Workflow at Dell with Enterprise Application Access (EAA)
PPTX
Bot Manager + Cloudlet Strengthen Mitigation Capability
PPTX
PPTX
Cloudlets and DevOps - A Dangerously Powerful Combination to Extend Capabilit...
PPTX
Configs, Configs, Everywhere! (Actually, Let's Simplify All Those Configs)
PPTX
Assessing Your Own Site Configuration
PDF
SlideShare 101
App-solute Testing: Making App Testing with Akamai Easy
Leveraging Akamai to Make Your Cloud Transformation Initiatives Successful
How BAMTECH Media Delivers 50,000 Live Events via APIs
From Development to Deployment - Use Akamai to Facilitate Workflow Automation
Ad Monetization Technologies & Advanced Media Workflows
Getting Real-Time Middle-Mile Visibility in Your CDN Behavior with DataStream
Visualizing Cellular Audience for Streaming KPI's
Performance and Scalability with the Application Load Balancer Cloudlet
Secure DevOps Workflow at Dell with Enterprise Application Access (EAA)
Bot Manager + Cloudlet Strengthen Mitigation Capability
Cloudlets and DevOps - A Dangerously Powerful Combination to Extend Capabilit...
Configs, Configs, Everywhere! (Actually, Let's Simplify All Those Configs)
Assessing Your Own Site Configuration
SlideShare 101
Ad

Similar to Connecting Web Performance to Business Results Using mPulse (20)

PDF
Marketing Analytics Masterclass April 2017
PDF
Optimizing Wordpress for Conversions (WPSF April 2, 2014)
PDF
Why SEO Matters for Financial Institutions: How To Build and Strengthen Your ...
PDF
Clickability Cut Costs Increase Revenue
PDF
Conversion Rate Optimization: Increase Profits Not Just Revenue - Rob Griffin...
PDF
How to Succeed in a Mobile World - Use the Growth of Mobile to Better Serve Y...
PDF
Are You Building a Web App That Works—or One That Wins.pdf
PDF
WEBSITE OPTIMIZATION.pdf
PDF
EzDataMunch_Corporate_Linkedin
PPTX
Startup KPI's, Conversion Rate Optimization and Marketingstack
PDF
EzDataMunch_Corporate_Qlikview2015
PDF
Rally Webinar: Proven Practices to Increase Apply Flow
PDF
eDocument Sciences SaaS 101
PDF
Next Generation Analytics Engine: Web Analytics Demystified
PDF
Conversion Optimization Framework to Build Sustainable and Repeat Growth
PPTX
RezStream Webinar: 5 tell-tale signs on why you need a new website
PPTX
How to Manage Digital User Experience for Web Applications
PDF
Why you need a website? by Proplus Logics Coimbatore
PDF
Web Audit Strategy Proposal Template PowerPoint Presentation Slides
PDF
Designing Web Experiences - Eyecatch
Marketing Analytics Masterclass April 2017
Optimizing Wordpress for Conversions (WPSF April 2, 2014)
Why SEO Matters for Financial Institutions: How To Build and Strengthen Your ...
Clickability Cut Costs Increase Revenue
Conversion Rate Optimization: Increase Profits Not Just Revenue - Rob Griffin...
How to Succeed in a Mobile World - Use the Growth of Mobile to Better Serve Y...
Are You Building a Web App That Works—or One That Wins.pdf
WEBSITE OPTIMIZATION.pdf
EzDataMunch_Corporate_Linkedin
Startup KPI's, Conversion Rate Optimization and Marketingstack
EzDataMunch_Corporate_Qlikview2015
Rally Webinar: Proven Practices to Increase Apply Flow
eDocument Sciences SaaS 101
Next Generation Analytics Engine: Web Analytics Demystified
Conversion Optimization Framework to Build Sustainable and Repeat Growth
RezStream Webinar: 5 tell-tale signs on why you need a new website
How to Manage Digital User Experience for Web Applications
Why you need a website? by Proplus Logics Coimbatore
Web Audit Strategy Proposal Template PowerPoint Presentation Slides
Designing Web Experiences - Eyecatch

More from Akamai Developers & Admins (20)

PDF
Mitigate Security Threats with SIEM
PDF
Manage Your Akamai-as-Code with Terraform
PDF
Akamai-as-Code with The Washington Post
PDF
Set up a Development Environment in 5 Minutes
PDF
AWS re:invent: The secret to building and delivering amazing apps at scale
PDF
AWS re:invent talk: The secrets to building and delivering amazing apps at scale
PDF
10 things you can do at the edge
PDF
How the internet is reshaping our lives
PDF
Velocity + Fluent 2018: API Performance
PDF
Fluent 2018: Measuring What Matters
PDF
Fluent 2018: When third parties stop being polite... and start getting real
PDF
Integrating Security Controls into the Development and Delivery Pipeline
PDF
Automation at the Edge
PDF
Akamai for Dev Ops Current Capabilities - Atlanta DevOps World Tour
PPTX
Getting Started with User and API Management Features
PDF
Akamai Developer General Session
PDF
Akamai Admin General Session
PPTX
EdgeWorkers: Enabling Autonomous, Developer Friendly Programming at the Edge
PDF
Optimizing your API to Perform at Scale
PPTX
Provision Your Own Apple TV channel with MSL 4.x
Mitigate Security Threats with SIEM
Manage Your Akamai-as-Code with Terraform
Akamai-as-Code with The Washington Post
Set up a Development Environment in 5 Minutes
AWS re:invent: The secret to building and delivering amazing apps at scale
AWS re:invent talk: The secrets to building and delivering amazing apps at scale
10 things you can do at the edge
How the internet is reshaping our lives
Velocity + Fluent 2018: API Performance
Fluent 2018: Measuring What Matters
Fluent 2018: When third parties stop being polite... and start getting real
Integrating Security Controls into the Development and Delivery Pipeline
Automation at the Edge
Akamai for Dev Ops Current Capabilities - Atlanta DevOps World Tour
Getting Started with User and API Management Features
Akamai Developer General Session
Akamai Admin General Session
EdgeWorkers: Enabling Autonomous, Developer Friendly Programming at the Edge
Optimizing your API to Perform at Scale
Provision Your Own Apple TV channel with MSL 4.x

Recently uploaded (20)

PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPTX
Cloud computing and distributed systems.
PDF
Machine learning based COVID-19 study performance prediction
PDF
Approach and Philosophy of On baking technology
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
KodekX | Application Modernization Development
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Encapsulation theory and applications.pdf
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
“AI and Expert System Decision Support & Business Intelligence Systems”
MIND Revenue Release Quarter 2 2025 Press Release
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Cloud computing and distributed systems.
Machine learning based COVID-19 study performance prediction
Approach and Philosophy of On baking technology
Review of recent advances in non-invasive hemoglobin estimation
KodekX | Application Modernization Development
Reach Out and Touch Someone: Haptics and Empathic Computing
Network Security Unit 5.pdf for BCA BBA.
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Encapsulation theory and applications.pdf
MYSQL Presentation for SQL database connectivity
Chapter 3 Spatial Domain Image Processing.pdf
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
Diabetes mellitus diagnosis method based random forest with bat algorithm

Connecting Web Performance to Business Results Using mPulse

  • 1. © AKAMAI - EDGE 2017 CONNECTING WEB PERFORMANCE TO BUSINESS RESULTS Enterprise Architect, Web Performance Ken Harker
  • 2. © AKAMAI - EDGE 2017 Agenda • Your Motivation • You Need a Plan • Finding Direction • Setting Targets • Allocating Resources • Expecting Success • Where Do We Go Next?
  • 3. © AKAMAI - EDGE 2017 Users Are Online More Than Ever • Source: eMarketer
  • 4. © AKAMAI - EDGE 2017 Mobile Commerce: 2016 Holidays Just imagine what it could have been if every user had experienced great performance Mobile shopping carts had a 56% abandonment rate – poor performance is one of the top three reasons Source: Slice Intelligence
  • 5. © AKAMAI - EDGE 2017 Being Slow Can Be Worse Than Being Down • Performance affects the user perception of site quality • The effect persists into the future • This is hard to appreciate fully
  • 6. © AKAMAI - EDGE 2017 We Can Silence the Doubters • https://wpostats.com/
  • 7. © AKAMAI - EDGE 2017 Early History • In 2006, Google published a landmark study showing that 500 ms of delay reduced web searches by 25% • In 2009, Bing and Google published joint experiments • 200 ms was enough to measurably change user engagement • 500 ms was all it took to impact revenue
  • 8. © AKAMAI - EDGE 2017 More Recent Published Findings • In 2013, Walmart revealed that every 100 ms improvement in page load time resulted in a 1% increase in revenue • In 2017, Akamai publishes biannual State of Online Retail Performance report • 100 ms delay in website load time can hurt conversion rates by 7%
  • 9. © AKAMAI - EDGE 2017 So You Need a Plan 1. Identify how performance is affecting your business 2. Have justifiable targets 3. Know where to focus your efforts 4. Predict Your Return on Investment Akamai mPulse has the tools you need to execute your plan
  • 10. © AKAMAI - EDGE 2017 Performance Is Not All That Matters To Your Customers ✓ Pricing ✓ Quality ✓ Incentives ✓ Marketing ✓ Ease of Use …but more a responsive web experience is definitely part of the solution …and very small improvements in performance can make a big difference
  • 11. © AKAMAI - EDGE 2017 We Start with Measurements • You need to know where you are starting from • You need to be measuring with accuracy and completeness • You need to be able to monitor your progress • You need to be able to identify success
  • 12. © AKAMAI - EDGE 2017 The Ecosystem of Site Performance Back-End Monitoring the Nuts and Bolts of Your Infrastructure and Application Synthetic Probing for Weakness Web Analytics Categorizing and Understanding Your Site Visitors RUM Revealing the Customer Experience
  • 13. © AKAMAI - EDGE 2017 APM, Synthetic, and Analytics APM • ✗ No insight into overall visitor experience • ✗ Unable to track performance of third-party services Synthetic • ✗ No insight into visitor engagement • ✗ No insight into conversion and revenue Web Analytics • ✗ Light, to no, insights into performance
  • 14. © AKAMAI - EDGE 2017 Real User Measurements • The Good • Ground truth for performance • Covers all variety of site visitors (geography, device, connection) • Captures both performance and business metric data at the same time • The Challenges • Data sets can be extremely large • Data is noisy • Distilling this data into business intelligence can be a challenge
  • 15. © AKAMAI - EDGE 2017 Large Sites Should Use All Four Measurement Systems Only RUM gives us the magic connection between performance and business outcome
  • 16. © AKAMAI - EDGE 2017 Akamai mPulse World’s premier Real User Measurement platform Acquired by Akamai in April 2017
  • 17. © AKAMAI - EDGE 2017 Operational Dashboards • Real-time • Comprehensive • Easy to filter • Customizable • Shareable
  • 18. © AKAMAI - EDGE 2017 Data Science • Analyze large volumes of historical data • Data modeling that can take longer to complete than “real-time” • Powerful correlations and other discovery mechanisms
  • 19. © AKAMAI - EDGE 2017 Triage and Diagnostics • Details on every resource request of every page view • Drill into front- end performance issues
  • 20. © AKAMAI - EDGE 2017 Real-Time Alerts • Of course, you can alert on performance events • You can also alert on business metrics • Conversion Rate drops too low • Too many or too few page views
  • 21. © AKAMAI - EDGE 2017 But What About Business Insights? • How Fast Do I Need To Be? • Where Should I Focus My Limited Human Capital? • What Will My ROI Look Like?
  • 22. © AKAMAI - EDGE 2017 How Fast Do I Need To Be? For a retail site, the answer to “How fast do I need to be?” should be: The performance level at which my conversion and revenue are maximized
  • 23. © AKAMAI - EDGE 2017 What Is Your Maximum Conversion Rate? A key metric of business success, conversion rate is the percentage of user sessions (visits) that result in a purchase during that session on your site Web site performance is almost always going to affect your conversion rate
  • 24. © AKAMAI - EDGE 2017 Every Site is Different, Nothing is Quite the Same Just because an industry study says “2 seconds” does not mean that your site needs to be loading in 2 seconds all the time Not every kind of page is the same Mobile and Desktop can be very different
  • 25. © AKAMAI - EDGE 2017 Desktop vs. Mobile vs. Tablet • Different device types can have radically different conversion behavior • Often, you need to treat each class of visitors separately
  • 26. © AKAMAI - EDGE 2017 Conversion Rate versus Page Load Time • Discover the point of diminishing returns for performance improvement
  • 27. © AKAMAI - EDGE 2017 Break It Down by Page • Not every page on your site will show the same conversion peak
  • 28. © AKAMAI - EDGE 2017 Also Consider Bounce Rate • Show how poor performance is driving potential customers away
  • 29. © AKAMAI - EDGE 2017 Where Should I Focus My Efforts? Even the largest retail sites only have so many developers and testers You cannot optimize everything at the same time Some pages on your site are more important than others
  • 30. © AKAMAI - EDGE 2017 Avoid the Checkout Flow Trap It is tempting to want to focus on the checkout flow as if it is the primary point of abandonment In our experience, this is a mistake Users do not always flow through the site in the same sequence Users often break their shopping across multiple sessions
  • 31. © AKAMAI - EDGE 2017 Find the Links Between Performance and Conversion Focus on the pages that show the highest correlation to user engagement and conversion Almost always, these will be pages prior to the steps where a user has decided to make a purchase
  • 32. © AKAMAI - EDGE 2017 Relative Conversion Impact Score • Identify the pages on your site whose performance could have the most impact to the conversion rate
  • 33. © AKAMAI - EDGE 2017 Relative Activity Impact Score • The best option for sites with a page visit revenue generation model • Also excellent for retail sites!
  • 34. © AKAMAI - EDGE 2017 What is My Return on Investment? Based on current site visitor behavior and current site performance, we can try to predict the future
  • 35. © AKAMAI - EDGE 2017 The What-If Dashboard
  • 36. © AKAMAI - EDGE 2017 What-If Gives You a Running Start • Investing in performance, rather than features or marketing or other initiatives, can sometimes be a hard sell inside organizations • The data models behind the What-If Dashboard help justify an appropriate level of investment in site performance
  • 37. © AKAMAI - EDGE 2017 Real-World Results
  • 38. © AKAMAI - EDGE 2017 Summary • Small changes in site performance can impact your bottom line • Target the page load time where your conversion rate is maximized • Focus on the pages that matter most to your conversion and revenue • Leverage real user measurements on your journey to better results
  • 39. © AKAMAI - EDGE 2017 Where Do We Go Next? Continuity Metrics Consistency
  • 40. © AKAMAI - EDGE 2017 Measuring the Continuous User Experience • The future of Boomerang and Akamai mPulse • Capture Visually Ready and Time to Interactive • Capture in-page Interactions • Framerate data and number of LongTasks • Just like with Page Load Time, we will be able to correlate these to the business outcome of the site
  • 41. © AKAMAI - EDGE 2017 No More Anomalies! Data models for more sophisticated analysis
  • 42. © AKAMAI - EDGE 2017 The “Eighty Twenty” Rule “80-90% of the end-user response time is spent on the frontend. Start there.” – Steve Souders, 2003 “80-90% of the user experience on your web site happens before the decision to purchase. Start there.” – Ken Harker, 2017
  • 43. © AKAMAI - EDGE 2017
  • 44. © AKAMAI - EDGE 2017 Additional Reading • Meyer, Marissa. “What Google Knows”. O’Reilly Web 2.0 Conference. 9 November 2006. • Schurman, Eric and Brutlag, Jake. “The User and Business Impact of Server Delays, Additional Bytes, and HTTP Chunking in Web Search”. O’Reilly Velocity Conference. 23 June 2009. • “Just One Second Delay in Page Load Can Cause 7% Loss in Customer Conversions”. Tagman and Glasses Direct. just-one-second-delay-in-page-load-can-cause-7-loss-in-customer- conversions/. 2012. • Crocker, Cliff; Kulick, Aaron; and Ram, Balaji “Real User Monitoring at Walmart”. https://www.slideshare.net/devonauerswald/walmart-pagespeedslide. 2013. • “Akamai Reveals 2 Seconds As The New Threshold Of Acceptability For ECommerce Web Page Response Times”. https://www.akamai.com/us/en/about/news/press/2009-press/akamai-reveals- 2-seconds-as-the-new-threshold-of-acceptability-for-ecommerce-web-page-response-times.jsp. 4 September 2009. • Jupiter Research. “Retail Web Site Performance: Consumer Reaction to a Poor Online Shopping Experience.” https://www.akamai.com/us/en/multimedia/documents/report/akamai-site- abandonment-final-report.pdf. 1 June 2006.