SlideShare a Scribd company logo
Panel: Technical SEO
Patrick Stox
Product Advisor,
Technical SEO, & Brand
Ambassador at Ahrefs
What I learned from
auditing over
1,000,000 websites
Who Is Patrick Stox?
Product Advisor & Technical SEO @ Ahrefs
Writing
•Ahrefs SEO book
•Ahrefs blog, SEL
•SEO Chapter of the Web Almanac 2021
•Technical Review Editor of the Art of SEO
4th edition
Community
•Founded a Technical SEO slack group
•/r/TechSEO moderator on Reddit
•Organize Raleigh SEO Meetup, Raleigh
SEO Conference, Beer & SEO
•Defined the role of SEO for the US
Department of Labor
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
Entire deck on Hreflang
issues with insights.
https://speakerdeck.com/pa
trickstox/hreflang-study-
and-interesting-issues-
brighton-seo-2023-patrick-
Full Data
http://bit.ly/ahrefs-site-audit-
study
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
Broken Pages
4XX page 44.082
404 page 40.555
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
How many hits?
How many links?
Redirect if you can
Free full-text matching
redirect script
https://colab.research.googl
e.com/drive/18lMkaRHK__e
NM6m5FpoyhGDlDAYr3a6P
?usp=sharing
Server Issues
● 5XX page 8.482%
● 500 page 5.001%
● Timed out 12.579%
Did traffic drop?
Are pages still indexed?
Redirects
● 3XX redirect 95.183%
● 302 redirect 25.576%
● Meta refresh redirect 1.763%
Meta refresh redirects are more
common than I thought.
Permanent Redirects
● HTTP 301
● HTTP 308
● Meta refresh 0
● HTTP refresh 0
● JavaScript location
● Crypto redirect
Temporary Redirects (weak signal
forward)
● HTTP 302
● HTTP 303
● HTTP 307 (server side, not the
browser cached one)
● Meta refresh >0
● HTTP refresh >0
Temporary Redirects (at some point)
Keep redirects at
least 1 year
Redirects
● HTTP to HTTPS redirect
88.001%
● HTTPS to HTTP redirect
6.153%
>6% is crazy high for people
redirecting HTTPS to HTTP
Redirects
● Broken redirect12.662%
Redirects
● Redirect chain 45.193%
● Redirect chain too long 0.114%
Google will follow up to 10 hops.
I don’t worry til >5 hops.
Redirects
● Redirect loop 2.162%
Wastes a lot of resources.
Mixed Content
● HTTPS/HTTP mixed
content 13.342%
Content Security Policy
(CSP)
upgrade-insecure-requests
In .htaccess:
<ifModule mod_headers.c>
Header always set Content-Security-
Policy "upgrade-insecure-requests;"
</IfModule>
Indexability
● Noindex 49.719%
Noindex in HTML and HTTP
header 5.776%
Intentional = fine
Unintentional = bad
Nofollow
● Nofollow page 26.34%
● Nofollow in HTML and
HTTP header 0.096%
Nofollows all links, including
internal links.
I’d rarely use this. Maybe on
UGC pages.
Canonicals
● Canonical from HTTP
to HTTPS 3.464%
● Canonical from HTTPS
to HTTP 2.079%
Canonicals
● Canonical points to
redirect 5.877%
These will likely get
followed.
Look at what version is
indexed.
Canonicals
● Canonical points to
4XX 2.598%
Likely ignored.
Canonicals
● Non-canonical page
specified as canonical
one 1.362%
Links (Indexable)
● Page has links to
redirect 62.719%
As long as they resolve, it’s
okay.
Clean up when you get a
chance, but not a big deal.
Links (Indexable)
● Orphan page (has no incoming
internal links) 49.905%
● Page has only one dofollow
incoming internal link
44.397%
These pages aren’t likely
important.
If you didn’t link to them,
how much do you really
care?
Links (Indexable)
● Page has links to
broken page
36.195%
Clean up for UX.
Links (Indexable)
● Page has nofollow outgoing
internal links 26.69%
● Page has nofollow incoming
internal links only 6.218%
Don’t nofollow internal links.
Links (Indexable)
● HTTPS page has internal
links to HTTP 20.536%
Okay-ish if they redirect.
Links (Indexable)
● HTTP page has internal
links to HTTPS 3.427%
Redirect to HTTPS.
Links Not Indexable
● Page has links to redirect
62.719%
● Orphan page (has no incoming
internal links) 49.905%
● +more
Impact is really more on UX.
Shouldn’t have any impact
on traffic or rankings.
Content Indexable
● Meta description tag missing
or empty 72.926%
● Title tag missing or empty
5.545%
Content Indexable
● Title too long 63.193%
● Meta description too short
59.242%
● Meta description too long
54.455%
● Title too short 32.758%
¯_(ツ)_/¯
Google will write titles and
descriptions for you.
Only worry if the pages get
lots of traffic or you think
they’re important.
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
Content Indexable
● Page and SERP titles
do not match
68.537%
Script to see which titles
were the most changed.
https://colab.research.googl
e.com/drive/1mg3DTWVkgX
0KHD3Hx2Y3WyMAUDjdm3
cB?usp=sharing
Content Indexable
● H1 tag missing or empty59.503%
Usually a quick fix so I’d do
it, but not that important.
Text size is likely more
important.
Content Indexable
● Multiple H1 tags 51.254%
Allowed in HTML5.
Content Indexable
● Low word count 18.208%
Who is the president of
Bulgaria?
You don’t need 1500 words
to answer that!
Content Indexable
● Multiple meta description tags
3.562%
● Multiple title tags 3.036%
Combined into 1 for
indexing in Google.
Content Not
Indexable
● Meta description tag missing
or empty 72.926%
● Title too long 63.193%
● +More
It’s not indexable, don’t
worry about it.
Duplicates
● Duplicate pages without
canonical 15.698%
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
Google is pretty good at
figuring this out.
Performance
● Pages with poor CLS
0.292%
● Pages with poor LCP
0.249%
● Pages with poor FID 0.018%
Add PageSpeed Insights to
your audits to get CWV (field
data) and Lighthouse (lab
data) at scale
What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox
Images
● Missing alt text80.401%
Accessibility issue.
Potential legal issue.
Alt text counts as normal
text on the page.
Images
● Image file size too large
27.25%
Compress your images.
Images
● Image broken 15.42%
● Page has broken image
15.42%
Fix broken ones on
important pages.
Images
● Page has redirected image
9.142%
● Image redirects 8.961%
Low priority as long as they
work.
Images
● HTTPS page links to
HTTP image
12.328%
Content Security Policy
(CSP)
upgrade-insecure-requests
JavaScript
● JavaScript broken 4.823%
● Page has broken JavaScript
4.822%
Potential UX and
functionality issues.
It may even prevent your
content from being seen.
JavaScript
● Page has redirected JavaScript
2.644%
● JavaScript redirects2.626%
Fine as long as it still works.
Clean up if you can, but I
wouldn’t prioritize this.
JavaScript
● HTTPS page links to HTTP
JavaScript 1.663%
Content Security Policy
(CSP)
upgrade-insecure-requests
CSS
● CSS broken 4.25%
● Page has broken CSS 4.25%
Potential UX issues.
CSS
● CSS redirects 1.276%
CSS
● HTTPS page links to
HTTP CSS 1.063%
Content Security Policy
(CSP)
upgrade-insecure-requests
Sitemaps
● 3XX redirect in sitemap
22.838%
● Non-canonical page in sitemap
12.107%
● Noindex page in sitemap
11.602%
Pages in sitemaps are a
canonicalization signal.
They should all be 200s and
the canonical.
Automate your sitemaps.
If manual, I don’t bother.
Sitemaps
Sitemap larger 50MB #N/A
Sitemap with over 50K URLs
#N/A
Sitemap in the wrong format
#N/A
These can keep your
sitemap from being
processed.
IndexNow is better imo.
● Faster
● More than just 200s
● Data protection
● <lastmod> is unreliable
● Broader distribution
Real-time monitoring
coming to Ahrefs, w/
IndexNow
External Pages
● External 3XX redirect
17.252%
Helping another site. I
wouldn’t prioritize this.
External Pages
● External 4XX 9.2%
● External 5XX 4.988%
● External time out 3.688%
Potential UX issue.
Other
● Double slash in URL11.078%
Lots more sites than
expected.
Ignored by browsers and
search engines.
Other
● More than three parameters
in URL8.067%
May indicate bloat.
Other
● Non-canonical page receives
organic traffic 6.55%
● 3XX page receives organic
traffic 6.139%
One page or the other will
rank.
Don’t worry about it unless
you have a specific
preference.
Other
● 4XX page receives
organic traffic 2.141%
● Noindex page receives
organic traffic 0.636%
Recent?
Blocked by robots.txt?
Do Care About
● Not indexed but should be
● Redirect 404 pages w/ links
● Internal linking
● Anything else that’s important
but not working
Thank You!
Try Ahrefs Site Auditor Free
ahrefs.com/awt

More Related Content

PPTX
SEO Gap Analysis: Leverage Your Competitors' Performance - WTSFest 2022
PDF
Developing Technical SEO Skills - Brighton SEO Sept 2021
PDF
[BrightonSEO October 2022] On-page SEO: from intention to conversion
PPTX
TechSEO Boost - Apps script for SEOs
PDF
Beyond blue links: the evolution of search intent and discoverability
PDF
Beyond the Basics – 5 Google Business Profile elements you might not know abo...
PPTX
Fear and Loathing Google in Las Vegas - Lily Ray SEO Presentation 2024
PDF
[LondonSEO 2020] BigQuery & SQL for SEOs
SEO Gap Analysis: Leverage Your Competitors' Performance - WTSFest 2022
Developing Technical SEO Skills - Brighton SEO Sept 2021
[BrightonSEO October 2022] On-page SEO: from intention to conversion
TechSEO Boost - Apps script for SEOs
Beyond blue links: the evolution of search intent and discoverability
Beyond the Basics – 5 Google Business Profile elements you might not know abo...
Fear and Loathing Google in Las Vegas - Lily Ray SEO Presentation 2024
[LondonSEO 2020] BigQuery & SQL for SEOs

What's hot (20)

PDF
How to construct your own SEO a b split tests (for free) - BrightonSEO July 2021
PPTX
BrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
PPTX
Semantic Publishing and Entity SEO - Conteference 20-11-2022
PDF
A Simple method to Create Content using NLP
PPTX
Search Query Processing: The Secret Life of Queries, Parsing, Rewriting & SEO
PDF
The Worst SEO Issues of Online Stores in 2022 & How to Fix Them #YoastCon2022
PPTX
How to leverage indexation tracking to monitor issues and improve performance
PDF
Quality Content at Scale Through Automated Text Summarization of UGC
PDF
Everything You Didn't Know About Entity SEO
PPTX
From knowledge graph to commonsense knowledge graph brighton seo
PDF
How to control googlebot
PDF
BrightonSEO Oct 2022 Similar_ai.pdf
PPTX
The Quickest Win in SEO – How to do Internal Linking the Right Way
PPTX
BrightonSEO: How to generate 8 million SEO test ideas - Will Critchlow
PPTX
The Full Scoop on Google's Title Rewrites
PPTX
The Big SEO Migration - Learnings from a first time hiker
PDF
The Value of Featured Snippets (BrightonSEO 2023).pdf
PDF
SEO at Scale - BrightonSEO April 2022
PPTX
Diginius - DuckDuckGo, Privacy and the Future of Search
PDF
BrightonSEO October 2022 - Martijn Scheybeler - SEO Testing: Find Out What Wo...
How to construct your own SEO a b split tests (for free) - BrightonSEO July 2021
BrightonSEO - Master Crawl Budget Optimization for Enterprise Websites
Semantic Publishing and Entity SEO - Conteference 20-11-2022
A Simple method to Create Content using NLP
Search Query Processing: The Secret Life of Queries, Parsing, Rewriting & SEO
The Worst SEO Issues of Online Stores in 2022 & How to Fix Them #YoastCon2022
How to leverage indexation tracking to monitor issues and improve performance
Quality Content at Scale Through Automated Text Summarization of UGC
Everything You Didn't Know About Entity SEO
From knowledge graph to commonsense knowledge graph brighton seo
How to control googlebot
BrightonSEO Oct 2022 Similar_ai.pdf
The Quickest Win in SEO – How to do Internal Linking the Right Way
BrightonSEO: How to generate 8 million SEO test ideas - Will Critchlow
The Full Scoop on Google's Title Rewrites
The Big SEO Migration - Learnings from a first time hiker
The Value of Featured Snippets (BrightonSEO 2023).pdf
SEO at Scale - BrightonSEO April 2022
Diginius - DuckDuckGo, Privacy and the Future of Search
BrightonSEO October 2022 - Martijn Scheybeler - SEO Testing: Find Out What Wo...
Ad

Similar to What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox (20)

PPTX
A Crash Course in Technical SEO from Patrick Stox - Beer & SEO Meetup May 2019
PDF
Prioritising Impactful SEO Tasks
PDF
How to do a SEO Site Audit
PPT
Diagnosing Technical Issues With Search Engine Optimization
PPTX
Troubleshooting Technical SEO Problems - Patrick Stox - Raleigh SEO Meetup
PDF
Technical SEO Checklist for Beginners
PPTX
Technical SEO FTW!
PDF
SEO for developers in e-commerce business
PPTX
eGrove Systems Corporation - PrestaShop Development Services
PDF
Technical SEO for MODX CMS (MODXpo 2017)
PDF
Technical SEO.pdf
PPTX
SEO Surgery APAC #1
PDF
Technial SEO
PDF
BrightonSEO 2017 - SEO quick wins from a technical check
PDF
How Developers Can Make A Website SEO Friendly
PDF
How to Enhance Your SEO When Redesigning an Ecommerce Website - Tarun Gehani,...
PDF
SEO for Developers
 
PPTX
Website Migrations at SMX Munich 2019 - Patrick Stox
PPTX
Screaming Frog: Little-Known Features In The SEO Spider
PPTX
Website Audit [On Page and Off Page] by Carl Benedic Pantaleon
 
A Crash Course in Technical SEO from Patrick Stox - Beer & SEO Meetup May 2019
Prioritising Impactful SEO Tasks
How to do a SEO Site Audit
Diagnosing Technical Issues With Search Engine Optimization
Troubleshooting Technical SEO Problems - Patrick Stox - Raleigh SEO Meetup
Technical SEO Checklist for Beginners
Technical SEO FTW!
SEO for developers in e-commerce business
eGrove Systems Corporation - PrestaShop Development Services
Technical SEO for MODX CMS (MODXpo 2017)
Technical SEO.pdf
SEO Surgery APAC #1
Technial SEO
BrightonSEO 2017 - SEO quick wins from a technical check
How Developers Can Make A Website SEO Friendly
How to Enhance Your SEO When Redesigning an Ecommerce Website - Tarun Gehani,...
SEO for Developers
 
Website Migrations at SMX Munich 2019 - Patrick Stox
Screaming Frog: Little-Known Features In The SEO Spider
Website Audit [On Page and Off Page] by Carl Benedic Pantaleon
 
Ad

More from Ahrefs (20)

PDF
What's new at Ahrefs [end of 2023]
 
PPTX
10 quick wins to improve your rankings using Ahrefs.pptx
 
PPTX
Canonicalization for SEO BrightonSEO April 2023 Patrick Stox
 
PPTX
How Search Works
 
PPTX
The Elusive ROI of Content Marketing (by Tim Soulo)
 
PPTX
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
 
PDF
Why Scaling (Great) Content Is So Bloody Hard
 
PPTX
What's Next for Page Experience - SMX Next 2021 - Patrick Stox
 
PPTX
Google's Search Signals For Page Experience - SMX Advanced 2021 Patrick Stox
 
PPTX
Most Valuable SEO Presentation - Advanced Search Summit - DMO Advanced 2021 -...
 
PDF
SEO Data Mythbusting - Are You Analyzing the Right Data?
 
PPTX
Local Link Building - Pubcon Local 2021 - Patrick Stox
 
PPTX
How to find other affiliates most successful content TPAS Patrick Stox Ahrefs
 
PPTX
Nofollow UGC Sponsored SEOFromHome Patrick Stox Ahrefs
 
PPTX
Data Visualization for SEO
 
PPTX
Nofollow, UGC, and Sponsored Attributes
 
PDF
Blogging for Business: How to Build a Million Dollar Business With One Article
 
PPTX
Advanced Ways to Use Ahrefs (That You Didn't Know About)
 
PDF
11 Things That ONLY Ahrefs Can Do
 
PDF
What you need to know about backlinks in 2019
 
What's new at Ahrefs [end of 2023]
 
10 quick wins to improve your rankings using Ahrefs.pptx
 
Canonicalization for SEO BrightonSEO April 2023 Patrick Stox
 
How Search Works
 
The Elusive ROI of Content Marketing (by Tim Soulo)
 
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
 
Why Scaling (Great) Content Is So Bloody Hard
 
What's Next for Page Experience - SMX Next 2021 - Patrick Stox
 
Google's Search Signals For Page Experience - SMX Advanced 2021 Patrick Stox
 
Most Valuable SEO Presentation - Advanced Search Summit - DMO Advanced 2021 -...
 
SEO Data Mythbusting - Are You Analyzing the Right Data?
 
Local Link Building - Pubcon Local 2021 - Patrick Stox
 
How to find other affiliates most successful content TPAS Patrick Stox Ahrefs
 
Nofollow UGC Sponsored SEOFromHome Patrick Stox Ahrefs
 
Data Visualization for SEO
 
Nofollow, UGC, and Sponsored Attributes
 
Blogging for Business: How to Build a Million Dollar Business With One Article
 
Advanced Ways to Use Ahrefs (That You Didn't Know About)
 
11 Things That ONLY Ahrefs Can Do
 
What you need to know about backlinks in 2019
 

Recently uploaded (20)

PPTX
Amazon - STRATEGIC.......................pptx
PDF
UNIT 2 - 5 DISTRIBUTION IN RURAL MARKETS.pdf
DOCX
AL-ahly Sabbour un official strategic plan.docx
PDF
Ramjilal Ramsaroop || Trending Branding
PDF
Mastering Content Strategy in 2025 ss.pdf
PDF
Prove and Prioritize Profitability in Every Marketing Campaign - Zach Sherrod...
PPTX
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
PDF
Fly Emirates SEO case study by Rakesh pathak.pdf
PDF
Future Retail Disruption Trends and Observations
PDF
PPTX
Solomon_Chapter 6_The Self: Mind, Gender, and Body.pptx
PDF
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
PDF
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
PPTX
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
PDF
Building a strong social media presence.
PDF
Proven AI Visibility: From SEO Strategy To GEO Tactics
PPTX
Your score increases as you pick a category, fill out a long description and ...
DOCX
Parkville marketing plan .......MR.docx
PPTX
The evolution of the internet - its impacts on consumers
PPTX
Final Project parkville.............pptx
Amazon - STRATEGIC.......................pptx
UNIT 2 - 5 DISTRIBUTION IN RURAL MARKETS.pdf
AL-ahly Sabbour un official strategic plan.docx
Ramjilal Ramsaroop || Trending Branding
Mastering Content Strategy in 2025 ss.pdf
Prove and Prioritize Profitability in Every Marketing Campaign - Zach Sherrod...
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
Fly Emirates SEO case study by Rakesh pathak.pdf
Future Retail Disruption Trends and Observations
Solomon_Chapter 6_The Self: Mind, Gender, and Body.pptx
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
Unit 1 -2 THE 4 As of RURAL MARKETING MIX.pdf
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
Building a strong social media presence.
Proven AI Visibility: From SEO Strategy To GEO Tactics
Your score increases as you pick a category, fill out a long description and ...
Parkville marketing plan .......MR.docx
The evolution of the internet - its impacts on consumers
Final Project parkville.............pptx

What I learned from auditing over 1,000,000 websites - SERP Conf 2024 Patrick Stox