SlideShare a Scribd company logo
Improve Crawling and
Indexing with
User-Friendly
Log File Insights
Slideshare.Net/Stevenvvessum
@STEVENVVESSUM
Steven van Vessum
Conductor
Steven van Vessum
Director of Organic Marketing at Conductor
Previously:
Co-founder & VP of Community at ContentKing
Title Slide Option
3
Real-Time SEO Auditing & Monitoring
About
#brightonSEO
4
Real-Time SEO Auditing & Monitoring
About
#brightonSEO
5
Technical SEO is the
Foundation of Successful
Organic Marketing
Technical SEO
Technical
Ensure discoverability
Content
Address customer needs
Insights
Optimize performance
Action
Move faster
About
#brightonSEO
Let’s be honest…
We’re all having issues
getting content indexed.
Possible
reasons…
● The web is growing
faster than ever.
● The rise of AI
generated content.
Photo by the
awesome Lily
Ray from
Amsive Digital
Possible
reasons…
Crawling, rendering,
indexing, storing and
serving content is
expensive.
Possible
reasons…
● Google’s has been
raising the “content
quality bar” over the
last few years.
● Helpful Content
Update in August
2022.
Tough shit? 💩
The Issues We See
at Companies
The issue we
see at
companies
They just ship an X
amount of content
pieces a month.
The issue we
see at
companies
They don’t reflect on
the work they’ve done.
The issue we
see at
companies
They don’t understand
and can’t explain
obvious search engine
behavior.
How Companies
Get Better
Enablement Companies need
easy access to
log file insights.
Thinking
critically and
getting
answers
● Has Google crawled
these pages yet?
● Has Google tried
crawling pages
while they had
issues?
● How often do my
pages get recrawled
on average?
● Has Google
reindexed the pages
we updated?
Thinking
critically and
getting
answers
With these
answers, they
can….
● Improve time to
crawl
● Improve time to
index
● Improve time to
rank
● Improve time to
traffic
● SEO forecast
With these
answers, they
can….
By providing easy access
to log file insights….
You’ll make SEO
accessible.
You’ll make SEO fun.
You’ll get buy-in from
management.
Log files
What are
log files?
● Text files containing
records of all the
requests a server
has received from
both humans and
crawlers.
● Its responses to
these requests.
Why Are Logs
Important to SEO?
Logs show crawlers’
true behavior
Log File Analysis As
We Know It
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
Log file analysis
as we know it Inefficient and time
consuming.
Often only performed
once a year.
Log file analysis
as we know it
Insights are kept
within silos.
Log file analysis
as we know it
I get it though.
But we NEED
to do better
(and we can)
Our Dream
● Log data is
available in
real-time.
● Insights are
automatically
distilled.
It would be
amazing if….
It would be
amazing if….
● Made easily
accessible for
web and
content teams.
Getting Your Hands
on Logs
Is….tricky
● Access logs aren’t
there (anymore).
● PII concerns.
Is….tricky
● Office politics.
● Slow processes.
Enter CDN logs
● Real-Time
● Plug ‘n Play
Connecting to
Content Inventory
Connect log
insights to
content
inventory
● Coupled to
content
● Results in
enlightenment
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf
Improving Crawling
& Indexing
New Pages How long does it take
for search engines to
crawl new pages?
New Pages Can you speed up
time to crawl
with better content
promotion?
New Pages Can you speed up time
to crawl with better
internal linking?
New Pages Is there a correlation
between
crawl frequency and
internal links?
New Pages Is there a correlation
between
crawl frequency and
internal links?
Move away from
manually parsing raw
logs to automatically
extracted insights.
Updated Pages Has Google already
picked up my
improvements?
Updated Pages How soon does Google
refresh pages after
making updates?
Updated Pages Is there increased crawl
activity after making
changes?
A timeline with
changes and whether
they were seen by
search engines.
Robots.txt Has Google recrawled
the new robots.txt
directives?
Robots.txt Has Google tried
requesting the
robots.txt while it had a
Disallow: /
Learn what search
engines know.
XML Sitemap Has Google recrawled
my XML sitemap after it
was updated?
XML Sitemap How frequently does
Google crawl my oldest
XML sitemaps?
Learn what content
search engines know
about.
Recap
Logs are important
to SEO
Lots of companies
underperform without insights
from logs
Distilling actionable insights
from logs is time-consuming
and hard
Making insights easily
accessible across teams
is hard
Getting your hands
on logs is hard
Connecting
insights to content
inventory is hard
Enter CDN logs.
(With ContentKing)
Learn how
your work moves
the needle
And keep sharpening
your blade.
Shout!
Questions, comments, ideas…
FREE 45-day Trial
Experience Real-Time Log File Analysis yourself.
Improve your SEO game in under 20 seconds.
contentkingapp.com/brightonseo

More Related Content

PPTX
What we can learn from losing SEO tests
PDF
Improving Crawling and Indexing using Real-Time Log File Insights
PDF
The Ultimate Maturity Audit _ Brighton SEO.pdf
PPTX
Holistic Search - Developing An Organic First Strategy
PPTX
How to leverage indexation tracking to monitor issues and improve performance
PPTX
Creating An Inclusive Web
PDF
Networking for SEOs (and why it matters)
PDF
How to Create an Airtight SEO Strategy to Beat Any Competitor - Rumble Romagnoli
What we can learn from losing SEO tests
Improving Crawling and Indexing using Real-Time Log File Insights
The Ultimate Maturity Audit _ Brighton SEO.pdf
Holistic Search - Developing An Organic First Strategy
How to leverage indexation tracking to monitor issues and improve performance
Creating An Inclusive Web
Networking for SEOs (and why it matters)
How to Create an Airtight SEO Strategy to Beat Any Competitor - Rumble Romagnoli

What's hot (20)

PDF
How to control googlebot
PPTX
Shining a light on the dark funnel
PPTX
I Am A Donut - How To Avoid International SEO Mistakes
PDF
How to get more traffic with less content - BrightonSEO
PPTX
Can you trust AI with your content?
PDF
Core Web Vitals Audit - Sophie Gibson - PDF - BrightonSEO.pdf
PPTX
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
PDF
Agile SEO: Prioritise SEO Activities with Cadence and Risk Radius
PDF
Creating Search Quality Algorithms - Richard Lawrence - BrightonSEO.pdf
PDF
BrightonSEO slide deck Oct 2022 - Levi Williams-Clucas - Review Generation an...
PDF
Probabilistic Thinking in SEO - BrightonSEO October 2022
PDF
[BrightonSEO Oct 2022] Remarketing SEO - Himani Kankaria - Missive Digital.pdf
PDF
BrightonSEO-Pres.pdf
PPTX
Lucy Dodds - BrightonSEO Autumn 22
PPTX
How SEO changes, as we say bye bye to cookies
PDF
BrightonSEO October 2022 - Martijn Scheybeler - SEO Testing: Find Out What Wo...
PPTX
Monet BrightonSEO Slides 2022
PPTX
How to create content that generates leads -- not just traffic.pptx
PDF
How to produce great multilingual content, even when you can't read it | Laur...
PPTX
BrightonSEO - NLP for SEOs - How to optimise your content for BERT.pptx
How to control googlebot
Shining a light on the dark funnel
I Am A Donut - How To Avoid International SEO Mistakes
How to get more traffic with less content - BrightonSEO
Can you trust AI with your content?
Core Web Vitals Audit - Sophie Gibson - PDF - BrightonSEO.pdf
Machine Learning use cases for Technical SEO Automation Brighton SEO Patrick ...
Agile SEO: Prioritise SEO Activities with Cadence and Risk Radius
Creating Search Quality Algorithms - Richard Lawrence - BrightonSEO.pdf
BrightonSEO slide deck Oct 2022 - Levi Williams-Clucas - Review Generation an...
Probabilistic Thinking in SEO - BrightonSEO October 2022
[BrightonSEO Oct 2022] Remarketing SEO - Himani Kankaria - Missive Digital.pdf
BrightonSEO-Pres.pdf
Lucy Dodds - BrightonSEO Autumn 22
How SEO changes, as we say bye bye to cookies
BrightonSEO October 2022 - Martijn Scheybeler - SEO Testing: Find Out What Wo...
Monet BrightonSEO Slides 2022
How to create content that generates leads -- not just traffic.pptx
How to produce great multilingual content, even when you can't read it | Laur...
BrightonSEO - NLP for SEOs - How to optimise your content for BERT.pptx
Ad

Similar to BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf (20)

PDF
Get Content Crawled & Ranked Faster: 5 Tips From An SEO Expert
PPTX
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
PPTX
SEO Server Log File Analysis - What You Should Be Looking For - Tea-Time SEO ...
PDF
Log File Analysis: The most powerful tool in your SEO toolkit
PPTX
Technical SEO explain by Akramujjaman Mridha
PDF
Advanced data-driven technical SEO - SMX London 2019
PDF
Log analysis and pro use cases for search marketers online version (1)
PDF
SEO for Large/Enterprise Websites - Data & Tech Side
PDF
Webmaster tools (ICMK485)
DOCX
Read This FirstAnnielytics.com@AnnieCushingNOTES ABOUT THIS WORKBO.docx
PDF
Sustainable growth with the Continuous SEO Process
PPTX
SearchLove Boston 2017 | Dom Woodman | How to Get Insight From Your Logs
PDF
How to do a SEO Site Audit
PDF
Keeping Things Lean & Mean: Crawl Optimisation - Search Marketing Summit AU
PDF
SEO 101: How to Get Started Winning Google Search Traffic
PPTX
Website Audit [On Page and Off Page] by Carl Benedic Pantaleon
PPTX
Search Engine Optimization, SEO Audits, and Analytics
PPTX
SEO for Large Websites
PPTX
SEO Auditing Like a Pro by Zachary Russell
PDF
Modern SEO Players Guide
Get Content Crawled & Ranked Faster: 5 Tips From An SEO Expert
BrightonSEO 5 Critical Questions Your Log Files Can Answer September 2016
SEO Server Log File Analysis - What You Should Be Looking For - Tea-Time SEO ...
Log File Analysis: The most powerful tool in your SEO toolkit
Technical SEO explain by Akramujjaman Mridha
Advanced data-driven technical SEO - SMX London 2019
Log analysis and pro use cases for search marketers online version (1)
SEO for Large/Enterprise Websites - Data & Tech Side
Webmaster tools (ICMK485)
Read This FirstAnnielytics.com@AnnieCushingNOTES ABOUT THIS WORKBO.docx
Sustainable growth with the Continuous SEO Process
SearchLove Boston 2017 | Dom Woodman | How to Get Insight From Your Logs
How to do a SEO Site Audit
Keeping Things Lean & Mean: Crawl Optimisation - Search Marketing Summit AU
SEO 101: How to Get Started Winning Google Search Traffic
Website Audit [On Page and Off Page] by Carl Benedic Pantaleon
Search Engine Optimization, SEO Audits, and Analytics
SEO for Large Websites
SEO Auditing Like a Pro by Zachary Russell
Modern SEO Players Guide
Ad

More from Steven van Vessum (8)

PDF
SEO Quality Assurance: Just How Needed Is It? 1,300 SEOs Respond — brightonSE...
PDF
SEO Quality Assurance: Just How Needed Is It? 1,300 SEOs respond
PDF
International SEO: Beating Big Brands by Picking Fights You Can Win
PDF
ContentKing - Digital Olympus - SEO Disasters
PDF
[DUTCH] ContentKing - SEO Benelux - eCommerce SEO fails
PDF
Doing SEO in The Netherlands - SEOloger October 2017
PDF
The Continuous SEO Process (WebExpo, September 2016)
PDF
SEOloger - December 2016
SEO Quality Assurance: Just How Needed Is It? 1,300 SEOs Respond — brightonSE...
SEO Quality Assurance: Just How Needed Is It? 1,300 SEOs respond
International SEO: Beating Big Brands by Picking Fights You Can Win
ContentKing - Digital Olympus - SEO Disasters
[DUTCH] ContentKing - SEO Benelux - eCommerce SEO fails
Doing SEO in The Netherlands - SEOloger October 2017
The Continuous SEO Process (WebExpo, September 2016)
SEOloger - December 2016

Recently uploaded (20)

PDF
How the Minnesota Vikings Used Community to Drive 170% Growth and Acquire 34K...
PDF
Building a strong social media presence.
PDF
MARG’s Door & Window Hardware Catalogue | Trending Branding Digital Solutions
PPTX
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
PDF
Coleção Nature .
PPTX
Best Digital marketing service provider in Chandigarh.pptx
PDF
Hidden gems in Microsoft ads with Navah Hopkins
PDF
How a Travel Company Can Implement Content Marketing
PPTX
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
PPTX
Your score increases as you pick a category, fill out a long description and ...
PDF
AI & Automation: The Future of Marketing or the End of Creativity - Eric Ritt...
PDF
Fly Emirates SEO case study by Rakesh pathak.pdf
PPTX
Final Project parkville.............pptx
PPTX
PRINCIPLES OF MANAGEMENT and functions (1).pptx
PDF
AI & Automation: The Future of Marketing or the End of Creativity - Matthew W...
PPTX
Assignment 2 Task 1 - How Consumers Use Technology and Its Impact on Their Lives
PDF
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
PPTX
Solomon_Chapter 6_The Self: Mind, Gender, and Body.pptx
PDF
Mastering Content Strategy in 2025 ss.pdf
PPTX
Mastering eCommerce SEO: Strategies to Boost Traffic and Maximize Conversions
How the Minnesota Vikings Used Community to Drive 170% Growth and Acquire 34K...
Building a strong social media presence.
MARG’s Door & Window Hardware Catalogue | Trending Branding Digital Solutions
Kimberly Crossland Storytelling Marketing Class 5stars.pptx
Coleção Nature .
Best Digital marketing service provider in Chandigarh.pptx
Hidden gems in Microsoft ads with Navah Hopkins
How a Travel Company Can Implement Content Marketing
Presentation - MindfulHeal Digital Ayurveda GTM & Marketing Plan.pptx
Your score increases as you pick a category, fill out a long description and ...
AI & Automation: The Future of Marketing or the End of Creativity - Eric Ritt...
Fly Emirates SEO case study by Rakesh pathak.pdf
Final Project parkville.............pptx
PRINCIPLES OF MANAGEMENT and functions (1).pptx
AI & Automation: The Future of Marketing or the End of Creativity - Matthew W...
Assignment 2 Task 1 - How Consumers Use Technology and Its Impact on Their Lives
EVOLUTION OF RURAL MARKETING IN INDIAN CIVILIZATION
Solomon_Chapter 6_The Self: Mind, Gender, and Body.pptx
Mastering Content Strategy in 2025 ss.pdf
Mastering eCommerce SEO: Strategies to Boost Traffic and Maximize Conversions

BrightonSEO October 2022 - Log File Analysis - Steven van Vessum.pdf