Skip to main content
TechSEO Vitals

On what's actually changing

Page 2

All articles

Google Will Never Read Your llms.txt. Build It Anyway

Lighthouse says build an llms.txt. Google says don't bother. Both are right – because it was never meant for Google's search. Here's who actually reads it and why you should ship it.

Your Sitemap Is Doing the Opposite of What You Think

Every URL in your sitemap is a statement to Google about what deserves to be indexed. Most sites are confessing more than they realize.

AI Search exposes every shortcut you took for Google

Thin content, duplicate descriptions, hidden prices, weak entity signals. Google forgave them for years. AI Search just picks the competitor with cleaner data instead.

Your robots.txt Is Doing the Opposite of What You Think

Add a named block for GPTBot and it stops obeying your wildcard rules entirely. The most common robots.txt mistake quietly hands AI crawlers the pages you tried to block.

The 499 Error Is Quietly Destroying Your AI Visibility

Every time ChatGPT gives up on a slow page, your server logs a 499. It is the clearest signal you have that AI crawlers tried to read your content and walked away.

When Cloudflare Becomes Your SEO's Worst Enemy

Bot Fight Mode and Under Attack Mode can quietly deindex your site. How Cloudflare's protection features block Google and AI crawlers, and how to catch it before it costs you.

Years of Technical Debt Are Catching Up With Your Website

Old CMS versions, megabytes of unused JavaScript, and neglected server config quietly pile up for years. AI crawlers just made that debt far more expensive to ignore.

Page Speed Matters Even More for AI Crawlers

Google gives your page a second chance. AI crawlers like GPTBot and ClaudeBot make one request and move on. If your site is slow, your content never reaches AI tools.

Stop Making AI Optimizations That Don't Actually Work

Serving Markdown to crawlers risks cloaking penalties. Adding llms.txt won't boost visibility. Separate fact from hype in AI optimization.

Every two weeks

The technical SEO newsletter engineers and SEOs actually finish

One specific problem, taken apart, with a position on what to do about it — argued against the primary documentation and against what I see in audits. Then three stories from the last two weeks, picked and explained.

Mersudin ForbesMersudin ForbesMark Williams-CookMark Williams-CookAleyda SolisAleyda Solis
Recommended by industry leaders

Subscribe

A new episode every two weeks. Unsubscribe in one click.

By subscribing, I agree to the Privacy Policy and Terms and Conditions.

No spam, ever. Unsubscribe at any time.
Technical SEO notes