SEOFix blog · Category
How AI crawlers and answer engines read your site, and what to change so they can find, cite and link to it.
llms.txt won't move your AI search visibility. It does get read by coding agents and agent tooling. The evidence, who has adopted it, and a template for sites where it's worth 20 minutes.
1,805 words · 8 min read
The best public data says GPTBot and ClaudeBot don't run JavaScript, and the vendors don't document it either way. A two-command test shows what they see on your site.
1,693 words · 8 min read
Every AI company now runs separate crawlers for training, search and live user fetches. Which ones to block, the robots.txt for each policy, and how to check they obey.
1,878 words · 9 min read