Findings · SEO
robots.txt Analysis
robots.txt tells search engines what to crawl — missing or misconfigured = SEO problems
14.1%
of 418 scanned sites fail this check
Fail
14.1%
59 scans
Warning
0.5%
2 scans
Pass
85.4%
357 scans
Why it matters
This check belongs to SEO — will people find it? It's rated medium severity. robots.txt tells search engines what to crawl — missing or misconfigured = SEO problems
The fix
Vettd's Fix Pack includes a copy-paste-ready solution for this check — auto-generated for your specific site, in the right format for your stack. See pricing, or scan first to see what your site needs.
Check your own site for this.
Vettd runs this check (and 81 others) on any URL. Free, no signup, ~30 seconds.
Scan your site →