robots.txt inaccessible
robots.txt could not be fetched. Crawlers may treat the entire site as disallowed.
Check ID ROBOTS_TXT_INACCESSIBLE
·
Category Robots.txt
·
Available on every plan
How to fix it
Make /robots.txt return a 200. If you have no rules, serve an empty allow-all file.
Wrendex catches robots.txt inaccessible on every audit.
No credit card · All 170+ checks · Full PDF report
Run free audit →