Free Robots.txt Checker
Check your website's robots.txt file, review crawler directives, sitemap references and identify potential SEO issues.
No signup required. We directly check your public robots.txt file.
File Availability
Check whether your website has a publicly accessible robots.txt file.
Crawler Rules
Review Allow, Disallow and User-agent directives that control crawler access.
Sitemaps
Find sitemap references declared in your robots.txt file.