Robots.txt Tester
Parse robots.txt rules, test URL against User-Agent. See Allow/Disallow for Googlebot. Essential for SEO crawling.
Also useful in this workflow: Sitemap XML Validator, URL Count Checker.
Related tools
Used together
Next step
After this check, run Sitemap XML Validator to validate the next part of your SEO workflow.