Blocked URL Tester
Check if a URL path is blocked by robots.txt for a User-Agent. Test crawl access. Free SEO tool.
Also useful in this workflow: Sitemap XML Validator, Robots.txt Tester.
Related tools
Used together
Next step
After this check, run Sitemap XML Validator to validate the next part of your SEO workflow.