Robots.txt Tester
Test crawler access rules by user-agent and path. Check if URLs are allowed or blocked by your robots policy.
About This Tool
Run quick robots checks before deployment. It parses user-agent groups, `Allow`, `Disallow`, and `Sitemap` directives, then evaluates a target path.
If both URL and pasted content are present, the pasted robots text is used.