Free Robots.txt Checker

Validate your robots.txt rules, test URLs against them, and discover accidentally blocked pages.

We'll fetch and analyze your robots.txt, then test the URL if provided. Sign in for more checks. Anonymous: 3 checks/day.

Rule Analysis

Parses all User-agent, Allow, and Disallow rules with line numbers.

URL Testing

Test any URL to see if it's blocked and which rule matches.

Issue Detection

Finds conflicting rules, critical blocks, and missing directives.