Paste your robots.txt, enter a URL path, and instantly see if any crawler is allowed or blocked — and which specific rule is being applied.
Robots.txt sorted for you. Every Sitezy site ships with a correctly configured robots.txt — allowing Google to crawl everything it should and nothing it shouldn't.
Get My Free Preview →