Paste or fetch a robots.txt file to analyze crawl rules, detect errors, and get optimization insights.
Paste or fetch a robots.txt file to see parsed rules, errors, and optimization tips.