Robots.txt Validator
Test if a URL is allowed for different bots
Robots.txt
User-agent: * Disallow: /admin Allow: /
Bot / User Agent
All Bots (*)
Googlebot
Bingbot
DuckDuckBot
Yandex
BaiduSpider
Facebook
Twitterbot
URL Path
Validate