Multi-Tools
Back to Tools
Robots.txt Generator
User-agent
All robots (*)
Googlebot
Bingbot
Yandex
DuckDuckBot
Rule Type
Allow
Disallow
Path
Add Rule
Example: /admin/, /private/, /*.pdf
Crawl-delay (optional)
Sitemap URL (optional)
Generate Robots.txt
Generated Robots.txt
Download Robots.txt