Robots.txt Generator

Define how search engines crawl your site.

Add Rule

User Agent

Directive

Path

Active Rules

No rules added yet. (Default allows everything)

Sitemap URL (Optional)

Crawl Delay (seconds)

Output: robots.txt