Robots.txt Generator

Configure rules for search engine crawlers.

Default Policy for All Crawlers (*)

This sets the base rule for all user-agents not specifically mentioned.

Sitemap URL (Optional)

Custom Rules

User-Agent

Rule

Path

Generated robots.txt

Save this content as `robots.txt` in your site's root.

User-agent: *
Allow: /