robots.txt Generator

— agents · rules · sitemap

Appearance

Go to

All tools Guide REST API client

About

About Terms Privacy

Remember input Local only

robots.txt is a crawler hint, not access control. This tool does not publish the file.

User-agent

Rule

Sitemap URL (optional)

One path per line 0 / 262,144

Output

Private key

Ready — processing stays in your browser; input is not saved.