Robots.txt Generator

Create a standard robots.txt file to guide search engine crawlers.

Sitemap URL

Disallow Path

User-agent: *
Allow: /
Disallow: /admin

Sitemap: https://example.com/sitemap.xml

Your data is processed locally in your browser for maximum privacy.

How to Use Robots.txt Generator

Set crawl rules

Add sitemap URL

Copy or download the file

Use standard User-agent and Disallow rules.

Include your XML sitemap URL.

Save as robots.txt instantly.

Technical

Professional Sitemap Generator utility.