Home › Robots.txt Generator
Private: nothing leaves your browser. No sign-up.
Robots.txt Generator
Create a valid robots.txt with crawler rules and sitemap link. Free, no sign-up.
What it does
Add one rule block at a time: pick a user agent (or * for all crawlers), list paths to disallow and allow, optionally set a crawl delay, then add your sitemap URL. The tool assembles a correctly formatted robots.txt you can copy and upload to your site root.
Common pattern
Disallow /admin/ and /private/ for all agents while pointing crawlers at your sitemap is the standard starting setup for most sites.
Private by design
Everything runs in your browser. Nothing leaves your device.
Planning estimate only. Results use the list prices shown and may differ from your actual bill. Terms
Frequently asked questions
What is robots.txt?
A plain text file at your site root (example.com/robots.txt) that tells search engine crawlers which pages they may or may not visit.
Does robots.txt keep pages private?
No. It is a request, not enforcement: well-behaved crawlers obey it, but it does not block determined visitors. Use authentication for real privacy.
Is my input sent to a server?
No. Generation happens entirely in your browser.