# Robots.txt Generator

> Free robots.txt generator. Add allow and disallow rules per user agent, set crawl delays, point to your sitemap, and copy a valid robots.txt. Runs in your browser.

Create a valid robots.txt with crawler rules and sitemap link. Free, no sign-up.

*Interactive tool: enter your values at https://toollantern.win/robots-txt-generator/ and results update instantly in your browser.*

## What it does

Add one rule block at a time: pick a user agent (or * for all crawlers), list paths to disallow and allow, optionally set a crawl delay, then add your sitemap URL. The tool assembles a correctly formatted robots.txt you can copy and upload to your site root.

## Common pattern

Disallow /admin/ and /private/ for all agents while pointing crawlers at your sitemap is the standard starting setup for most sites.

## Private by design

Everything runs in your browser. Nothing leaves your device.

## Frequently asked questions
### What is robots.txt?

A plain text file at your site root (example.com/robots.txt) that tells search engine crawlers which pages they may or may not visit.

### Does robots.txt keep pages private?

No. It is a request, not enforcement: well-behaved crawlers obey it, but it does not block determined visitors. Use authentication for real privacy.

### Is my input sent to a server?

No. Generation happens entirely in your browser.

---
Interactive version: https://toollantern.win/robots-txt-generator/