🤖 Robots.txt Generator
Build a robots.txt file — allow and disallow rules, sitemap, download it ready to use.
Build a robots.txt file for your website without writing it by hand. Add allow and disallow rules for any path, add your sitemap address, and download the finished file. A live preview shows exactly what will be in the file.
How it works
Pick the user-agent, add rules with the Add rule button (choose Allow or Disallow and type the path), add your sitemap URL if you have one, then press Download robots.txt to save the file. Upload it to the top level of your website (for example, yoursite.com/robots.txt).
Note: Google ignores crawl-delay — it is only honoured by some other crawlers. Leave it empty unless you know a crawler you target reads it.
Preview
🔐 Your text never leaves your browser.