Robots.txt Generator




How to Use This Robots.txt Generator

Use the generator below to produce a ready-to-use robots.txt file. It runs offline and creates the recommended rules for most sites.

  1. Enter your site URL — include https://. Example: https://yourwebsite.com.
  2. Click Generate — the tool will build the rules and sitemap lines automatically.
  3. Review the output — it will include Disallow rules (e.g. /search, /category/, /tag/) and one or more Sitemap: lines.
  4. Click Copy to copy the content to your clipboard.
  5. Publish the file — paste the copied text into a file named robots.txt and upload it to your site root so it is reachable at https://yourwebsite.com/robots.txt.

Tip: If your site has multiple sitemap files (for posts, pages, images), add each sitemap URL on its own Sitemap: line as shown by the generator.