Professional Robots.txt Generator

# Your robots.txt will be generated here.
Warning: You have a `Disallow: /` rule for all bots (`*`), which will block your entire site from search engines.

How to Use This Generator

A robots.txt file tells search engine crawlers which pages or files the crawler can or can't request from your site. It acts as a guide, not an unbreakable command.

  1. Use Presets (Optional): For a quick start, click a preset button like "WordPress" to load a standard configuration.
  2. Set Sitemap: Enter the full URL to your sitemap. This helps search engines find all your important pages.
  3. Define Rules:
    • User-agent: Specify the bot you're making rules for. Use * for all bots, or be specific (e.g., Googlebot, Bingbot).
    • Add Paths: Click "Add Disallow" or "Add Allow" to create a new input field for each path you want to block or permit.
  4. Copy the Code: The text in the "Live Preview" box updates automatically. Once you are satisfied, click the "Copy" button.

How to Implement on Your Website

  1. Create a new plain text file on your computer.
  2. Paste the copied code into this file.
  3. Save the file with the exact name robots.txt.
  4. Upload this file to the root directory of your website. This is usually the public_html, www, or main domain folder.
  5. Verify it's working by visiting https://yourwebsite.com/robots.txt. You should see the text you pasted.