Free tools

Robots.txt Generator

Free robots.txt generator. Add allow, disallow and sitemap lines in your browser, then copy or download the file. Nothing is uploaded to GraphicByte.

Tool names, instructions and generated content may be provided in English.

User-agent: *
Allow: /
Disallow: /admin
Disallow: /account

Sitemap: https://www.graphicbyte.co.uk/sitemap.xml

About this tool

Build a robots.txt for a shop, docs site or Discord landing page without editing the file by hand. Default suggestions keep /admin and /account out of the public index.

Download the file and put it at the site root. GraphicByte’s own robots.txt already blocks account and checkout paths.

How to use it

  1. Set the user-agent (usually *).
  2. List allow and disallow paths, one per line, plus your sitemap URL.
  3. Copy or download robots.txt and upload it to your domain root.

FAQs

Where do I put robots.txt?

At https://your-domain/robots.txt — the site root, not a subfolder.

Does this submit my site to Google?

No. It only builds the file. Use Google Search Console to request indexing.

Should I disallow everything?

Only if the site must stay private. Public shops should allow catalogue pages and point Sitemap at sitemap.xml.

More free tools