GraphicByte

Kostenlose Tools

Robots.txt Generator

Free robots.txt generator. Add allow, disallow and sitemap lines in your browser, then copy or download the file. Nothing is uploaded to GraphicByte.

  • Läuft im Browser
  • Nichts wird hochgeladen
  • Kein Konto nötig

Toolnamen, Anleitungen und erzeugte Inhalte können auf Englisch vorliegen.

User-agent: *
Allow: /
Disallow: /admin
Disallow: /account

Sitemap: https://www.graphicbyte.co.uk/sitemap.xml

Über dieses Tool

Build a robots.txt for a shop, docs site or Discord landing page without editing the file by hand. Default suggestions keep /admin and /account out of the public index.

Download the file and put it at the site root. GraphicByte’s own robots.txt already blocks account and checkout paths.

So verwenden Sie es

  1. Set the user-agent (usually *).
  2. List allow and disallow paths, one per line, plus your sitemap URL.
  3. Copy or download robots.txt and upload it to your domain root.

FAQ

Where do I put robots.txt?

At https://your-domain/robots.txt — the site root, not a subfolder.

Does this submit my site to Google?

No. It only builds the file. Use Google Search Console to request indexing.

Should I disallow everything?

Only if the site must stay private. Public shops should allow catalogue pages and point Sitemap at sitemap.xml.

Weitere kostenlose Tools