Robots.txt Generator
Free robots.txt generator. Add allow, disallow and sitemap lines in your browser, then copy or download the file. Nothing is uploaded to GraphicByte.
Toolnamen, Anleitungen und erzeugte Inhalte können auf Englisch vorliegen.
User-agent: * Allow: / Disallow: /admin Disallow: /account Sitemap: https://www.graphicbyte.co.uk/sitemap.xml
Über dieses Tool
Build a robots.txt for a shop, docs site or Discord landing page without editing the file by hand. Default suggestions keep /admin and /account out of the public index.
Download the file and put it at the site root. GraphicByte’s own robots.txt already blocks account and checkout paths.
So verwenden Sie es
- Set the user-agent (usually *).
- List allow and disallow paths, one per line, plus your sitemap URL.
- Copy or download robots.txt and upload it to your domain root.
FAQ
Where do I put robots.txt?
At https://your-domain/robots.txt — the site root, not a subfolder.
Does this submit my site to Google?
No. It only builds the file. Use Google Search Console to request indexing.
Should I disallow everything?
Only if the site must stay private. Public shops should allow catalogue pages and point Sitemap at sitemap.xml.