Robots.txt Generator
Free robots.txt generator. Add allow, disallow and sitemap lines in your browser, then copy or download the file. Nothing is uploaded to GraphicByte.
Los nombres, instrucciones y contenidos generados de las herramientas pueden estar en inglés.
User-agent: * Allow: / Disallow: /admin Disallow: /account Sitemap: https://www.graphicbyte.co.uk/sitemap.xml
Acerca de esta herramienta
Build a robots.txt for a shop, docs site or Discord landing page without editing the file by hand. Default suggestions keep /admin and /account out of the public index.
Download the file and put it at the site root. GraphicByte’s own robots.txt already blocks account and checkout paths.
Cómo usarla
- Set the user-agent (usually *).
- List allow and disallow paths, one per line, plus your sitemap URL.
- Copy or download robots.txt and upload it to your domain root.
Preguntas frecuentes
Where do I put robots.txt?
At https://your-domain/robots.txt — the site root, not a subfolder.
Does this submit my site to Google?
No. It only builds the file. Use Google Search Console to request indexing.
Should I disallow everything?
Only if the site must stay private. Public shops should allow catalogue pages and point Sitemap at sitemap.xml.
