Robots.txt Generator
Build a robots.txt that tells search engines what to crawl.
- Free
- No signup
- Private: runs in your browser
- Works on mobile
Robots.txt Generator tool
Loading the tool…
How to use Robots.txt Generator
- Enter your values in the fields above.
- The result updates instantly as you type or change an option.
- Copy the result or note it down. Nothing is saved on our servers.
Why use DocConvertPRO?
- Free to use with no signup or watermark.
- Everything runs in your browser. Your input is not uploaded.
- Works on phones, tablets and computers.
- Made for Indian users: rupees, lakh/crore formats and local use cases.
About this tool
Place the file at the root of your site, for example https://example.com/robots.txt.
Frequently asked questions
Does robots.txt hide pages?
No. It only asks crawlers not to crawl. Use noindex or authentication to hide content.
Where do I upload it?
At the root of your domain.
Should I add a sitemap?
Yes, it helps crawlers find your pages.