Build a robots.txt file and an XML sitemap for your website, then download them or copy the text.
Choose robots.txt or sitemap.xml.
Enter your website address and the rules or pages.
Download the file and upload it to your site.
Yes. It is free, with no sign-up.
No. This tool runs in your browser, so your files are processed on your own device and are never uploaded to our servers.
In the top-level folder of your site, so it opens at yourdomain.com/robots.txt.
No. robots.txt only asks well-behaved crawlers not to visit. Do not use it to protect private pages.