Does robots.txt hide a page from Google?

No. It only asks crawlers not to fetch the page. A blocked URL can still appear in results (without a description) if other sites link to it. Use a noindex meta tag or HTTP header to keep a page out of the index.

robots.txt Generator

Generate a valid robots.txt file. Start from a preset, add the paths you want to keep crawlers out of, set a sitemap URL, and optionally block the common AI training crawlers.

Preset

Disallowed paths — one per line

Crawl-delay (seconds, optional)

Sitemap URL

robots.txt

User-agent: *
Disallow: /admin
Disallow: /account
Disallow: /cart
Disallow: /*?

Sitemap: https://example.com/sitemap.xml

Save this as /robots.txt at your domain root. Disallow is a crawl instruction, not access control or a reliable way to keep a page out of the index — use noindex or authentication for that. Googlebot ignores Crawl-delay.

FAQ

Does robots.txt hide a page from Google?: No. It only asks crawlers not to fetch the page. A blocked URL can still appear in results (without a description) if other sites link to it. Use a noindex meta tag or HTTP header to keep a page out of the index.

Related tools

Free to use, no sign-up. Calculations run in your browser — nothing you type is sent to a server. These tools are for general information only, not professional advice. See the full tool list.