Allow AI assistants to access your website through robots.txt
8 of 541
websites blocked ChatGPT and Claude’s page-reading agents
Closes the site to every assistant
User-agent: * Disallow: /
Allows those agents by name
User-agent: ChatGPT-User User-agent: Claude-User Allow: / User-agent: * Disallow: /