# Block all crawlers from accessing any content User-agent: * Disallow: / # Specifically block major known AI and scraping bots User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: facebookexternalhit Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: Sogou Disallow: / User-agent: Yandex Disallow: /