# Block known bad bots User-agent: BadBot Disallow: / User-agent: EvilScraper Disallow: / User-agent: Scrapy Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Dotbot Disallow: / User-agent: Yandex Disallow: / User-agent: FacebookBot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: ClaudeBot Disallow: / User-agent: claudebot Disallow: / #User-agent: bingbot #Disallow: / User-agent: aiHitBot Disallow: / User-agent: DuckDuckBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: dataforseo-bot Disallow: / User-agent: aiHitBot Disallow: / User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / #User-agent: * #Disallow: / #Allow: /public-directory/