User-agent: * Disallow: /cgi-bin/ User-agent: GPTBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: CCBot User-agent: PerplexityBot User-agent: Bytespider User-agent: Amazonbot User-agent: Google-Extended User-agent: Selenium User-agent: HeadlessChrome User-agent: PhantomJS User-agent: Puppeteer Disallow: /