User-agent: CCBot User-agent: ChatGPT User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: BLEXBot User-agent: dotbot User-agent: AhrefsBot User-agent: SemrushBot User-agent: AhrefsSiteAudit User-agent: mj12bot User-agent: barkrowler User-agent: siteliner User-agent: linkbot User-agent: cliqzbot User-agent: NinjBot User-agent: NinjaBot User-agent: seznam.cz User-agent: YandexBot Disallow: /clue/ Disallow: /crossword-clues/ Disallow: /crossword-answers/ User-agent: * Disallow: /clue/*/1000$