// glossary entry

AI bots (AI crawlers)

Definition: Automated programs that read websites on behalf of AI providers to collect training data or generate real-time responses. Notable examples: GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot (Perplexity), Google-Extended (Google).

Everyday analogy: Like library staff from various publishers who stop by your library to study content. You decide who you grant access to.

How we use this: In the AI Visibility Audit, we check which AI bots are blocked in robots.txt (often unintentionally) and whether your content is even accessible to AI responses.

// synonyms

  • AI Crawler
  • AI Bots
Back to Glossary
Is the term still unclear?

Let's talk for 15 minutes

If a term in this glossary isn't entirely clear in the context of your project, or if you want to know whether the concept is relevant to your situation-just ask us. The initial consultation is free and non-binding.

Book an initial consultation Call: +49 751 95899217
Free No obligation 15 minutes