// glossary entry

AI bots (AI crawlers)

Definition: Automated programs that read websites on behalf of AI providers to collect training data or generate real-time responses. Notable examples: GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot (Perplexity), Google-Extended (Google).

Everyday analogy: Like library staff from various publishers who stop by your library to study content. You decide who you grant access to.

How we use this: In the AI Visibility Audit, we check which AI bots are blocked in robots.txt (often unintentionally) and whether your content is even accessible to AI responses.

// synonyms

  • AI Crawler
  • AI Bots
Back to Glossary
Is the term still unclear?

Let's talk for 15 minutes

If a term in this glossary isn't entirely clear in the context of your project, or if you want to know whether the concept is relevant to your situation—just ask us. The initial consultation is free and non-binding.

Book an initial consultation Call: +49 751 95899217
Free No obligation 15 minutes