VisitorType
← AI Agent Directory

ClaudeBot

AI training crawler

Anthropic's training crawler for Claude models.

What ClaudeBot does

ClaudeBot collects public web content used to train Anthropic's Claude models. Like its peers it fetches HTML without executing JavaScript, so it is invisible to browser-based analytics — server-side detection is the only way to see it.

Fact sheet

Operator
Anthropic
robots.txt token
ClaudeBot
Honors robots.txt
Yes (documented)
Executes JavaScript
No — invisible to browser analytics
Identity verifiable by IP
No published ranges
Official documentation
Anthropic docs ↗

How it identifies itself

Mozilla/5.0 (compatible; ClaudeBot/1.0; [email protected])

User-agent strings are free to fake — any scraper can claim to be ClaudeBot. With no published IP ranges, claims by this agent can't be cryptographically verified — treat lookalikes with suspicion.

Allow or block via robots.txt

# Block ClaudeBot
User-agent: ClaudeBot
Disallow: /

# Or allow it explicitly
User-agent: ClaudeBot
Allow: /

Should you block ClaudeBot?

Same trade as GPTBot: blocking opts you out of training data, not out of Claude users reaching you (Claude-User handles live fetches). Anthropic honors robots.txt. Decide with data on what it actually reads.

Is ClaudeBot reading your site?

ClaudeBotnever runs JavaScript, so GA4 can't see it. VisitorType's server-side detection can — with per-page counts.

Measure it free

Related agents