#005

ClaudeBot

The Knowledge Gatherer

Anthropic

Training

Dex Entry

ClaudeBot helps enhance the utility and safety of Anthropic's generative AI models by collecting web content that could potentially contribute to their training.

When Disabled

When a site restricts ClaudeBot access, it signals that the site's future materials should be excluded from Anthropic's AI model training datasets.

robots.txt

Honors robots.txt directives.

Published IPs

Not published as an IP list.

Base Stats

Crawl Rate

Stealth

Reach

Obedience

User-Agent String

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ClaudeBot/1.0; +claudebot@anthropic.com