| crawler | operator | pages | rate | amount |
|---|---|---|---|---|
| ClaudeBot | Anthropic model training |
6,168 | $0.01 | $61.68 |
| Googlebot | Google search indexing |
1,186 | $0.01 | $11.86 |
| Amazonbot | Amazon model training |
1,020 | $0.01 | $10.20 |
| Meta-ExternalAgent | Meta model training |
860 | $0.01 | $8.60 |
| Bingbot | Microsoft search indexing |
605 | $0.01 | $6.05 |
| GPTBot | OpenAI model training |
316 | $0.01 | $3.16 |
| OAI-SearchBot | OpenAI AI answers (live retrieval) |
275 | $0.01 | $2.75 |
| ChatGPT-User | OpenAI AI answers (live retrieval) |
97 | $0.01 | $0.97 |
| PerplexityBot | Perplexity AI answers (live retrieval) |
91 | $0.01 | $0.91 |
| Applebot | Apple search indexing |
83 | $0.01 | $0.83 |
| Claude-User | Anthropic AI answers (live retrieval) |
27 | $0.01 | $0.27 |
| CCBot | Common Crawl model training |
12 | $0.01 | $0.12 |
| DuckDuckBot | DuckDuckGo search indexing |
11 | $0.01 | $0.11 |
| Perplexity-User | Perplexity AI answers (live retrieval) |
9 | $0.01 | $0.09 |
| Bytespider | ByteDance model training |
5 | $0.01 | $0.05 |