Indicators / series
crawl.anthropic.crawl_to_refer.pt
Source: Cloudflare blog (Radar) (Cloudflare) · Cloudflare; short quotation · CSV
Cloudflare Radar, via the Cloudflare blog
| id | value | grade | as of date | published date | tier | audited vs reported | extraction method | review status | retrieved at | http status | content hash | supersedes id | url | flags |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ba6ef0b053fe2530 | 70,900× | grade B, evidence tier 3 | 2025-06-26 | 2025-07-01 | 3 | reported | manual | approved | 2026-09-22 12:55 | 200 | b1be58c5050b | — | source page | Cloudflare Radar, week of 19-26 June 2025: HTML pages crawled for each page referral sent back. Claude's app sends no Referer header, so Cloudflare says the ratio may be overstated, by an unclear amount. |
| b5911a6d01612130 | 50,000× | grade B, evidence tier 3 | 2025-08-07 | 2025-08-28 | 3 | reported | manual | approved | 2026-09-22 12:55 | 200 | 56e40ee42703 | — | source page | Cloudflare Radar, first week of August 2025, all industries. |
Raw snippets and dispute text
- ba6ef0b053fe2530 the ratios range from Anthropic’s 70,900:1 down to Mistral’s 0.1:1.
- b5911a6d01612130 For the default view, Anthropic had the highest crawl-to-refer ratio at nearly 50,000:1, followed by OpenAI at 887:1 and Perplexity at 118:1.