Indicators / series
cl.engram_harvey.closed_book_accuracy.pt
Source: Engram blog (Engram) · Engram; short quotation · CSV
Engram
| id | value | grade | as of date | published date | tier | audited vs reported | extraction method | review status | retrieved at | http status | content hash | supersedes id | url | flags |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ebb4956dc41143fb | 72.6% | grade D, evidence tier 7 | 2026-08-17 | 2026-08-17 | 7 | company_stated | manual | approved | 2026-09-10T06:54:22.277475Z | 200 | fc46cbd93413 | — | source page |
Raw snippets and dispute text
- ebb4956dc41143fb Closed-book knowledge rises from 4.7% to 72.6% between training steps zero and one thousand.