Skip to content
Slow Variables
Ask

Methods · Model

50%/80% horizon ratio

METR 50% horizon divided by 80% horizon for the same model (derived metric horizon_ratio_80_50). ~7-10x recently, up from ~5x.

Reason through this

The reading

The gap is widening, which is pro-normal. It is the paper's reliability argument made measurable.

Every readingeach dot links to its record
a readingnormal rangefast range
measured

25 readings drawn from the derived metric horizon_ratio_80_50; 50 observations in the evidence.

Derived (horizon_ratio_80_50) from: METR time horizons (v1.1). METR, Measuring AI Ability to Complete Long Tasks (Horizon v1.1).

The numbers
as ofreadingvaluerecord
2026-03-05gpt 5 46.34×measured
2026-02-19gemini 3 1 pro4.28×measured
2026-02-05gpt 5 3 codex6.39×measured
2026-02-05claude opus 4 6 inspect10.3×measured
2025-12-11gpt 5 25.34×measured
2025-11-24claude opus 4 5 inspect5.93×measured
2025-11-19gpt 5 1 codex max inspect4.42×measured
2025-11-18gemini 3 pro4.14×measured
2025-08-07gpt 5 2025 08 07 inspect5.30×measured
2025-08-05claude 4 1 opus inspect4.28×measured
2025-05-22claude 4 opus inspect4.91×measured
2025-04-16o3 inspect3.99×measured
2025-02-24claude 3 7 sonnet inspect4.99×measured
2024-12-05o1 inspect5.48×measured
2024-10-22claude 3 5 sonnet 20241022 inspect7.91×measured
2024-09-12o1 preview4.60×measured
2024-06-20claude 3 5 sonnet 20240620 inspect6.82×measured
2024-05-13gpt 4o inspect5.52×measured
2024-04-09gpt 4 turbo inspect4.02×measured
2024-03-04claude 3 opus inspect6.19×measured
2023-11-06gpt 4 1106 inspect5.17×measured
2023-03-14gpt 44.48×measured
2022-03-15gpt 3 5 turbo instruct2.35×measured
2020-05-28davinci 0022.56×measured
2019-02-14gpt24.20×measured

Why it matters

The ratio is the reliability gap in one number. If it collapses toward 2x while the 80% horizon exceeds eight hours, the normal-technology thesis loses its productisation argument.

What cuts against it

Ratio is sensitive to the task mix and to the exclusion of models beyond the suite ceiling; a single new model can move it.

How it is measured
  • derived metric horizon_ratio_80_50 (formula in the semantic layer)
  • source METR time horizons (v1.1) · default tier 1 · METR; analysis code MIT at https://github.com/METR/eval-analysis-public
  • proxy benchmark · cadence per release · valve invention to product

Normal = ratio ≥ 5 (gap holding or widening); fast = ratio ≤ 2. The falsifying condition (≤ 2 AND 80% horizon > 8 h) is compound and lives in the thesis monitor, not the band.

Applied to metric:horizon_ratio_80_50.

Model comparison (lower AIC fits better; both on ln(horizon) residuals)
fitestimate95% intervalnR²AICinputs
ord_half_life_misfit2.04×—–—sources12
Derived rows (25)
as ofdimsvalueinputs
2026-03-05gpt_5_46.34×sources12
2026-02-19gemini_3_1_pro4.28×sources12
2026-02-05gpt_5_3_codex6.39×sources12
2026-02-05claude_opus_4_6_inspect10.3×sources12
2025-12-11gpt_5_25.34×sources12
2025-11-24claude_opus_4_5_inspect5.93×sources12
2025-11-19gpt_5_1_codex_max_inspect4.42×sources12
2025-11-18gemini_3_pro4.14×sources12
2025-08-07gpt_5_2025_08_07_inspect5.30×sources12
2025-08-05claude_4_1_opus_inspect4.28×sources12
2025-05-22claude_4_opus_inspect4.91×sources12
2025-04-16o3_inspect3.99×sources12
2025-02-24claude_3_7_sonnet_inspect4.99×sources12
2024-12-05o1_inspect5.48×sources12
2024-10-22claude_3_5_sonnet_20241022_inspect7.91×sources12
2024-09-12o1_preview4.60×sources12
2024-06-20claude_3_5_sonnet_20240620_inspect6.82×sources12
2024-05-13gpt_4o_inspect5.52×sources12
2024-04-09gpt_4_turbo_inspect4.02×sources12
2024-03-04claude_3_opus_inspect6.19×sources12
2023-11-06gpt_4_1106_inspect5.17×sources12
2023-03-14gpt_44.48×sources12
2022-03-15gpt_3_5_turbo_instruct2.35×sources12
2020-05-28davinci_0022.56×sources12
2019-02-14gpt24.20×sources12
Latest readings
  • 2026-03-05 gpt_5_4 · 6.34×as of 2026-03-05(2 obs)
  • 2026-02-19 gemini_3_1_pro · 4.28×as of 2026-02-19(2 obs)
  • 2026-02-05 gpt_5_3_codex · 6.39×as of 2026-02-05(2 obs)
  • 2026-02-05 claude_opus_4_6_inspect · 10.3×as of 2026-02-05(2 obs)
  • 2025-12-11 gpt_5_2 · 5.34×as of 2025-12-11(2 obs)
  • 2025-11-24 claude_opus_4_5_inspect · 5.93×as of 2025-11-24(2 obs)
Why this status, and its history

Latest non-disputed model ratio is 6.3x (>= 5 normal band); the Mythos point is excluded as beyond the 16h suite ceiling. Matches the brief's expectation. Initial seed; pending Alex's review.

  1. 2026-09-10unmeasured to consistent with normalconf — → 70 · initial seed (model-drafted)

    Latest non-disputed model ratio is 6.3x (>= 5 normal band); the Mythos point is excluded as beyond the 16h suite ceiling. Matches the brief's expectation. Initial seed; pending Alex's review.

    sources12
Why this confidence

Rests on 50 observations from METR time horizons (v1.1); best evidence tier 1, grade A; stale since 2026-03-05.

Confidence is independent of status: 90–95 multiple strong independent sources; 70–89 good evidence, some ambiguity; 50–69 mixed or hard to operationalise; 0–49 limited or vague evidence.

Predictions that lean on this

More predictions that lean on this