Skip to content
Slow Variables
Ask

Methods · Model

METR 50% time horizon

Length (in human-expert minutes) of software tasks a frontier model completes with 50% success, per METR's Horizon v1.1 suite, plotted by model release date. The band applies to the doubling time of that series over the most recent window METR itself reports (2024 onward), recomputed here from METR's corrected data file; METR's published 2023-onward figure is shown alongside.

Reason through this

The reading

What models can do is improving fast by any historical standard. The open question the rule answers is whether it is improving as fast as AI 2027, the most aggressive widely read forecast, needs.

Every readinglog scale · each dot links to its record
gpt2 · 0.054 min (0.010 min–0.14 min) · 2019-02-14 · measureddavinci 002 · 0.14 min (0.093 min–0.22 min) · 2020-05-28 · measuredgpt 3 5 turbo instruct · 0.60 min (0.26 min–1.12 min) · 2022-03-15 · measuredgpt 4 · 3.99 min (1.93 min–8.00 min) · 2023-03-14 · measuredgpt 4 1106 inspect · 4.04 min (1.87 min–8.44 min) · 2023-11-06 · measuredclaude 3 opus inspect · 3.95 min (1.71 min–8.76 min) · 2024-03-04 · measuredgpt 4 turbo inspect · 3.73 min (1.98 min–6.74 min) · 2024-04-09 · measuredgpt 4o inspect · 6.99 min (4.00 min–12.9 min) · 2024-05-13 · measuredclaude 3 5 sonnet 20240620 inspect · 11.4 min (5.49 min–22.4 min) · 2024-06-20 · measuredo1 preview · 20.3 min (11.7 min–33.4 min) · 2024-09-12 · measuredclaude 3 5 sonnet 20241022 inspect · 20.5 min (10.1 min–40.8 min) · 2024-10-22 · measuredo1 inspect · 38.8 min (21.2 min–1.1 h) · 2024-12-05 · measuredclaude 3 7 sonnet inspect · 1.0 h (33.0 min–1.7 h) · 2025-02-24 · measuredo3 inspect · 2.0 h (1.2 h–3.2 h) · 2025-04-16 · measuredclaude 4 opus inspect · 1.7 h (60.0 min–2.7 h) · 2025-05-22 · measuredclaude 4 1 opus inspect · 1.7 h (59.3 min–2.7 h) · 2025-08-05 · measuredgpt 5 2025 08 07 inspect · 3.4 h (1.9 h–6.8 h) · 2025-08-07 · measuredgemini 3 pro · 3.7 h (2.3 h–6.3 h) · 2025-11-18 · measuredgpt 5 1 codex max inspect · 3.7 h (2.2 h–6.6 h) · 2025-11-19 · measuredclaude opus 4 5 inspect · 4.9 h (2.7 h–10.4 h) · 2025-11-24 · measuredgpt 5 2 · 5.9 h (3.3 h–13.6 h) · 2025-12-11 · measuredclaude opus 4 6 inspect · 12.0 h (5.3 h–60.6 h) · 2026-02-05 · measuredgpt 5 3 codex · 5.8 h (3.2 h–13.6 h) · 2026-02-05 · measuredgemini 3 1 pro · 6.4 h (3.9 h–11.6 h) · 2026-02-19 · measuredgpt 5 4 · 5.7 h (3.1 h–12.8 h) · 2026-03-05 · measuredclaude mythos preview early inspect · 17.4 h (8.5 h–55.1 h) · 2026-04-07 · measured · disputed
a readingdisputedinterval
measured

26 readings drawn from metr.*.horizon_50.pt, one of 5 series listed under How it is measured; 80 observations in the evidence.

Source: METR time horizons (v1.1). METR, Measuring AI Ability to Complete Long Tasks (Horizon v1.1).

The numbers
as ofreadingvaluerecord
2026-04-07claude mythos preview early inspect (disputed)17.4 h (8.5 h–55.1 h)measured
2026-03-05gpt 5 45.7 h (3.1 h–12.8 h)measured
2026-02-19gemini 3 1 pro6.4 h (3.9 h–11.6 h)measured
2026-02-05gpt 5 3 codex5.8 h (3.2 h–13.6 h)measured
2026-02-05claude opus 4 6 inspect12.0 h (5.3 h–60.6 h)measured
2025-12-11gpt 5 25.9 h (3.3 h–13.6 h)measured
2025-11-24claude opus 4 5 inspect4.9 h (2.7 h–10.4 h)measured
2025-11-19gpt 5 1 codex max inspect3.7 h (2.2 h–6.6 h)measured
2025-11-18gemini 3 pro3.7 h (2.3 h–6.3 h)measured
2025-08-07gpt 5 2025 08 07 inspect3.4 h (1.9 h–6.8 h)measured
2025-08-05claude 4 1 opus inspect1.7 h (59.3 min–2.7 h)measured
2025-05-22claude 4 opus inspect1.7 h (60.0 min–2.7 h)measured
2025-04-16o3 inspect2.0 h (1.2 h–3.2 h)measured
2025-02-24claude 3 7 sonnet inspect1.0 h (33.0 min–1.7 h)measured
2024-12-05o1 inspect38.8 min (21.2 min–1.1 h)measured
2024-10-22claude 3 5 sonnet 20241022 inspect20.5 min (10.1 min–40.8 min)measured
2024-09-12o1 preview20.3 min (11.7 min–33.4 min)measured
2024-06-20claude 3 5 sonnet 20240620 inspect11.4 min (5.49 min–22.4 min)measured
2024-05-13gpt 4o inspect6.99 min (4.00 min–12.9 min)measured
2024-04-09gpt 4 turbo inspect3.73 min (1.98 min–6.74 min)measured
2024-03-04claude 3 opus inspect3.95 min (1.71 min–8.76 min)measured
2023-11-06gpt 4 1106 inspect4.04 min (1.87 min–8.44 min)measured
2023-03-14gpt 43.99 min (1.93 min–8.00 min)measured
2022-03-15gpt 3 5 turbo instruct0.60 min (0.26 min–1.12 min)measured
2020-05-28davinci 0020.14 min (0.093 min–0.22 min)measured
2019-02-14gpt20.054 min (0.010 min–0.14 min)measured

Why it matters

The cleanest single measure of how fast the models themselves are improving. Narayanan and Kapoor's argument is that fast improvement here does not, on its own, make firms, jobs or productivity change quickly.

What cuts against it

On the 2023-onward window (METR's published 128.7 days, our fit 125) the status would be emerging, not faster than normal; the status depends on the window. METR notes measurements above 16 hours are unreliable with the current task suite, so the newest points carry wide intervals and are flagged disputed, and human baselines exist for only 5 of the 31 tasks over 8 hours. Horizon is a software-task construct and may not transfer to other work.

How it is measured
  • series metr.*.horizon_50.pt
  • series metr.suite.doubling_time_days.pt
  • series metr_blog.suite.doubling_time_days_since_2024.pt
  • series metr_blog.suite.doubling_time_days_since_2023.pt
  • series metr_blog.suite.doubling_time_days_2019_2025.pt
  • source METR time horizons (v1.1) · default tier 1 · METR; analysis code MIT at https://github.com/METR/eval-analysis-public
  • source METR research posts · default tier 6 · METR
  • proxy benchmark · cadence per release

Normal = doubling time ≥ 7 months (≈213 days, METR's 2019–2025 trend); fast = ≤ 4 months (≈122 days), the AI 2027 assumption. Between the two is `emerging`. The bands are about the current pace, so the input is a log-linear fit over the 2024-onward window, the most recent window METR reports (89 days in the TH1.1 post of 29 Jan 2026), recomputed from METR's corrected data. On the 2023-onward window METR's published figure is 128.7 days, in the gap between the bands: the reading is window-sensitive and both numbers are shown.

Applied to metric:horizon_doubling_days_50_since_2024.

Model comparison (lower AIC fits better; both on ln(horizon) residuals)
fitestimate95% intervalnR²AICinputs
horizon_doubling_days_50_since_2024108 days99 days–119 days200.966-44.8sources12+23 more
horizon_doubling_days_50_since_2023125 days111 days–143 days220.933-31.0sources12+23 more
horizon_blowup_year_50_since_20242025.82025.4–2026.8200.64578.1sources12+23 more
Latest readings
  • 2026-04-07 claude_mythos_preview_early_inspect · 17.4 h(8.5 h–55.1 h)⚑disputed: METR: measurements above 16 hours are unreliable with the current task suiteas of 2026-04-07
  • 2026-03-05 gpt_5_4 · 5.7 h(3.1 h–12.8 h)as of 2026-03-05
  • 2026-02-19 gemini_3_1_pro · 6.4 h(3.9 h–11.6 h)as of 2026-02-19
  • 2026-02-05 gpt_5_3_codex · 5.8 h(3.2 h–13.6 h)as of 2026-02-05
  • 2026-02-05 claude_opus_4_6_inspect · 12.0 h(5.3 h–60.6 h)as of 2026-02-05
  • 2025-12-11 gpt_5_2 · 5.9 h(3.3 h–13.6 h)as of 2025-12-11
Why this status, and its history

Band input switched to the most recent window METR reports (2024 onward), per the updated rationale: our log-linear fit on METR's corrected v1.1 data gives a doubling time of 108 days, inside the fast band (<=122). METR's own TH1.1 post (29 Jan 2026) reports 89 days since 2024. On the 2023-onward window the figures are 128.7 (METR) and 125 (ours), which would read emerging; the status is window-sensitive and both are shown on the page.

  1. 2026-09-10emerging to faster than normalconf 80 → 80 · initial seed (model-drafted)

    Band input switched to the most recent window METR reports (2024 onward), per the updated rationale: our log-linear fit on METR's corrected v1.1 data gives a doubling time of 108 days, inside the fast band (<=122). METR's own TH1.1 post (29 Jan 2026) reports 89 days since 2024. On the 2023-onward window the figures are 128.7 (METR) and 125 (ours), which would read emerging; the status is window-sensitive and both are shown on the page.

    sources123456+14 more
  2. 2026-09-10unmeasured to emergingconf — → 80 · initial seed (model-drafted)

    METR's published 2023-onward doubling time is 128.7 days (CI 104-158), between the normal band (>=213 days) and the fast band (<=122 days). Initial seed; the brief expected faster_than_normal. Pending Alex's review.

    source1
Why this confidence

Rests on 80 observations from METR research posts, METR time horizons (v1.1); best evidence tier 1, grade A; current.

Confidence is independent of status: 90–95 multiple strong independent sources; 70–89 good evidence, some ambiguity; 50–69 mixed or hard to operationalise; 0–49 limited or vague evidence.

Predictions that lean on this

More predictions that lean on this