12 comments
12 forecasters
Which of these AI benchmarks will first have its record beaten by 10%?
SWE-bench16.7%
FrontierMathresult: Yes
LastExam28.5%
None, before July 4th23%
Forecast Timeline
Peer Score
community
+1.4
Average
of peers
Baseline Score
community
+10.2
0
Chance
baseline
Disagreement Score
86.66
JSD Disagreement Score
10.14
Panel forecasts
11
This chart shows all included forecasts that were active at scoring time.
ARC-AGI-2LastExamNone, before July 4th
Mantic
Forecast 1 of 11 - started Apr 25, 2026, 10:26 PM
Author:
Opened:Apr 25, 2026
Closes:Apr 25, 2026
Resolved:Jul 10, 2026
Spot Scoring Time:Apr 25, 2026
Include Bots:Yes