Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-5.1 (high) | AgMoDB

GPT-5.1 (high)

November 13, 2025Last synced Apr 7, 2026, 4:00 PM400K context

Blended Price

$3.44/M

Input Price

$1.25/M

Output Price

$10.00/M

Speed

121 tok/s

TTFT

27.83s

Benchmark Scores

Intelligence Index

External Benchmarks

ARC-AGI-1

How GPT-5.1 (high) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

47.7

Coding Index

44.7

Math Index

94.0

MMLU Pro

0.9 / 100

GPQA Diamond

0.9 / 100

HLE

0.3 / 100

LiveCodeBench

0.9 / 100

SciCode

0.4 / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

0.9 / 30

IFBench

0.7 / 100

LCR

0.8 / 100

Terminal-Bench Hard

0.5 / 100

τ²-Bench

0.8 / 100

arc_agi

72.8 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.7

ARC-AGI-2arc_agi

17.6 / 100

ARC-AGI-2 Cost per Taskarc_agi

1.2

ARC-AGI-1benchmark_matrix

72.8 / 100

ARC-AGI-2benchmark_matrix

17.6 / 100

AA Long Context Reasoning (Matrix)benchmark_matrix

75.0

AIME 2025 (Matrix)benchmark_matrix

94.0

BRUMO 2025benchmark_matrix

93.3

Chatbot Arena ELO (Matrix)benchmark_matrix

1464.0

CMIMC 2025benchmark_matrix

91.9

GPQA Diamond (Matrix)benchmark_matrix

88.1

HLE (Matrix)benchmark_matrix

32.0

HMMT Nov 2025benchmark_matrix

91.7

LiveCodeBench (Matrix)benchmark_matrix

82.0

MATH-500 (Matrix)benchmark_matrix

99.0

MathArena Apex 2025benchmark_matrix

1.0

MMLUbenchmark_matrix

90.0

MMLU-Pro (Matrix)benchmark_matrix

87.5

MMMU-Probenchmark_matrix

85.4

SMT 2025benchmark_matrix

91.0

SWE-bench Probenchmark_matrix

45.0

Terminal-Bench 2.0benchmark_matrix

47.6

browsecompbenchmark_matrix

60.0

FrontierMathbenchmark_matrix

31.0 / 100

MMMUbenchmark_matrix

84.2 / 100

simpleqabenchmark_matrix

55.0

SWE-bench Verifiedbenchmark_matrix

76.3 / 100

AA-Omniscience AccuracyPredicted

40.6 / 100

AA-Omniscience Hallucination RatePredicted

95.9 / 100

Aider PolyglotPredicted

83.6 / 100

AIMEPredicted

0.7 / 30

AlpacaEval 2.0 LCPredicted

50.1 / 100

AlpacaEval 2.0 RawPredicted

41.3 / 100

BFCL (Berkeley Function Calling)Predicted

58.3

BigCodeBench CompletePredicted

48.2 / 100

BigCodeBench InstructPredicted

38.5 / 100

AA Intelligence Index (Matrix)Predicted

64.4

AIME 2024Predicted

99.1

Arena-Hard AutoPredicted

87.0

BrowseCompPredicted

64.7

CritPtPredicted

6.3

GSM8KPredicted

89.8

HMMT Feb 2025Predicted

89.7

HumanEvalPredicted

94.7

IFBench (Matrix)Predicted

68.2

IFEvalPredicted

92.5

IMO 2025Predicted

38.1

MRCR v2Predicted

77.1

OSWorldPredicted

51.8

SimpleQAPredicted

55.4

Tau-Bench Telecom (Matrix)Predicted

98.0

Terminal-Bench 1.0Predicted

41.6

USAMO 2025Predicted

30.2

Video-MMUPredicted

88.5

Aider PolyglotPredicted

2.0

Apex AgentsPredicted

2.7

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.6

CAD-EvalPredicted

2.5

Chess PuzzlesPredicted

0.2

CyBenchPredicted

0.7

DeepResearchBenchPredicted

0.5

FictionLiveBenchPredicted

0.9

GdpvalPredicted

0.4

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

2.3

GSOPredicted

0.0

HellaSwagPredicted

0.0

HlePredicted

0.3

Lech Mazur WritingPredicted

8.6

METR Time HorizonsPredicted

16.3

OTIS Mock AIME 2024–2025Predicted

1.4

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.5

The Agent CompanyPredicted

33.7

TriviaQAPredicted

14.9

VPCTPredicted

0.6

WinoGrandePredicted

1.2

GAIA Level 1Predicted

64.8

GAIA Level 2Predicted

48.9

GAIA Level 3Predicted

45.6

GAIAPredicted

49.7 / 100

LongBench v2 EasyPredicted

58.3

LongBench v2 HardPredicted

28.8

LongBench v2Predicted

28.5 / 100

MATH-500Predicted

1.0 / 100

MathVistaPredicted

72.9 / 100

MLE-benchPredicted

45.2 / 100

MMTU Table UnderstandingPredicted

69.5 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

91.6 / 100

OCRBench v2Predicted

86.7 / 100

Open LLM AveragePredicted

18.6 / 100

Open LLM: BBHPredicted

51.6 / 100

Open LLM: GPQAPredicted

28.5 / 100

Open LLM: IFEvalPredicted

28.7 / 100

Open LLM: MATH Level 5Predicted

10.2 / 100

Open LLM: MMLU-PROPredicted

34.2 / 100

Open LLM: MUSRPredicted

40.6 / 100

RE-BenchPredicted

96.0

SWE-bench LitePredicted

74.4 / 100

tau-bench RetailPredicted

88.2 / 100

WebArenaPredicted

12.6 / 100

WildBenchPredicted

43.2

browsecompbrowsecomp

60.0

BullshitBenchbullshitbench

25.0 / 100

Epoch Capabilities Indexepoch_ai

149.7

LegalBenchlegalbench

85.7 / 100

LiveBench Codinglivebench

72.5 / 100

LiveBench Data Analysislivebench

69.6 / 100

LiveBench Languagelivebench

79.3 / 100

LiveBench Mathlivebench

86.9 / 100

LiveBench Overalllivebench

72.0 / 100

LiveBench Reasoninglivebench

78.8 / 100

MedQA (USMLE)medqa

96.4

MMMUmmmu

85.4 / 100

PRBench Financeseal

48.0

PRBench Legalseal

49.3

SimpleBenchsimplebench

53.2 / 100

Vectara Factual Consistencyvectara_hallucination

87.9 / 100

Vectara Hallucination Ratevectara_hallucination

12.1 / 100

WeirdMLweirdml

60.8 / 100