Models Agents EvalsIndustry

AgMoDB by @mistakeknot

o4-mini (high) | AgMoDB

o4-mini (high)

April 16, 2025Last synced Apr 7, 2026, 4:00 PM200K context

Blended Price

$1.93/M

Input Price

$1.10/M

Output Price

$4.40/M

Speed

134 tok/s

TTFT

37.64s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How o4-mini (high) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

33.1

Coding Index

25.6

Math Index

90.7

MMLU Pro

0.8 / 100

GPQA Diamond

0.8 / 100

HLE

0.2 / 100

LiveCodeBench

0.9 / 100

SciCode

0.5 / 100

MATH-500

1.0 / 100

AIME

0.9 / 30

AIME 2025

0.9 / 30

IFBench

0.7 / 100

LCR

0.6 / 100

Terminal-Bench Hard

0.2 / 100

τ²-Bench

0.6 / 100

aider

72.0 / 100

ARC-AGI-1arc_agi

58.7 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.4

ARC-AGI-2arc_agi

6.1 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.9

ARC-AGI-1benchmark_matrix

58.7 / 100

ARC-AGI-2benchmark_matrix

6.1 / 100

AIME 2024benchmark_matrix

93.4

AIME 2025 (Matrix)benchmark_matrix

92.7

Arena-Hard Autobenchmark_matrix

79.1

BRUMO 2025benchmark_matrix

86.7

CMIMC 2025benchmark_matrix

84.4

Codeforces Ratingbenchmark_matrix

2719.0

CritPtbenchmark_matrix

0.6

GPQA Diamond (Matrix)benchmark_matrix

81.4

HLE (Matrix)benchmark_matrix

18.9

HMMT Feb 2025benchmark_matrix

66.7

HumanEvalbenchmark_matrix

98.5

IFEvalbenchmark_matrix

92.4

IMO 2025benchmark_matrix

14.3

LiveCodeBench (Matrix)benchmark_matrix

80.2

MATH-500 (Matrix)benchmark_matrix

98.2

MMLUbenchmark_matrix

90.3

MMLU-Pro (Matrix)benchmark_matrix

81.9

SimpleQAbenchmark_matrix

19.3

SMT 2025benchmark_matrix

88.7

Terminal-Bench 1.0benchmark_matrix

18.5

USAMO 2025benchmark_matrix

19.3

FrontierMathbenchmark_matrix

17.0 / 100

MMMUbenchmark_matrix

79.7 / 100

simpleqabenchmark_matrix

19.3

SWE-bench Verifiedbenchmark_matrix

68.1 / 100

AA-Omniscience AccuracyPredicted

41.4 / 100

AA-Omniscience Hallucination RatePredicted

96.6 / 100

AlpacaEval 2.0 LCPredicted

35.8 / 100

AlpacaEval 2.0 RawPredicted

25.9 / 100

BigCodeBench CompletePredicted

59.6 / 100

BigCodeBench InstructPredicted

50.7 / 100

AA Intelligence Index (Matrix)Predicted

68.1

AA Long Context Reasoning (Matrix)Predicted

72.4

BrowseCompPredicted

72.7

GSM8KPredicted

96.1

HMMT Nov 2025Predicted

60.1

IFBench (Matrix)Predicted

56.1

MathArena Apex 2025Predicted

1.2

MMMU-ProPredicted

82.1

MRCR v2Predicted

80.8

OSWorldPredicted

40.1

SWE-bench ProPredicted

42.6

Tau-Bench Telecom (Matrix)Predicted

96.5

Terminal-Bench 2.0Predicted

26.9

Video-MMUPredicted

81.3

browsecompPredicted

57.6

Apex AgentsPredicted

1.6

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

CyBenchPredicted

0.3

DeepResearchBenchPredicted

0.4

GSM8K (Epoch)Predicted

2.5

HellaSwagPredicted

1.2

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

The Agent CompanyPredicted

2.7

TriviaQAPredicted

7.7

WinoGrandePredicted

1.1

GAIA Level 1Predicted

72.8

GAIA Level 2Predicted

58.6

GAIA Level 3Predicted

50.3

GAIAPredicted

57.4 / 100

LegalBenchPredicted

90.4 / 100

LiveBench CodingPredicted

64.5 / 100

LiveBench Data AnalysisPredicted

46.9 / 100

LiveBench LanguagePredicted

59.4 / 100

LiveBench MathPredicted

56.9 / 100

LiveBench OverallPredicted

50.1 / 100

LiveBench ReasoningPredicted

45.7 / 100

LongBench v2 EasyPredicted

57.6

LongBench v2 HardPredicted

50.1

LongBench v2Predicted

45.4 / 100

MathVistaPredicted

69.0 / 100

MLE-benchPredicted

33.4 / 100

MT-BenchPredicted

8.5 / 10

NoLiMa (NIAH)Predicted

94.7 / 100

OCRBench v2Predicted

86.8 / 100

Open LLM AveragePredicted

25.0 / 100

Open LLM: BBHPredicted

55.6 / 100

Open LLM: GPQAPredicted

28.5 / 100

Open LLM: IFEvalPredicted

45.3 / 100

Open LLM: MATH Level 5Predicted

7.3 / 100

Open LLM: MMLU-PROPredicted

39.6 / 100

Open LLM: MUSRPredicted

39.4 / 100

RE-BenchPredicted

57.4

tau-bench RetailPredicted

84.4 / 100

WebArenaPredicted

14.0 / 100

WildBenchPredicted

50.3

BFCL (Berkeley Function Calling)bfcl

53.2

BullshitBenchbullshitbench

8.0 / 100

Aider Polyglotepoch_ai

0.1

Arc Agi 2epoch_ai

0.0

CAD-Evalepoch_ai

2.8

Chess Puzzlesepoch_ai

0.3

Epoch Capabilities Indexepoch_ai

146.8

FictionLiveBenchepoch_ai

0.7

Gdpvalepoch_ai

0.3

GeoBenchepoch_ai

0.1

GSOepoch_ai

0.0

Hleepoch_ai

0.1

Lech Mazur Writingepoch_ai

7.5

METR Time Horizonsepoch_ai

0.6

OTIS Mock AIME 2024–2025epoch_ai

0.8

SimpleQA Verified (Epoch)epoch_ai

0.2

VPCTepoch_ai

0.6

EQ-Bench 3eqbench

1550.0

MedQA (USMLE)medqa

96.0

MMMUmmmu

81.6 / 100

MMTU Table Understandingmmtu

66.0 / 100

PropensityBenchseal

15.8

SimpleBenchsimplebench

38.7 / 100

simpleqasimpleqa

20.2

SWE-bench Liteswebench

60.0 / 100

SWE-bench Verifiedswebench

64.6 / 100

Vectara Factual Consistencyvectara_hallucination

81.4 / 100

Vectara Hallucination Ratevectara_hallucination

18.6 / 100

WeirdMLweirdml

52.6 / 100