Models Agents EvalsIndustry

AgMoDB by @mistakeknot

o1-mini | AgMoDB

o1-mini

September 12, 2024Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How o1-mini Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

20.4

Coding Index

—

Math Index

—

MMLU Pro

0.7 / 100

GPQA Diamond

0.6 / 100

HLE

0.0 / 100

LiveCodeBench

0.6 / 100

SciCode

0.3 / 100

MATH-500

0.9 / 100

AIME

0.6 / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

aider

32.9 / 100

ARC-AGI-1arc_agi

14.0 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.1

ARC-AGI-2arc_agi

0.8 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.2

AA-Omniscience AccuracyPredicted

41.1 / 100

AA-Omniscience Hallucination RatePredicted

96.8 / 100

AIME 2025Predicted

0.5 / 30

AlpacaEval 2.0 LCPredicted

34.5 / 100

AlpacaEval 2.0 RawPredicted

27.0 / 100

BFCL (Berkeley Function Calling)Predicted

41.6

BigCodeBench CompletePredicted

54.0 / 100

BigCodeBench InstructPredicted

44.0 / 100

AA Intelligence Index (Matrix)Predicted

66.0

AA Long Context Reasoning (Matrix)Predicted

60.4

AIME 2024Predicted

77.7

AIME 2025 (Matrix)Predicted

78.4

Arena-Hard AutoPredicted

68.4

BrowseCompPredicted

61.7

BRUMO 2025Predicted

87.5

CMIMC 2025Predicted

75.3

CritPtPredicted

0.1

GPQA Diamond (Matrix)Predicted

69.0

GSM8KPredicted

92.4

HLE (Matrix)Predicted

15.5

HMMT Feb 2025Predicted

59.2

HMMT Nov 2025Predicted

89.6

HumanEvalPredicted

87.0

IFBench (Matrix)Predicted

38.3

IFEvalPredicted

85.1

IMO 2025Predicted

15.4

LiveCodeBench (Matrix)Predicted

60.0

MATH-500 (Matrix)Predicted

95.2

MathArena Apex 2025Predicted

15.9

MMLUPredicted

85.1

MMLU-Pro (Matrix)Predicted

76.4

MMMU-ProPredicted

80.7

MRCR v2Predicted

90.3

OSWorldPredicted

38.0

SimpleQAPredicted

14.6

SMT 2025Predicted

81.4

SWE-bench ProPredicted

30.6

Tau-Bench Telecom (Matrix)Predicted

96.0

Terminal-Bench 2.0Predicted

11.2

Terminal-Bench 1.0Predicted

18.6

USAMO 2025Predicted

3.5

Video-MMUPredicted

93.5

browsecompPredicted

58.9

BullshitBenchPredicted

16.7 / 100

Apex AgentsPredicted

2.3

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

5.0

Chess PuzzlesPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.4

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

4.4

GSOPredicted

37.3

HellaSwagPredicted

11.5

HlePredicted

0.1

METR Time HorizonsPredicted

0.6

PIQAPredicted

0.9

PosttrainbenchPredicted

60.0

SimpleQA Verified (Epoch)Predicted

0.3

The Agent CompanyPredicted

1.7

TriviaQAPredicted

4.3

VPCTPredicted

0.4

WinoGrandePredicted

0.9

FrontierMathPredicted

14.0 / 100

GAIA Level 1Predicted

49.9

GAIA Level 2Predicted

27.3

GAIA Level 3Predicted

2.6

GAIAPredicted

34.1 / 100

IFBenchPredicted

0.4 / 100

LCRPredicted

0.2 / 100

LegalBenchPredicted

74.9 / 100

LiveBench CodingPredicted

66.6 / 100

LiveBench Data AnalysisPredicted

39.9 / 100

LiveBench LanguagePredicted

46.9 / 100

LiveBench MathPredicted

58.1 / 100

LiveBench OverallPredicted

47.5 / 100

LiveBench ReasoningPredicted

34.3 / 100

MathVistaPredicted

61.5 / 100

MLE-benchPredicted

23.3 / 100

MMMUPredicted

70.9 / 100

MMTU Table UnderstandingPredicted

53.9 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

92.9 / 100

OCRBench v2Predicted

83.0 / 100

Open LLM AveragePredicted

32.7 / 100

Open LLM: BBHPredicted

60.9 / 100

Open LLM: GPQAPredicted

33.1 / 100

Open LLM: IFEvalPredicted

33.5 / 100

Open LLM: MATH Level 5Predicted

14.2 / 100

Open LLM: MMLU-PROPredicted

45.4 / 100

Open LLM: MUSRPredicted

43.4 / 100

RE-BenchPredicted

4.9

τ²-BenchPredicted

0.2 / 100

tau-bench RetailPredicted

77.8 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

92.7 / 100

Vectara Hallucination RatePredicted

7.3 / 100

WebArenaPredicted

4.1 / 100

WildBenchPredicted

48.1

Aider Polyglotepoch_ai

18.6

Arc Agi 2epoch_ai

0.0

CyBenchepoch_ai

0.1

Epoch Capabilities Indexepoch_ai

136.6

Lech Mazur Writingepoch_ai

6.5

OTIS Mock AIME 2024–2025epoch_ai

0.4

LongBench v2 Easylongbench2

38.9

LongBench v2 Hardlongbench2

38.9

LongBench v2longbench2

37.8 / 100

MedQA (USMLE)medqa

90.2

SimpleBenchsimplebench

18.1 / 100

simpleqasimpleqa

7.6

SWE-bench Liteswebench

41.0 / 100

SWE-bench Verifiedswebench

48.6 / 100

WeirdMLweirdml

36.3 / 100