Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Grok 3 | AgMoDB

Grok 3

February 19, 2025Last synced Apr 7, 2026, 4:00 PM131K context

Blended Price

$6.00/M

Input Price

$3.00/M

Output Price

$15.00/M

Speed

41 tok/s

TTFT

0.41s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How Grok 3 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

25.2

Coding Index

19.8

Math Index

58.0

MMLU Pro

0.8 / 100

GPQA Diamond

0.7 / 100

HLE

0.1 / 100

LiveCodeBench

0.4 / 100

SciCode

0.4 / 100

MATH-500

0.9 / 100

AIME

0.3 / 30

AIME 2025

0.6 / 30

IFBench

0.5 / 100

LCR

0.5 / 100

Terminal-Bench Hard

0.1 / 100

τ²-Bench

0.5 / 100

aider

49.3 / 100

ARC-AGI-1arc_agi

16.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.4 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.0

ARC-AGI-1benchmark_matrix

5.5 / 100

ARC-AGI-2benchmark_matrix

0.0 / 100

AIME 2024benchmark_matrix

93.3

AIME 2025 (Matrix)benchmark_matrix

93.3

Chatbot Arena ELO (Matrix)benchmark_matrix

1402.0

GPQA Diamond (Matrix)benchmark_matrix

84.6

HLE (Matrix)benchmark_matrix

18.2

HumanEvalbenchmark_matrix

87.3

IFEvalbenchmark_matrix

84.0

LiveCodeBench (Matrix)benchmark_matrix

79.4

MATH-500 (Matrix)benchmark_matrix

99.2

MMLUbenchmark_matrix

88.0

MMLU-Pro (Matrix)benchmark_matrix

79.9

Terminal-Bench 1.0benchmark_matrix

17.5

simpleqabenchmark_matrix

31.0

SWE-bench Verifiedbenchmark_matrix

48.5 / 100

AA-Omniscience AccuracyPredicted

39.6 / 100

AA-Omniscience Hallucination RatePredicted

96.8 / 100

AlpacaEval 2.0 LCPredicted

15.0 / 100

AlpacaEval 2.0 RawPredicted

11.7 / 100

BFCL (Berkeley Function Calling)Predicted

47.8

BigCodeBench CompletePredicted

59.0 / 100

BigCodeBench InstructPredicted

48.7 / 100

AA Intelligence Index (Matrix)Predicted

73.2

AA Long Context Reasoning (Matrix)Predicted

75.6

Arena-Hard AutoPredicted

80.0

BrowseCompPredicted

72.2

BRUMO 2025Predicted

82.4

CMIMC 2025Predicted

72.1

CritPtPredicted

0.1

GSM8KPredicted

93.7

HMMT Feb 2025Predicted

63.7

HMMT Nov 2025Predicted

78.9

IFBench (Matrix)Predicted

40.9

IMO 2025Predicted

13.7

MathArena Apex 2025Predicted

0.7

MMMU-ProPredicted

81.7

MRCR v2Predicted

76.9

OSWorldPredicted

36.2

SimpleQAPredicted

29.4

SMT 2025Predicted

79.8

SWE-bench ProPredicted

35.3

Tau-Bench Telecom (Matrix)Predicted

95.3

Terminal-Bench 2.0Predicted

18.2

USAMO 2025Predicted

9.6

Video-MMUPredicted

86.7

browsecompPredicted

52.1

BullshitBenchPredicted

15.1 / 100

Apex AgentsPredicted

1.8

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

4.2

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.3

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

11.5

GSOPredicted

0.0

HellaSwagPredicted

1.1

HlePredicted

0.1

METR Time HorizonsPredicted

0.7

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

The Agent CompanyPredicted

2.0

TriviaQAPredicted

4.3

VPCTPredicted

0.4

WinoGrandePredicted

1.1

FrontierMathPredicted

11.9 / 100

GAIA Level 1Predicted

66.9

GAIA Level 2Predicted

53.5

GAIA Level 3Predicted

29.5

GAIAPredicted

52.6 / 100

LegalBenchPredicted

90.2 / 100

LiveBench CodingPredicted

65.0 / 100

LiveBench Data AnalysisPredicted

40.8 / 100

LiveBench LanguagePredicted

54.7 / 100

LiveBench MathPredicted

59.2 / 100

LiveBench OverallPredicted

46.9 / 100

LiveBench ReasoningPredicted

41.6 / 100

LongBench v2 EasyPredicted

52.3

LongBench v2 HardPredicted

47.5

LongBench v2Predicted

42.9 / 100

MathVistaPredicted

62.0 / 100

MLE-benchPredicted

20.8 / 100

MMTU Table UnderstandingPredicted

58.5 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

92.6 / 100

OCRBench v2Predicted

84.9 / 100

Open LLM AveragePredicted

33.8 / 100

Open LLM: BBHPredicted

62.7 / 100

Open LLM: GPQAPredicted

33.8 / 100

Open LLM: IFEvalPredicted

63.5 / 100

Open LLM: MATH Level 5Predicted

49.7 / 100

Open LLM: MMLU-PROPredicted

47.5 / 100

Open LLM: MUSRPredicted

44.3 / 100

RE-BenchPredicted

1.8

SWE-bench LitePredicted

43.9 / 100

tau-bench RetailPredicted

76.2 / 100

WebArenaPredicted

15.3 / 100

WildBenchPredicted

52.9

Aider Polyglotepoch_ai

0.0

Arc Agi 2epoch_ai

0.0

BALROGepoch_ai

0.0

Epoch Capabilities Indexepoch_ai

141.1

FictionLiveBenchepoch_ai

0.6

Lech Mazur Writingepoch_ai

7.3

OTIS Mock AIME 2024–2025epoch_ai

0.6

Parameter Countepoch_ai

3000000000000.0

SimpleQA Verified (Epoch)epoch_ai

0.2

Training Computeepoch_ai

3.5e+26

EQ-Bench 3eqbench

1427.0

MedQA (USMLE)medqa

83.8

MMMUmmmu

78.0 / 100

SimpleBenchsimplebench

36.1 / 100

Vectara Factual Consistencyvectara_hallucination

94.2 / 100

Vectara Hallucination Ratevectara_hallucination

5.8 / 100

WeirdMLweirdml

37.2 / 100