Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Gemini 2.5 Pro | AgMoDB

Gemini 2.5 Pro

June 5, 2025Last synced Apr 7, 2026, 4:00 PM1049K context

Blended Price

$3.44/M

Input Price

$1.25/M

Output Price

$10.00/M

Speed

132 tok/s

TTFT

25.43s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How Gemini 2.5 Pro Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

34.6

Coding Index

31.9

Math Index

87.7

MMLU Pro

0.9 / 100

GPQA Diamond

0.8 / 100

HLE

0.2 / 100

LiveCodeBench

0.8 / 100

SciCode

0.4 / 100

MATH-500

1.0 / 100

AIME

0.9 / 30

AIME 2025

0.9 / 30

IFBench

0.5 / 100

LCR

0.7 / 100

Terminal-Bench Hard

0.3 / 100

τ²-Bench

0.5 / 100

aa_omniscience

39.0 / 100

Aider Polyglotaider

83.1 / 100

ARC-AGI-1arc_agi

37.0 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.5

ARC-AGI-2arc_agi

4.9 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.8

ARC-AGI-1benchmark_matrix

41.0 / 100

ARC-AGI-2benchmark_matrix

4.9 / 100

AA Intelligence Index (Matrix)benchmark_matrix

70.0

AIME 2024benchmark_matrix

92.0

AIME 2025 (Matrix)benchmark_matrix

86.7

Arena-Hard Autobenchmark_matrix

90.8

BRUMO 2025benchmark_matrix

90.0

Chatbot Arena ELO (Matrix)benchmark_matrix

1437.0

CMIMC 2025benchmark_matrix

58.1

Codeforces Ratingbenchmark_matrix

2001.0

CritPtbenchmark_matrix

2.0

GPQA Diamond (Matrix)benchmark_matrix

84.0

HLE (Matrix)benchmark_matrix

18.8

HMMT Feb 2025benchmark_matrix

82.5

HMMT Nov 2025benchmark_matrix

66.7

IFBench (Matrix)benchmark_matrix

52.3

IFEvalbenchmark_matrix

90.8

IMO 2025benchmark_matrix

31.6

LiveCodeBench (Matrix)benchmark_matrix

70.4

MATH-500 (Matrix)benchmark_matrix

97.3

MathArena Apex 2025benchmark_matrix

0.5

MMLUbenchmark_matrix

89.8

MMLU-Pro (Matrix)benchmark_matrix

85.6

MRCR v2benchmark_matrix

83.1

SimpleQAbenchmark_matrix

52.9

SMT 2025benchmark_matrix

84.9

Terminal-Bench 2.0benchmark_matrix

32.6

Terminal-Bench 1.0benchmark_matrix

25.3

USAMO 2025benchmark_matrix

24.0

Video-MMUbenchmark_matrix

84.8

FrontierMathbenchmark_matrix

5.0 / 100

LiveBench Overallbenchmark_matrix

58.3 / 100

MMMUbenchmark_matrix

81.7 / 100

SimpleBenchbenchmark_matrix

62.4 / 100

simpleqabenchmark_matrix

52.9

SWE-bench Verifiedbenchmark_matrix

63.8 / 100

AA-Omniscience Hallucination RatePredicted

96.5 / 100

AlpacaEval 2.0 LCPredicted

65.9 / 100

AlpacaEval 2.0 RawPredicted

26.3 / 100

BFCL (Berkeley Function Calling)Predicted

55.2

BigCodeBench CompletePredicted

64.5 / 100

BigCodeBench InstructPredicted

63.0 / 100

AA Long Context Reasoning (Matrix)Predicted

72.2

BrowseCompPredicted

83.1

GSM8KPredicted

96.0

HumanEvalPredicted

94.9

MMMU-ProPredicted

82.1

OSWorldPredicted

39.5

SWE-bench ProPredicted

38.3

Tau-Bench Telecom (Matrix)Predicted

96.4

browsecompPredicted

56.8

Apex AgentsPredicted

1.9

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

CyBenchPredicted

0.3

GSM8K (Epoch)Predicted

3.0

HellaSwagPredicted

0.1

METR Time HorizonsPredicted

23.6

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

TriviaQAPredicted

7.3

WinoGrandePredicted

0.9

LongBench v2 HardPredicted

50.0

LongBench v2Predicted

45.3 / 100

MathVistaPredicted

69.3 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

94.7 / 100

Open LLM AveragePredicted

25.8 / 100

Open LLM: BBHPredicted

56.4 / 100

Open LLM: GPQAPredicted

27.5 / 100

Open LLM: IFEvalPredicted

46.7 / 100

Open LLM: MATH Level 5Predicted

6.9 / 100

Open LLM: MMLU-PROPredicted

40.4 / 100

Open LLM: MUSRPredicted

37.4 / 100

RE-BenchPredicted

35.9

tau-bench RetailPredicted

80.4 / 100

WebArenaPredicted

14.7 / 100

WildBenchPredicted

50.7

BullshitBenchbullshitbench

20.0 / 100

Aider Polyglotepoch_ai

0.0

Arc Agi 2epoch_ai

0.0

BALROGepoch_ai

0.0

CAD-Evalepoch_ai

1.4

Chess Puzzlesepoch_ai

0.2

DeepResearchBenchepoch_ai

0.3

Epoch Capabilities Indexepoch_ai

146.7

FictionLiveBenchepoch_ai

0.6

Gdpvalepoch_ai

0.3

GeoBenchepoch_ai

0.0

GSOepoch_ai

0.0

Hleepoch_ai

0.2

Lech Mazur Writingepoch_ai

8.6

OTIS Mock AIME 2024–2025epoch_ai

0.8

SimpleQA Verified (Epoch)epoch_ai

0.6

The Agent Companyepoch_ai

4.2

VPCTepoch_ai

0.4

WebDev Arenaepoch_ai

3505.0

EQ-Bench 3eqbench

1546.0

FrontierMathfrontiermath

10.0 / 100

GAIA Level 1gaia

71.7

GAIA Level 2gaia

50.0

GAIA Level 3gaia

38.5

GAIAgaia

55.2 / 100

LegalBenchlegalbench

84.3 / 100

LiveBench Codinglivebench

75.7 / 100

LiveBench Data Analysislivebench

51.6 / 100

LiveBench Languagelivebench

75.5 / 100

LiveBench Mathlivebench

68.3 / 100

LiveBench Overalllivebench

58.3 / 100

LiveBench Reasoninglivebench

70.8 / 100

LongBench v2 Easylongbench2

63.3

MedQA (USMLE)medqa

93.1

MLE-benchmlebench

59.6 / 100

MMMUmmmu

84.0 / 100

MMTU Table Understandingmmtu

66.5 / 100

OmniDocBench Overallomnidocbench

88.0 / 100

OCRBench v2open-vlm-leaderboard

86.2 / 100

SEAL Tool Use (Enterprise)seal

68.8

SimpleBenchsimplebench

51.6 / 100

SWE-bench Liteswebench

51.7 / 100

SWE-bench Verifiedswebench

53.6 / 100

Vectara Factual Consistencyvectara_hallucination

93.0 / 100

Vectara Hallucination Ratevectara_hallucination

7.0 / 100

WeirdMLweirdml

54.0 / 100