AgMoDB
Models
Agents
Evals
Explore
Tools
Industry
Menu
Gemini 1.5 Pro (Sep '24) | AgMoDB
All Models
Gemini 1.5 Pro (Sep '24)
September 24, 2024
Last synced Apr 7, 2026, 4:00 PM
Blended Price
Free/M
Input Price
Free/M
Output Price
Free/M
Speed
0 tok/s
TTFT
0.00s
Benchmark Scores
Intelligence Index
External Benchmarks
ARC-AGI-2
Add to comparison
How Gemini 1.5 Pro (Sep '24) Compares
Axes
X Axis
Blended Price (USD)
Y Axis
AgMoBench Overall
Bubble Size
Context Window
Filters
Blended Price (USD)
$0.00 – $30.0
AgMoBench Overall
≥ 3.5
Providers
ai21-labs
alibaba
anthropic
aws
azure
baidu
cohere
deepseek
+15 more
Table view
Filters
Show quadrants
Top models
anthropic
openai
google
meta
mistral
nvidia
kimi
xai
azure
deepseek
aws
cohere
baidu
ai21-labs
zai
reka-ai
xiaomi
alibaba
minimax
ibm
Bubble size = Context Window
16384.00
2000000.00
Compare with other models
16.0
Coding Index
23.6
Math Index
—
MMLU Pro
0.8
/ 100
GPQA Diamond
0.6
/ 100
HLE
0.0
/ 100
LiveCodeBench
0.3
/ 100
SciCode
0.3
/ 100
MATH-500
0.9
/ 100
AIME
0.2
/ 30
AIME 2025
—
/ 30
IFBench
—
/ 100
LCR
—
/ 100
Terminal-Bench Hard
—
/ 100
τ²-Bench
—
/ 100
arc_agi
0.8
/ 100
ARC-AGI-2 Cost per Task
arc_agi
0.0
AA-Omniscience Accuracy
Predicted
41.1
/ 100
AA-Omniscience Hallucination Rate
Predicted
95.6
/ 100
Aider Polyglot
Predicted
40.1
/ 100
AIME 2025
Predicted
0.2
/ 30
AlpacaEval 2.0 LC
Predicted
37.8
/ 100
AlpacaEval 2.0 Raw
Predicted
54.0
/ 100
ARC-AGI-1
Predicted
10.4
/ 100
ARC-AGI-1 Cost per Task
Predicted
0.1
BFCL (Berkeley Function Calling)
Predicted
41.5
AA Intelligence Index (Matrix)
Predicted
82.4
AA Long Context Reasoning (Matrix)
Predicted
71.4
AIME 2024
Predicted
53.7
AIME 2025 (Matrix)
Predicted
79.1
Arena-Hard Auto
Predicted
68.3
BrowseComp
Predicted
24.7
BRUMO 2025
Predicted
87.3
CMIMC 2025
Predicted
75.3
CritPt
Predicted
0.1
GPQA Diamond (Matrix)
Predicted
69.9
GSM8K
Predicted
90.9
HLE (Matrix)
Predicted
22.8
HMMT Feb 2025
Predicted
72.7
HMMT Nov 2025
Predicted
89.6
HumanEval
Predicted
91.0
IFBench (Matrix)
Predicted
23.2
IFEval
Predicted
82.0
IMO 2025
Predicted
15.4
LiveCodeBench (Matrix)
Predicted
68.2
MATH-500 (Matrix)
Predicted
96.7
MathArena Apex 2025
Predicted
1.0
MMLU
Predicted
86.6
MMLU-Pro (Matrix)
Predicted
75.9
MMMU-Pro
Predicted
80.7
MRCR v2
Predicted
74.5
OSWorld
Predicted
42.6
SimpleQA
Predicted
27.4
SMT 2025
Predicted
81.4
SWE-bench Pro
Predicted
37.9
Tau-Bench Telecom (Matrix)
Predicted
96.0
Terminal-Bench 2.0
Predicted
10.5
Terminal-Bench 1.0
Predicted
18.5
USAMO 2025
Predicted
8.6
Video-MMU
Predicted
93.9
browsecomp
Predicted
58.9
BullshitBench
Predicted
7.3
/ 100
Aider Polyglot
Predicted
0.0
Apex Agents
Predicted
2.0
BIG-Bench Hard
Predicted
3.0
BoolQ
Predicted
0.8
Chess Puzzles
Predicted
0.1
DeepResearchBench
Predicted
0.2
FictionLiveBench
Predicted
0.4
Gdpval
Predicted
0.2
GeoBench
Predicted
0.0
GSM8K (Epoch)
Predicted
6.6
GSO
Predicted
0.0
HellaSwag
Predicted
6.9
Lech Mazur Writing
Predicted
7.4
METR Time Horizons
Predicted
0.4
PIQA
Predicted
0.8
Posttrainbench
Predicted
60.0
SimpleQA Verified (Epoch)
Predicted
0.5
TriviaQA
Predicted
4.3
VPCT
Predicted
0.4
WinoGrande
Predicted
0.8
FrontierMath
Predicted
14.0
/ 100
IFBench
Predicted
0.3
/ 100
LCR
Predicted
0.0
/ 100
LegalBench
Predicted
73.3
/ 100
LiveBench Coding
Predicted
72.3
/ 100
LiveBench Data Analysis
Predicted
49.6
/ 100
LiveBench Language
Predicted
68.2
/ 100
LiveBench Math
Predicted
66.6
/ 100
LiveBench Overall
Predicted
47.4
/ 100
LiveBench Reasoning
Predicted
62.1
/ 100
LongBench v2 Easy
Predicted
47.1
LongBench v2 Hard
Predicted
42.7
LongBench v2
Predicted
38.7
/ 100
MLE-bench
Predicted
14.6
/ 100
MMTU Table Understanding
Predicted
47.2
/ 100
MT-Bench
Predicted
7.9
/ 10
Open LLM Average
Predicted
13.1
/ 100
Open LLM: BBH
Predicted
24.5
/ 100
Open LLM: GPQA
Predicted
23.2
/ 100
Open LLM: IFEval
Predicted
25.7
/ 100
Open LLM: MATH Level 5
Predicted
52.3
/ 100
Open LLM: MMLU-PRO
Predicted
18.2
/ 100
Open LLM: MUSR
Predicted
28.4
/ 100
RE-Bench
Predicted
4.8
simpleqa
Predicted
26.5
SWE-bench Lite
Predicted
23.1
/ 100
SWE-bench Verified
Predicted
47.0
/ 100
τ²-Bench
Predicted
0.1
/ 100
tau-bench Retail
Predicted
69.1
/ 100
Terminal-Bench Hard
Predicted
0.0
/ 100
Vectara Factual Consistency
Predicted
92.7
/ 100
Vectara Hallucination Rate
Predicted
7.3
/ 100
WebArena
Predicted
11.5
/ 100
WeirdML
Predicted
32.1
/ 100
BigCodeBench Complete
bigcodebench
57.5
/ 100
BigCodeBench Instruct
bigcodebench
43.8
/ 100
Arc Agi 2
epoch_ai
0.0
BALROG
epoch_ai
0.0
CAD-Eval
epoch_ai
3.6
CyBench
epoch_ai
0.1
Epoch Capabilities Index
epoch_ai
128.4
Hle
epoch_ai
0.0
OTIS Mock AIME 2024–2025
epoch_ai
0.2
The Agent Company
epoch_ai
6.8
GAIA Level 1
gaia
58.1
GAIA Level 2
gaia
51.6
GAIA Level 3
gaia
24.5
GAIA
gaia
49.2
/ 100
MathVista
mathvista
52.1
/ 100
MedQA (USMLE)
medqa
76.5
MMMU
mmmu
62.2
/ 100
NoLiMa (NIAH)
nolima
92.6
/ 100
OCRBench v2
open-vlm-leaderboard
75.4
/ 100
SimpleBench
simplebench
27.1
/ 100
Video-MME Long
videomme
77.4
Video-MME Medium
videomme
81.0
Video-MME
videomme
81.3
/ 100
Video-MME Short
videomme
84.5
WildBench
wildbench
47.4