Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Molmo 7B-D | AgMoDB

Molmo 7B-D

September 25, 2024Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How Molmo 7B-D Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

9.2

Coding Index

1.2

Math Index

0.0

MMLU Pro

0.4 / 100

GPQA Diamond

0.2 / 100

HLE

0.1 / 100

LiveCodeBench

0.0 / 100

SciCode

0.0 / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

0.0 / 30

IFBench

0.2 / 100

LCR

0.0 / 100

Terminal-Bench Hard

0.0 / 100

τ²-Bench

0.0 / 100

Predicted

49.3 / 100

AA-Omniscience Hallucination RatePredicted

95.8 / 100

Aider PolyglotPredicted

5.1 / 100

AIMEPredicted

0.0 / 30

AlpacaEval 2.0 LCPredicted

20.8 / 100

AlpacaEval 2.0 RawPredicted

16.8 / 100

ARC-AGI-1Predicted

6.0 / 100

ARC-AGI-1 Cost per TaskPredicted

0.1

ARC-AGI-2Predicted

0.1 / 100

ARC-AGI-2 Cost per TaskPredicted

0.1

BFCL (Berkeley Function Calling)Predicted

16.2

BigCodeBench CompletePredicted

28.3 / 100

BigCodeBench InstructPredicted

22.3 / 100

AA Intelligence Index (Matrix)Predicted

50.3

AA Long Context Reasoning (Matrix)Predicted

75.0

AIME 2024Predicted

2.4

AIME 2025 (Matrix)Predicted

20.2

Arena-Hard AutoPredicted

7.9

BrowseCompPredicted

84.4

BRUMO 2025Predicted

98.5

CMIMC 2025Predicted

88.7

CritPtPredicted

2.5

GPQA Diamond (Matrix)Predicted

25.4

GSM8KPredicted

55.8

HLE (Matrix)Predicted

21.0

HMMT Feb 2025Predicted

36.7

HMMT Nov 2025Predicted

93.1

HumanEvalPredicted

53.5

IFBench (Matrix)Predicted

23.9

IFEvalPredicted

64.8

IMO 2025Predicted

28.0

LiveCodeBench (Matrix)Predicted

17.2

MATH-500 (Matrix)Predicted

71.6

MathArena Apex 2025Predicted

9.1

MMLUPredicted

58.7

MMLU-Pro (Matrix)Predicted

34.8

MMMU-ProPredicted

74.8

MRCR v2Predicted

79.4

OSWorldPredicted

76.2

SimpleQAPredicted

32.4

SMT 2025Predicted

89.0

SWE-bench ProPredicted

53.0

Tau-Bench Telecom (Matrix)Predicted

98.5

Terminal-Bench 2.0Predicted

62.0

Terminal-Bench 1.0Predicted

18.8

USAMO 2025Predicted

5.0

Video-MMUPredicted

83.6

browsecompPredicted

86.4

BullshitBenchPredicted

11.5 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

4.0

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.9

CAD-EvalPredicted

12.1

Chess PuzzlesPredicted

0.3

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.3

GdpvalPredicted

0.4

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

7.5

GSOPredicted

0.2

HellaSwagPredicted

0.7

HlePredicted

0.0

Lech Mazur WritingPredicted

6.4

METR Time HorizonsPredicted

1.6

OTIS Mock AIME 2024–2025Predicted

0.0

PIQAPredicted

1.4

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.4

The Agent CompanyPredicted

0.6

TriviaQAPredicted

4.7

VPCTPredicted

0.4

WinoGrandePredicted

0.7

FrontierMathPredicted

32.0 / 100

GAIA Level 1Predicted

2.3

GAIA Level 2Predicted

0.1

GAIA Level 3Predicted

0.0

GAIAPredicted

1.4 / 100

LegalBenchPredicted

20.7 / 100

LiveBench CodingPredicted

74.4 / 100

LiveBench Data AnalysisPredicted

60.1 / 100

LiveBench LanguagePredicted

72.4 / 100

LiveBench MathPredicted

79.6 / 100

LiveBench OverallPredicted

63.9 / 100

LiveBench ReasoningPredicted

64.4 / 100

LongBench v2 EasyPredicted

23.0

LongBench v2 HardPredicted

21.3

LongBench v2Predicted

20.0 / 100

MATH-500Predicted

0.2 / 100

MathVistaPredicted

17.4 / 100

MedQA (USMLE)Predicted

34.8

MLE-benchPredicted

41.0 / 100

MMMUPredicted

41.7 / 100

MMTU Table UnderstandingPredicted

40.0 / 100

MT-BenchPredicted

7.6 / 10

NoLiMa (NIAH)Predicted

78.1 / 100

Open LLM AveragePredicted

26.9 / 100

Open LLM: BBHPredicted

50.4 / 100

Open LLM: GPQAPredicted

29.3 / 100

Open LLM: IFEvalPredicted

75.0 / 100

Open LLM: MATH Level 5Predicted

18.2 / 100

Open LLM: MMLU-PROPredicted

33.8 / 100

Open LLM: MUSRPredicted

38.7 / 100

RE-BenchPredicted

94.4

SimpleBenchPredicted

25.5 / 100

simpleqaPredicted

22.9

SWE-bench LitePredicted

3.5 / 100

SWE-bench VerifiedPredicted

26.0 / 100

tau-bench RetailPredicted

89.0 / 100

Vectara Factual ConsistencyPredicted

90.3 / 100

Vectara Hallucination RatePredicted

9.7 / 100

WebArenaPredicted

0.1 / 100

WeirdMLPredicted

9.0 / 100

WildBenchPredicted

29.9

OCRBench v2open-vlm-leaderboard

65.6 / 100