Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Qwen2.5 Coder Instruct 32B | AgMoDB

Qwen2.5 Coder Instruct 32B

November 11, 2024Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How Qwen2.5 Coder Instruct 32B Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

12.9

Coding Index

—

Math Index

—

MMLU Pro

0.6 / 100

GPQA Diamond

0.4 / 100

HLE

0.0 / 100

LiveCodeBench

0.3 / 100

SciCode

0.3 / 100

MATH-500

0.8 / 100

AIME

0.1 / 30

AIME 2025

— / 30

IFBench

— / 100

LCR

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

Predicted

40.7 / 100

AA-Omniscience Hallucination RatePredicted

94.3 / 100

Aider PolyglotPredicted

15.5 / 100

AIME 2025Predicted

0.1 / 30

AlpacaEval 2.0 LCPredicted

37.3 / 100

AlpacaEval 2.0 RawPredicted

29.4 / 100

ARC-AGI-1Predicted

2.3 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

31.6

BigCodeBench CompletePredicted

54.3 / 100

BigCodeBench InstructPredicted

44.5 / 100

AA Intelligence Index (Matrix)Predicted

65.5

AA Long Context Reasoning (Matrix)Predicted

70.0

AIME 2024Predicted

39.0

AIME 2025 (Matrix)Predicted

19.9

Arena-Hard AutoPredicted

49.0

BrowseCompPredicted

59.1

BRUMO 2025Predicted

73.5

CMIMC 2025Predicted

84.1

CritPtPredicted

0.1

GPQA Diamond (Matrix)Predicted

49.6

GSM8KPredicted

79.4

HLE (Matrix)Predicted

61.9

HMMT Feb 2025Predicted

30.1

HMMT Nov 2025Predicted

88.3

HumanEvalPredicted

79.6

IFBench (Matrix)Predicted

28.1

IFEvalPredicted

78.3

IMO 2025Predicted

9.9

LiveCodeBench (Matrix)Predicted

39.2

MATH-500 (Matrix)Predicted

89.9

MathArena Apex 2025Predicted

0.7

MMLUPredicted

79.9

MMLU-Pro (Matrix)Predicted

66.9

MMMU-ProPredicted

80.7

MRCR v2Predicted

73.9

OSWorldPredicted

32.5

SimpleQAPredicted

17.6

SMT 2025Predicted

70.6

SWE-bench ProPredicted

27.2

Tau-Bench Telecom (Matrix)Predicted

94.9

Terminal-Bench 2.0Predicted

17.3

Terminal-Bench 1.0Predicted

12.0

USAMO 2025Predicted

4.4

Video-MMUPredicted

85.9

browsecompPredicted

56.4

BullshitBenchPredicted

55.3 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.2

Arc Agi 2Predicted

2.1

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.9

CAD-EvalPredicted

7.5

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.4

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

9.9

GSOPredicted

0.0

HellaSwagPredicted

20.0

HlePredicted

0.2

Lech Mazur WritingPredicted

6.8

METR Time HorizonsPredicted

0.2

OTIS Mock AIME 2024–2025Predicted

0.1

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.2

The Agent CompanyPredicted

1.1

TriviaQAPredicted

3.0

VPCTPredicted

0.3

WinoGrandePredicted

0.8

FrontierMathPredicted

36.5 / 100

GAIA Level 1Predicted

23.8

GAIA Level 2Predicted

7.4

GAIA Level 3Predicted

0.0

GAIAPredicted

14.7 / 100

IFBenchPredicted

0.3 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

80.0 / 100

LiveBench CodingPredicted

63.6 / 100

LiveBench Data AnalysisPredicted

38.0 / 100

LiveBench LanguagePredicted

47.0 / 100

LiveBench MathPredicted

55.3 / 100

LiveBench OverallPredicted

40.1 / 100

LiveBench ReasoningPredicted

32.1 / 100

LongBench v2 EasyPredicted

39.6

LongBench v2 HardPredicted

38.2

LongBench v2Predicted

31.6 / 100

MathVistaPredicted

53.6 / 100

MedQA (USMLE)Predicted

71.7

MLE-benchPredicted

14.6 / 100

MMMUPredicted

59.8 / 100

MMTU Table UnderstandingPredicted

47.9 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

91.2 / 100

OCRBench v2Predicted

77.0 / 100

RE-BenchPredicted

0.2

SimpleBenchPredicted

20.4 / 100

simpleqaPredicted

18.6

SWE-bench LitePredicted

10.7 / 100

τ²-BenchPredicted

0.0 / 100

tau-bench RetailPredicted

74.8 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

94.0 / 100

Vectara Hallucination RatePredicted

6.0 / 100

WebArenaPredicted

7.4 / 100

WeirdMLPredicted

17.3 / 100

WildBenchPredicted

50.2

Epoch Capabilities Indexepoch_ai

113.2

Open LLM Averageopen_llm_leaderboard

39.9 / 100

Open LLM: BBHopen_llm_leaderboard

66.3 / 100

Open LLM: GPQAopen_llm_leaderboard

34.9 / 100

Open LLM: IFEvalopen_llm_leaderboard

72.7 / 100

Open LLM: MATH Level 5open_llm_leaderboard

49.5 / 100

Open LLM: MMLU-PROopen_llm_leaderboard

44.1 / 100

Open LLM: MUSRopen_llm_leaderboard

43.9 / 100

SWE-bench Verifiedswebench

9.0 / 100