Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Qwen2.5 Instruct 72B | AgMoDB

Qwen2.5 Instruct 72B

September 19, 2024Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

55 tok/s

TTFT

1.06s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How Qwen2.5 Instruct 72B Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

15.6

Coding Index

11.9

Math Index

14.0

MMLU Pro

0.7 / 100

GPQA Diamond

0.5 / 100

HLE

0.0 / 100

LiveCodeBench

0.3 / 100

SciCode

0.3 / 100

MATH-500

0.9 / 100

AIME

0.2 / 30

AIME 2025

0.1 / 30

IFBench

0.4 / 100

LCR

0.2 / 100

Terminal-Bench Hard

0.0 / 100

τ²-Bench

0.3 / 100

Predicted

38.8 / 100

AA-Omniscience Hallucination RatePredicted

94.0 / 100

Aider PolyglotPredicted

21.3 / 100

AlpacaEval 2.0 LCPredicted

41.5 / 100

AlpacaEval 2.0 RawPredicted

32.6 / 100

ARC-AGI-1Predicted

1.7 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

36.9

BigCodeBench CompletePredicted

60.4 / 100

BigCodeBench InstructPredicted

50.2 / 100

AA Intelligence Index (Matrix)Predicted

68.7

AA Long Context Reasoning (Matrix)Predicted

68.9

AIME 2024Predicted

50.6

AIME 2025 (Matrix)Predicted

23.5

Arena-Hard AutoPredicted

63.9

BrowseCompPredicted

52.0

BRUMO 2025Predicted

59.3

CMIMC 2025Predicted

82.2

CritPtPredicted

0.1

GPQA Diamond (Matrix)Predicted

57.2

GSM8KPredicted

73.1

HLE (Matrix)Predicted

61.9

HMMT Feb 2025Predicted

30.8

HMMT Nov 2025Predicted

87.1

HumanEvalPredicted

82.5

IFBench (Matrix)Predicted

30.0

IFEvalPredicted

81.3

IMO 2025Predicted

7.9

LiveCodeBench (Matrix)Predicted

47.1

MATH-500 (Matrix)Predicted

92.7

MathArena Apex 2025Predicted

0.4

MMLUPredicted

83.8

MMLU-Pro (Matrix)Predicted

73.8

MMMU-ProPredicted

81.7

MRCR v2Predicted

72.7

OSWorldPredicted

30.0

SimpleQAPredicted

15.7

SMT 2025Predicted

61.6

SWE-bench ProPredicted

26.6

Tau-Bench Telecom (Matrix)Predicted

93.5

Terminal-Bench 2.0Predicted

12.0

Terminal-Bench 1.0Predicted

11.2

USAMO 2025Predicted

4.6

Video-MMUPredicted

86.4

browsecompPredicted

47.8

BullshitBenchPredicted

47.4 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

1.9

Arc Agi 2Predicted

2.7

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

6.5

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.4

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

20.3

GSOPredicted

0.0

HellaSwagPredicted

76.8

HlePredicted

0.2

Lech Mazur WritingPredicted

7.0

METR Time HorizonsPredicted

0.1

OTIS Mock AIME 2024–2025Predicted

0.1

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.2

The Agent CompanyPredicted

1.3

TriviaQAPredicted

1.9

VPCTPredicted

0.3

WinoGrandePredicted

0.9

FrontierMathPredicted

41.3 / 100

GAIA Level 1Predicted

38.1

GAIA Level 2Predicted

19.1

GAIA Level 3Predicted

0.5

GAIAPredicted

24.9 / 100

LegalBenchPredicted

88.3 / 100

LiveBench CodingPredicted

61.2 / 100

LiveBench Data AnalysisPredicted

33.8 / 100

LiveBench LanguagePredicted

41.6 / 100

LiveBench MathPredicted

49.5 / 100

LiveBench OverallPredicted

35.5 / 100

LiveBench ReasoningPredicted

26.7 / 100

LongBench v2 EasyPredicted

44.5

LongBench v2 HardPredicted

43.0

LongBench v2Predicted

30.5 / 100

MathVistaPredicted

59.2 / 100

MedQA (USMLE)Predicted

74.0

MLE-benchPredicted

11.5 / 100

MMMUPredicted

64.6 / 100

MMTU Table UnderstandingPredicted

45.7 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

93.1 / 100

OCRBench v2Predicted

81.9 / 100

RE-BenchPredicted

0.0

SimpleBenchPredicted

17.9 / 100

simpleqaPredicted

16.3

SWE-bench LitePredicted

14.5 / 100

SWE-bench VerifiedPredicted

20.9 / 100

tau-bench RetailPredicted

70.7 / 100

Vectara Factual ConsistencyPredicted

94.6 / 100

Vectara Hallucination RatePredicted

5.4 / 100

WebArenaPredicted

5.7 / 100

WeirdMLPredicted

20.9 / 100

WildBenchPredicted

54.9

Chatbot Arena ELOchatbot_arena

140.0

Open LLM Averageopen_llm_leaderboard

48.0 / 100

Open LLM: BBHopen_llm_leaderboard

72.7 / 100

Open LLM: GPQAopen_llm_leaderboard

37.5 / 100

Open LLM: IFEvalopen_llm_leaderboard

86.4 / 100

Open LLM: MATH Level 5open_llm_leaderboard

59.8 / 100

Open LLM: MMLU-PROopen_llm_leaderboard

56.3 / 100

Open LLM: MUSRopen_llm_leaderboard

42.1 / 100