Models Agents EvalsIndustry

AgMoDB by @mistakeknot

Llama 4 Scout | AgMoDB

Llama 4 Scout

April 5, 2025Last synced Apr 7, 2026, 4:00 PM328K context

Blended Price

$0.29/M

Input Price

$0.17/M

Output Price

$0.66/M

Speed

145 tok/s

TTFT

0.47s

Benchmark Scores

Intelligence Index

External Benchmarks

ARC-AGI-1

How Llama 4 Scout Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

13.5

Coding Index

6.7

Math Index

14.0

MMLU Pro

0.8 / 100

GPQA Diamond

0.6 / 100

HLE

0.0 / 100

LiveCodeBench

0.3 / 100

SciCode

0.2 / 100

MATH-500

0.8 / 100

AIME

0.3 / 30

AIME 2025

0.1 / 30

IFBench

0.4 / 100

LCR

0.3 / 100

Terminal-Bench Hard

0.0 / 100

τ²-Bench

0.2 / 100

arc_agi

0.5 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.0

ARC-AGI-1benchmark_matrix

0.5 / 100

ARC-AGI-2benchmark_matrix

0.0 / 100

Arena-Hard Autobenchmark_matrix

72.0

Chatbot Arena ELO (Matrix)benchmark_matrix

1350.0

GPQA Diamond (Matrix)benchmark_matrix

57.2

GSM8Kbenchmark_matrix

90.6

HumanEvalbenchmark_matrix

76.0

IFEvalbenchmark_matrix

81.0

LiveCodeBench (Matrix)benchmark_matrix

32.8

MATH-500 (Matrix)benchmark_matrix

83.0

MMLUbenchmark_matrix

88.5

MMLU-Pro (Matrix)benchmark_matrix

74.3

MMMUbenchmark_matrix

69.4 / 100

AA-Omniscience AccuracyPredicted

35.0 / 100

AA-Omniscience Hallucination RatePredicted

93.9 / 100

Aider PolyglotPredicted

18.3 / 100

AlpacaEval 2.0 LCPredicted

45.7 / 100

AlpacaEval 2.0 RawPredicted

34.6 / 100

BigCodeBench InstructPredicted

40.3 / 100

AA Intelligence Index (Matrix)Predicted

68.0

AA Long Context Reasoning (Matrix)Predicted

69.0

AIME 2024Predicted

51.2

AIME 2025 (Matrix)Predicted

19.0

BrowseCompPredicted

53.1

BRUMO 2025Predicted

60.2

CMIMC 2025Predicted

59.8

CritPtPredicted

0.0

HLE (Matrix)Predicted

9.1

HMMT Feb 2025Predicted

70.8

HMMT Nov 2025Predicted

36.9

IFBench (Matrix)Predicted

28.7

IMO 2025Predicted

7.9

MathArena Apex 2025Predicted

0.4

MMMU-ProPredicted

80.6

MRCR v2Predicted

83.9

OSWorldPredicted

26.9

SimpleQAPredicted

17.4

SMT 2025Predicted

71.6

SWE-bench ProPredicted

28.5

Tau-Bench Telecom (Matrix)Predicted

37.5

Terminal-Bench 2.0Predicted

12.5

Terminal-Bench 1.0Predicted

9.6

USAMO 2025Predicted

4.3

Video-MMUPredicted

78.9

browsecompPredicted

49.2

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

1.9

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.9

CAD-EvalPredicted

6.9

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

18.7

GSOPredicted

0.0

HellaSwagPredicted

19.0

HlePredicted

0.0

Lech Mazur WritingPredicted

6.9

METR Time HorizonsPredicted

0.1

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.2

The Agent CompanyPredicted

1.2

TriviaQAPredicted

2.0

VPCTPredicted

0.3

WinoGrandePredicted

1.0

FrontierMathPredicted

8.8 / 100

GAIA Level 1Predicted

32.7

GAIA Level 2Predicted

14.3

GAIA Level 3Predicted

0.2

GAIAPredicted

21.0 / 100

LegalBenchPredicted

86.7 / 100

LiveBench CodingPredicted

61.4 / 100

LiveBench Data AnalysisPredicted

34.1 / 100

LiveBench LanguagePredicted

41.9 / 100

LiveBench MathPredicted

49.9 / 100

LiveBench OverallPredicted

35.7 / 100

LiveBench ReasoningPredicted

26.9 / 100

LongBench v2 EasyPredicted

42.9

LongBench v2 HardPredicted

41.7

LongBench v2Predicted

37.6 / 100

MathVistaPredicted

46.1 / 100

MLE-benchPredicted

14.4 / 100

MMTU Table UnderstandingPredicted

42.3 / 100

MT-BenchPredicted

7.9 / 10

OCRBench v2Predicted

80.7 / 100

Open LLM AveragePredicted

45.5 / 100

Open LLM: BBHPredicted

69.8 / 100

Open LLM: GPQAPredicted

36.0 / 100

Open LLM: IFEvalPredicted

76.9 / 100

Open LLM: MATH Level 5Predicted

69.2 / 100

Open LLM: MMLU-PROPredicted

56.1 / 100

Open LLM: MUSRPredicted

45.6 / 100

RE-BenchPredicted

0.0

SimpleBenchPredicted

16.4 / 100

simpleqaPredicted

16.3

SWE-bench LitePredicted

12.7 / 100

tau-bench RetailPredicted

66.2 / 100

WebArenaPredicted

4.6 / 100

WeirdMLPredicted

22.4 / 100

WildBenchPredicted

54.1

BFCL (Berkeley Function Calling)bfcl

28.1

BigCodeBench Completebigcodebench

43.1 / 100

BullshitBenchbullshitbench

19.0 / 100

Arc Agi 2epoch_ai

0.0

Epoch Capabilities Indexepoch_ai

130.6

FictionLiveBenchepoch_ai

0.2

OTIS Mock AIME 2024–2025epoch_ai

0.1

EQ-Bench 3eqbench

1099.0

MedQA (USMLE)medqa

50.9

MMMUmmmu

69.4 / 100

NoLiMa (NIAH)nolima

81.7 / 100

SWE-bench Verifiedswebench

9.1 / 100

Vectara Factual Consistencyvectara_hallucination

92.3 / 100

Vectara Hallucination Ratevectara_hallucination

7.7 / 100