Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-4.1 nano | AgMoDB

GPT-4.1 nano

April 14, 2025Last synced Apr 7, 2026, 4:00 PM1048K context

Blended Price

$0.17/M

Input Price

$0.10/M

Output Price

$0.40/M

Speed

170 tok/s

TTFT

0.39s

Benchmark Scores

Intelligence Index

External Benchmarks

Aider Polyglot

How GPT-4.1 nano Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

13.0

Coding Index

11.2

Math Index

24.0

MMLU Pro

0.7 / 100

GPQA Diamond

0.5 / 100

HLE

0.0 / 100

LiveCodeBench

0.3 / 100

SciCode

0.3 / 100

MATH-500

0.8 / 100

AIME

0.2 / 30

AIME 2025

0.2 / 30

IFBench

0.3 / 100

LCR

0.2 / 100

Terminal-Bench Hard

0.0 / 100

τ²-Bench

0.2 / 100

aider

8.9 / 100

ARC-AGI-1arc_agi

0.0 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.0

ARC-AGI-2arc_agi

0.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

0.0

ARC-AGI-1benchmark_matrix

0.0 / 100

ARC-AGI-2benchmark_matrix

0.0 / 100

Arena-Hard Autobenchmark_matrix

10.7

GPQA Diamond (Matrix)benchmark_matrix

50.3

HumanEvalbenchmark_matrix

78.0

IFEvalbenchmark_matrix

75.0

MMLUbenchmark_matrix

80.1

AA-Omniscience AccuracyPredicted

35.6 / 100

AA-Omniscience Hallucination RatePredicted

91.9 / 100

AlpacaEval 2.0 LCPredicted

20.7 / 100

AlpacaEval 2.0 RawPredicted

16.1 / 100

BigCodeBench CompletePredicted

67.6 / 100

BigCodeBench InstructPredicted

57.6 / 100

AA Intelligence Index (Matrix)Predicted

71.8

AA Long Context Reasoning (Matrix)Predicted

66.1

AIME 2024Predicted

29.3

AIME 2025 (Matrix)Predicted

59.1

BrowseCompPredicted

71.2

BRUMO 2025Predicted

21.4

CMIMC 2025Predicted

40.4

CritPtPredicted

0.0

GSM8KPredicted

88.8

HLE (Matrix)Predicted

52.6

HMMT Feb 2025Predicted

64.6

HMMT Nov 2025Predicted

44.0

IFBench (Matrix)Predicted

22.1

IMO 2025Predicted

3.8

LiveCodeBench (Matrix)Predicted

36.8

MATH-500 (Matrix)Predicted

89.9

MathArena Apex 2025Predicted

0.1

MMLU-Pro (Matrix)Predicted

69.8

MMMU-ProPredicted

81.4

MRCR v2Predicted

80.1

OSWorldPredicted

22.7

SimpleQAPredicted

11.9

SMT 2025Predicted

58.3

SWE-bench ProPredicted

20.4

Tau-Bench Telecom (Matrix)Predicted

89.2

Terminal-Bench 2.0Predicted

5.3

Terminal-Bench 1.0Predicted

7.6

USAMO 2025Predicted

2.5

Video-MMUPredicted

57.6

browsecompPredicted

35.2

BullshitBenchPredicted

2.1 / 100

Apex AgentsPredicted

1.5

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

7.9

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.2

GdpvalPredicted

0.1

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

92.0

GSOPredicted

0.0

HellaSwagPredicted

96.7

HlePredicted

0.0

Lech Mazur WritingPredicted

6.6

METR Time HorizonsPredicted

0.0

PIQAPredicted

0.9

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.1

The Agent CompanyPredicted

1.1

TriviaQAPredicted

1.0

VPCTPredicted

0.3

WinoGrandePredicted

0.8

FrontierMathPredicted

4.9 / 100

GAIA Level 1Predicted

31.2

GAIA Level 2Predicted

16.4

GAIA Level 3Predicted

0.2

GAIAPredicted

20.1 / 100

LegalBenchPredicted

92.6 / 100

LiveBench CodingPredicted

55.1 / 100

LiveBench Data AnalysisPredicted

27.4 / 100

LiveBench LanguagePredicted

50.4 / 100

LiveBench MathPredicted

35.3 / 100

LiveBench OverallPredicted

40.9 / 100

LiveBench ReasoningPredicted

37.1 / 100

LongBench v2 EasyPredicted

43.2

LongBench v2 HardPredicted

44.5

LongBench v2Predicted

39.9 / 100

MathVistaPredicted

53.3 / 100

MLE-benchPredicted

5.1 / 100

MMMUPredicted

59.3 / 100

MMTU Table UnderstandingPredicted

41.5 / 100

MT-BenchPredicted

8.0 / 10

Open LLM AveragePredicted

58.6 / 100

Open LLM: BBHPredicted

77.8 / 100

Open LLM: GPQAPredicted

39.3 / 100

Open LLM: IFEvalPredicted

86.5 / 100

Open LLM: MATH Level 5Predicted

83.1 / 100

Open LLM: MMLU-PROPredicted

66.9 / 100

Open LLM: MUSRPredicted

48.3 / 100

RE-BenchPredicted

0.0

SimpleBenchPredicted

16.0 / 100

SWE-bench LitePredicted

9.5 / 100

SWE-bench VerifiedPredicted

19.6 / 100

tau-bench RetailPredicted

61.9 / 100

Vectara Factual ConsistencyPredicted

96.0 / 100

Vectara Hallucination RatePredicted

4.0 / 100

WebArenaPredicted

37.3 / 100

WildBenchPredicted

58.1

BFCL (Berkeley Function Calling)bfcl

33.0

Aider Polyglotepoch_ai

0.0

Arc Agi 2epoch_ai

0.0

Epoch Capabilities Indexepoch_ai

130.9

FictionLiveBenchepoch_ai

0.4

OTIS Mock AIME 2024–2025epoch_ai

0.3

EQ-Bench 3eqbench

1337.0

MedQA (USMLE)medqa

68.2

NoLiMa (NIAH)nolima

80.7 / 100

OCRBench v2open-vlm-leaderboard

71.0 / 100

simpleqasimpleqa

7.6

WeirdMLweirdml

19.0 / 100