Models Agents EvalsIndustry

AgMoDB by @mistakeknot

GPT-5.4 (Non-reasoning) | AgMoDB

GPT-5.4 (Non-reasoning)

March 5, 2026Last synced Apr 7, 2026, 4:00 PM

Blended Price

$5.63/M

Input Price

$2.50/M

Output Price

$15.00/M

Speed

67 tok/s

TTFT

0.55s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How GPT-5.4 (Non-reasoning) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

35.4

Coding Index

41.0

Math Index

—

MMLU Pro

— / 100

GPQA Diamond

0.7 / 100

HLE

0.1 / 100

LiveCodeBench

— / 100

SciCode

0.5 / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

— / 30

IFBench

0.5 / 100

LCR

0.5 / 100

Terminal-Bench Hard

0.4 / 100

τ²-Bench

0.4 / 100

aa_omniscience

50.0 / 100

AA-Omniscience Indexaa_omniscience

5.7 / 100

ARC-AGI-1arc_agi

93.7 / 100

ARC-AGI-1 Cost per Taskarc_agi

0.6

ARC-AGI-2arc_agi

74.0 / 100

ARC-AGI-2 Cost per Taskarc_agi

1.5

AA-Omniscience Hallucination RatePredicted

90.8 / 100

Aider PolyglotPredicted

83.5 / 100

AIMEPredicted

0.1 / 30

AIME 2025Predicted

0.8 / 30

AlpacaEval 2.0 LCPredicted

29.9 / 100

AlpacaEval 2.0 RawPredicted

21.0 / 100

BFCL (Berkeley Function Calling)Predicted

51.3

BigCodeBench CompletePredicted

37.5 / 100

BigCodeBench InstructPredicted

29.4 / 100

AA Intelligence Index (Matrix)Predicted

58.7

AA Long Context Reasoning (Matrix)Predicted

76.2

AIME 2024Predicted

98.5

AIME 2025 (Matrix)Predicted

99.9

Arena-Hard AutoPredicted

74.4

BrowseCompPredicted

81.3

BRUMO 2025Predicted

99.7

CMIMC 2025Predicted

90.7

CritPtPredicted

17.9

GPQA Diamond (Matrix)Predicted

88.6

GSM8KPredicted

94.9

HLE (Matrix)Predicted

45.0

HMMT Feb 2025Predicted

95.6

HMMT Nov 2025Predicted

90.2

HumanEvalPredicted

92.9

IFBench (Matrix)Predicted

65.3

IFEvalPredicted

91.1

IMO 2025Predicted

43.8

LiveCodeBench (Matrix)Predicted

82.0

MATH-500 (Matrix)Predicted

98.1

MathArena Apex 2025Predicted

11.1

MMLUPredicted

90.4

MMLU-Pro (Matrix)Predicted

86.0

MMMU-ProPredicted

80.0

MRCR v2Predicted

81.9

OSWorldPredicted

66.2

SimpleQAPredicted

64.3

SMT 2025Predicted

94.4

SWE-bench ProPredicted

53.1

Tau-Bench Telecom (Matrix)Predicted

98.8

Terminal-Bench 2.0Predicted

68.3

Terminal-Bench 1.0Predicted

47.8

USAMO 2025Predicted

30.6

Video-MMUPredicted

85.7

browsecompPredicted

81.7

Aider PolyglotPredicted

0.2

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.7

CAD-EvalPredicted

2.9

CyBenchPredicted

0.8

DeepResearchBenchPredicted

0.5

FictionLiveBenchPredicted

0.9

GdpvalPredicted

0.6

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

3.3

GSOPredicted

0.4

HellaSwagPredicted

0.0

HlePredicted

0.3

Lech Mazur WritingPredicted

8.6

METR Time HorizonsPredicted

46.2

PIQAPredicted

0.8

The Agent CompanyPredicted

59.3

TriviaQAPredicted

20.5

VPCTPredicted

0.7

WinoGrandePredicted

0.8

FrontierMathPredicted

38.7 / 100

GAIA Level 1Predicted

71.7

GAIA Level 2Predicted

45.1

GAIA Level 3Predicted

36.9

GAIAPredicted

54.8 / 100

LiveCodeBenchPredicted

0.6 / 100

LongBench v2 EasyPredicted

79.4

LongBench v2 HardPredicted

26.3

LongBench v2Predicted

23.0 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

70.0 / 100

MedQA (USMLE)Predicted

94.2

MLE-benchPredicted

66.5 / 100

MMLU ProPredicted

0.8 / 100

MMMUPredicted

81.7 / 100

MMTU Table UnderstandingPredicted

73.7 / 100

MT-BenchPredicted

7.8 / 10

NoLiMa (NIAH)Predicted

92.2 / 100

OCRBench v2Predicted

85.3 / 100

Open LLM AveragePredicted

12.3 / 100

Open LLM: BBHPredicted

37.7 / 100

Open LLM: GPQAPredicted

26.6 / 100

Open LLM: IFEvalPredicted

29.5 / 100

Open LLM: MATH Level 5Predicted

1.7 / 100

Open LLM: MMLU-PROPredicted

22.6 / 100

Open LLM: MUSRPredicted

37.9 / 100

RE-BenchPredicted

100.0

SimpleBenchPredicted

65.9 / 100

simpleqaPredicted

58.4

SWE-bench LitePredicted

74.0 / 100

SWE-bench VerifiedPredicted

80.3 / 100

tau-bench RetailPredicted

91.3 / 100

WebArenaPredicted

0.2 / 100

WildBenchPredicted

35.1

BullshitBenchbullshitbench

48.0 / 100

Arena ELO: Codingchatbot_arena

1457.0

Chatbot Arena ELOchatbot_arena

1485.0

Apex Agentsepoch_ai

3.4

Arc Agi 2epoch_ai

0.3

Chess Puzzlesepoch_ai

0.4

Epoch Capabilities Indexepoch_ai

156.0

OTIS Mock AIME 2024–2025epoch_ai

1.0

Posttrainbenchepoch_ai

0.0

SimpleQA Verified (Epoch)epoch_ai

0.4

LegalBenchlegalbench

86.0 / 100

LiveBench Codinglivebench

77.5 / 100

LiveBench Data Analysislivebench

79.3 / 100

LiveBench Languagelivebench

82.6 / 100

LiveBench Mathlivebench

94.2 / 100

LiveBench Overalllivebench

80.3 / 100

LiveBench Reasoninglivebench

88.1 / 100

OpenRouter Token Volumeopenrouter_rankings

305000000000.0

OpenRouter Weekly Trendopenrouter_rankings

42.0

Vectara Factual Consistencyvectara_hallucination

93.0 / 100

Vectara Hallucination Ratevectara_hallucination

7.0 / 100

WeirdMLweirdml

77.7 / 100