Models Agents EvalsIndustry

AgMoDB by @mistakeknot

DeepSeek V3.1 (Non-reasoning) | AgMoDB

DeepSeek V3.1 (Non-reasoning)

August 21, 2025Last synced Apr 7, 2026, 4:00 PM

Blended Price

$0.84/M

Input Price

$0.56/M

Output Price

$1.68/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How DeepSeek V3.1 (Non-reasoning) Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

28.1

Coding Index

28.4

Math Index

49.7

MMLU Pro

0.8 / 100

GPQA Diamond

0.7 / 100

HLE

0.1 / 100

LiveCodeBench

0.6 / 100

SciCode

0.4 / 100

MATH-500

— / 100

AIME

— / 30

AIME 2025

0.5 / 30

IFBench

0.4 / 100

LCR

0.5 / 100

Terminal-Bench Hard

0.2 / 100

τ²-Bench

0.3 / 100

Predicted

38.6 / 100

AA-Omniscience Hallucination RatePredicted

95.7 / 100

Aider PolyglotPredicted

54.2 / 100

AIMEPredicted

0.7 / 30

AlpacaEval 2.0 LCPredicted

36.6 / 100

AlpacaEval 2.0 RawPredicted

28.5 / 100

ARC-AGI-1Predicted

11.9 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

0.1 / 100

ARC-AGI-2 Cost per TaskPredicted

0.1

BFCL (Berkeley Function Calling)Predicted

47.9

BigCodeBench CompletePredicted

58.1 / 100

BigCodeBench InstructPredicted

47.8 / 100

AA Intelligence Index (Matrix)Predicted

69.9

AA Long Context Reasoning (Matrix)Predicted

71.0

AIME 2024Predicted

90.5

AIME 2025 (Matrix)Predicted

87.2

Arena-Hard AutoPredicted

79.9

BrowseCompPredicted

59.5

BRUMO 2025Predicted

84.8

CMIMC 2025Predicted

73.7

CritPtPredicted

2.6

GPQA Diamond (Matrix)Predicted

77.8

GSM8KPredicted

93.7

HLE (Matrix)Predicted

16.0

HMMT Feb 2025Predicted

66.1

HMMT Nov 2025Predicted

63.8

HumanEvalPredicted

90.5

IFBench (Matrix)Predicted

45.0

IFEvalPredicted

87.9

IMO 2025Predicted

14.7

LiveCodeBench (Matrix)Predicted

69.4

MATH-500 (Matrix)Predicted

96.8

MathArena Apex 2025Predicted

0.8

MMLUPredicted

88.4

MMLU-Pro (Matrix)Predicted

82.4

MMMU-ProPredicted

81.6

MRCR v2Predicted

81.7

OSWorldPredicted

37.4

SimpleQAPredicted

28.2

SMT 2025Predicted

80.7

SWE-bench ProPredicted

36.0

Tau-Bench Telecom (Matrix)Predicted

43.2

Terminal-Bench 2.0Predicted

19.6

Terminal-Bench 1.0Predicted

19.6

USAMO 2025Predicted

10.1

Video-MMUPredicted

86.7

browsecompPredicted

53.6

BullshitBenchPredicted

16.1 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.7

Arc Agi 2Predicted

0.0

BALROGPredicted

0.0

BIG-Bench HardPredicted

3.0

BoolQPredicted

0.8

CAD-EvalPredicted

4.1

Chess PuzzlesPredicted

0.1

CyBenchPredicted

0.2

DeepResearchBenchPredicted

0.3

GdpvalPredicted

0.2

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

7.3

GSOPredicted

0.0

HellaSwagPredicted

0.7

HlePredicted

0.1

METR Time HorizonsPredicted

0.9

OTIS Mock AIME 2024–2025Predicted

0.4

PIQAPredicted

0.8

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.3

The Agent CompanyPredicted

2.1

TriviaQAPredicted

4.6

VPCTPredicted

0.4

WinoGrandePredicted

0.9

FrontierMathPredicted

12.5 / 100

GAIA Level 1Predicted

67.4

GAIA Level 2Predicted

52.8

GAIA Level 3Predicted

27.9

GAIAPredicted

50.8 / 100

LegalBenchPredicted

89.6 / 100

LiveBench CodingPredicted

65.6 / 100

LiveBench Data AnalysisPredicted

42.8 / 100

LiveBench LanguagePredicted

52.5 / 100

LiveBench MathPredicted

60.7 / 100

LiveBench OverallPredicted

45.8 / 100

LiveBench ReasoningPredicted

40.5 / 100

LongBench v2 EasyPredicted

52.3

LongBench v2 HardPredicted

47.2

LongBench v2Predicted

42.7 / 100

MATH-500Predicted

0.9 / 100

MathVistaPredicted

69.1 / 100

MedQA (USMLE)Predicted

88.1

MLE-benchPredicted

22.4 / 100

MMMUPredicted

75.8 / 100

MMTU Table UnderstandingPredicted

57.8 / 100

MT-BenchPredicted

7.9 / 10

NoLiMa (NIAH)Predicted

94.3 / 100

OCRBench v2Predicted

85.0 / 100

Open LLM AveragePredicted

32.6 / 100

Open LLM: BBHPredicted

61.7 / 100

Open LLM: GPQAPredicted

33.5 / 100

Open LLM: IFEvalPredicted

58.8 / 100

Open LLM: MATH Level 5Predicted

27.1 / 100

Open LLM: MMLU-PROPredicted

46.3 / 100

Open LLM: MUSRPredicted

44.0 / 100

RE-BenchPredicted

3.2

simpleqaPredicted

28.7

SWE-bench LitePredicted

32.2 / 100

SWE-bench VerifiedPredicted

53.2 / 100

tau-bench RetailPredicted

77.1 / 100

WebArenaPredicted

6.6 / 100

WeirdMLPredicted

40.2 / 100

WildBenchPredicted

46.2

Epoch Capabilities Indexepoch_ai

138.9

FictionLiveBenchepoch_ai

0.5

Lech Mazur Writingepoch_ai

8.5

SimpleBenchsimplebench

40.0 / 100

Vectara Factual Consistencyvectara_hallucination

94.5 / 100

Vectara Hallucination Ratevectara_hallucination

5.5 / 100