Llama 2 Chat 7B

July 18, 2023Last synced Apr 7, 2026, 4:00 PM

Blended Price

$0.10/M

Input Price

$0.050/M

Output Price

$0.25/M

Speed

119 tok/s

TTFT

0.60s

Benchmark Scores

Intelligence Index

External Benchmarks

AlpacaEval 2.0 LC

How Llama 2 Chat 7B Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

GPQA Diamond

0.2 / 100

LiveCodeBench

0.0 / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

AlpacaEval 2.0 Rawalpacaeval

7.6 / 100

AA-Omniscience AccuracyPredicted

65.5 / 100

AA-Omniscience Hallucination RatePredicted

98.9 / 100

Aider PolyglotPredicted

26.1 / 100

AIME 2025Predicted

0.0 / 30

ARC-AGI-1Predicted

99.9 / 100

ARC-AGI-1 Cost per TaskPredicted

52.6

ARC-AGI-2Predicted

100.0 / 100

ARC-AGI-2 Cost per TaskPredicted

67.1

BFCL (Berkeley Function Calling)Predicted

13.6

BigCodeBench CompletePredicted

5.2 / 100

BigCodeBench InstructPredicted

4.2 / 100

AA Intelligence Index (Matrix)Predicted

26.5

AA Long Context Reasoning (Matrix)Predicted

85.2

AIME 2024Predicted

37.4

AIME 2025 (Matrix)Predicted

99.9

Arena-Hard AutoPredicted

22.8

BrowseCompPredicted

98.7

BRUMO 2025Predicted

100.0

CMIMC 2025Predicted

99.7

CritPtPredicted

99.5

GPQA Diamond (Matrix)Predicted

44.1

HLE (Matrix)Predicted

83.0

HMMT Feb 2025Predicted

97.7

HMMT Nov 2025Predicted

98.2

HumanEvalPredicted

25.2

IFBench (Matrix)Predicted

54.3

IFEvalPredicted

70.4

IMO 2025Predicted

94.6

LiveCodeBench (Matrix)Predicted

28.3

MATH-500 (Matrix)Predicted

82.3

MathArena Apex 2025Predicted

98.0

MMLU-Pro (Matrix)Predicted

21.5

MMMU-ProPredicted

68.2

MRCR v2Predicted

89.9

OSWorldPredicted

41.2

SimpleQAPredicted

90.6

SMT 2025Predicted

99.3

SWE-bench ProPredicted

34.5

Tau-Bench Telecom (Matrix)Predicted

99.9

Terminal-Bench 2.0Predicted

99.5

Terminal-Bench 1.0Predicted

74.6

USAMO 2025Predicted

36.7

Video-MMUPredicted

80.2

browsecompPredicted

95.4

BullshitBenchPredicted

93.1 / 100

Aider PolyglotPredicted

0.2

Apex AgentsPredicted

12.8

Arc Agi 2Predicted

99.2

BIG-Bench HardPredicted

3.0

CAD-EvalPredicted

16.4

Chess PuzzlesPredicted

2.0

CyBenchPredicted

0.7

DeepResearchBenchPredicted

0.7

FictionLiveBenchPredicted

0.6

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

4.8

HellaSwagPredicted

0.0

Lech Mazur WritingPredicted

7.4

METR Time HorizonsPredicted

98.1

OTIS Mock AIME 2024–2025Predicted

0.0

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

1.2

The Agent CompanyPredicted

0.6

TriviaQAPredicted

56.4

WinoGrandePredicted

0.5

FrontierMathPredicted

92.1 / 100

GAIA Level 1Predicted

0.9

GAIA Level 2Predicted

0.0

GAIA Level 3Predicted

0.0

GAIAPredicted

0.6 / 100

IFBenchPredicted

0.2 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

0.5 / 100

LiveBench CodingPredicted

91.4 / 100

LiveBench Data AnalysisPredicted

94.4 / 100

LiveBench LanguagePredicted

97.9 / 100

LiveBench MathPredicted

98.7 / 100

LiveBench OverallPredicted

96.2 / 100

LiveBench ReasoningPredicted

98.7 / 100

LongBench v2 EasyPredicted

16.4

LongBench v2 HardPredicted

10.3

LongBench v2Predicted

10.5 / 100

MathVistaPredicted

17.3 / 100

MedQA (USMLE)Predicted

21.4

MLE-benchPredicted

98.0 / 100

MMMUPredicted

47.6 / 100

MMTU Table UnderstandingPredicted

54.7 / 100

MT-BenchPredicted

7.3 / 10

NoLiMa (NIAH)Predicted

53.5 / 100

OCRBench v2Predicted

19.4 / 100

Open LLM AveragePredicted

3.0 / 100

Open LLM: BBHPredicted

11.8 / 100

Open LLM: GPQAPredicted

17.1 / 100

Open LLM: IFEvalPredicted

26.0 / 100

Open LLM: MATH Level 5Predicted

0.2 / 100

Open LLM: MMLU-PROPredicted

5.2 / 100

Open LLM: MUSRPredicted

26.6 / 100

RE-BenchPredicted

100.0

SimpleBenchPredicted

82.3 / 100

simpleqaPredicted

75.2

SWE-bench LitePredicted

7.2 / 100

SWE-bench VerifiedPredicted

74.5 / 100

τ²-BenchPredicted

0.0 / 100

tau-bench RetailPredicted

98.9 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

65.6 / 100

Vectara Hallucination RatePredicted

34.4 / 100

WebArenaPredicted

0.0 / 100

WeirdMLPredicted

25.6 / 100

WildBenchPredicted

7.7