Llama 2 Chat 7B

July 18, 2023Last synced Jun 12, 2026, 8:42 PM

Human Frontier

—

Human-calibrated frontier signal, backed by Arena-style preference evidence and separate from raw AgMoBench benchmark composite scores.

Blended Price

$0.10/M

Input Price

$0.050/M

Output Price

$0.25/M

Speed

108 tok/s

TTFT

5.61s

Benchmark Scores

Intelligence Index

Performance Radar

Llama 2 Chat 7B

Field Average

External Benchmarks

AlpacaEval 2.0 LC

How Llama 2 Chat 7B Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $37.5

AgMoBench Overall≥ 2.0

Providers

ai2ai21-labsalibabaanthropicarceeawsazurebaidu

Show quadrants

alibaba

mistral

anthropic

openai

meta

liquidai

nvidia

azure

google

deepseek

stepfun

cohere

minimax

ibm

nous-research

multiversecomputing

kimi

aws

zai

deepcogito

kwaikat

xai

xiaomi

ai21-labs

inclusionai

baidu

sarvam

prime-intellect

bytedance_seed

inception

upstage

reka-ai

tencent

arcee

ai2

swiss-ai-initiative

perplexity

Bubble size = Context Window

8191.00

2000000.00

Compare with other models

GPQA Diamond

0.2 / 100

LiveCodeBench

0.0 / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

AlpacaEval 2.0 Rawalpacaeval

7.6 / 100

AA-Omniscience AccuracyPredicted

65.5 / 100

AA-Omniscience Hallucination RatePredicted

98.9 / 100

Aider PolyglotPredicted

26.1 / 100

AIME 2025Predicted

0.0 / 30

ARC-AGI-1Predicted

99.9 / 100

ARC-AGI-1 Cost per TaskPredicted

52.6

ARC-AGI-2Predicted

100.0 / 100

ARC-AGI-2 Cost per TaskPredicted

67.1

BFCL (Berkeley Function Calling)Predicted

13.6

BigCodeBench CompletePredicted

5.2 / 100

BigCodeBench InstructPredicted

4.2 / 100

AA Intelligence Index (Matrix)Predicted

26.5

AA Long Context Reasoning (Matrix)Predicted

85.2

AIME 2024Predicted

37.4

AIME 2025 (Matrix)Predicted

99.9

Arena-Hard AutoPredicted

22.8

BrowseCompPredicted

98.7

BRUMO 2025Predicted

100.0

CMIMC 2025Predicted

99.7

CritPtPredicted

99.5

GPQA Diamond (Matrix)Predicted

44.1

HLE (Matrix)Predicted

83.0

HMMT Feb 2025Predicted

97.7

HMMT Nov 2025Predicted

98.2

HumanEvalPredicted

25.2

IFBench (Matrix)Predicted

54.3

IFEvalPredicted

70.4

IMO 2025Predicted

94.6

LiveCodeBench (Matrix)Predicted

28.3

MATH-500 (Matrix)Predicted

82.3

MathArena Apex 2025Predicted

98.0

MMLU-Pro (Matrix)Predicted

21.5

MMMU-ProPredicted

68.2

MRCR v2Predicted

89.9

OSWorldPredicted

41.2

SimpleQAPredicted

90.6

SMT 2025Predicted

99.3

SWE-bench ProPredicted

34.5

Tau-Bench Telecom (Matrix)Predicted

99.9

Terminal-Bench 2.0Predicted

99.5

Terminal-Bench 1.0Predicted

74.6

USAMO 2025Predicted

36.7

Video-MMUPredicted

80.2

browsecompPredicted

96.4

BullshitBenchPredicted

93.1 / 100

Aider PolyglotPredicted

0.2

Apex AgentsPredicted

12.8

Arc Agi 2Predicted

99.2

BIG-Bench HardPredicted

3.0

CAD-EvalPredicted

16.4

Chess PuzzlesPredicted

2.0

CyBenchPredicted

0.7

DeepResearchBenchPredicted

0.7

FictionLiveBenchPredicted

0.6

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

4.8

HellaSwagPredicted

0.0

Lech Mazur WritingPredicted

7.4

METR Time HorizonsPredicted

98.1

OTIS Mock AIME 2024–2025Predicted

0.0

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

1.2

The Agent CompanyPredicted

0.6

TriviaQAPredicted

56.4

WinoGrandePredicted

0.5

FrontierMathPredicted

92.1 / 100

GAIA Level 1Predicted

0.9

GAIA Level 2Predicted

0.0

GAIA Level 3Predicted

0.0

GAIAPredicted

0.6 / 100

IFBenchPredicted

0.2 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

0.5 / 100

LiveBench CodingPredicted

91.4 / 100

LiveBench Data AnalysisPredicted

94.4 / 100

LiveBench LanguagePredicted

97.9 / 100

LiveBench MathPredicted

98.7 / 100

LiveBench OverallPredicted

96.2 / 100

LiveBench ReasoningPredicted

98.7 / 100

LongBench v2 EasyPredicted

16.4

LongBench v2 HardPredicted

10.3

LongBench v2Predicted

10.5 / 100

MathVistaPredicted

17.3 / 100

MedQA (USMLE)Predicted

21.4

MLE-benchPredicted

98.0 / 100

MMMUPredicted

47.6 / 100

MMTU Table UnderstandingPredicted

54.7 / 100

MT-BenchPredicted

7.3 / 10

NoLiMa (NIAH)Predicted

53.5 / 100

OCRBench v2Predicted

19.4 / 100

Open LLM AveragePredicted

3.0 / 100

Open LLM: BBHPredicted

11.8 / 100

Open LLM: GPQAPredicted

17.1 / 100

Open LLM: IFEvalPredicted

26.0 / 100

Open LLM: MATH Level 5Predicted

0.2 / 100

Open LLM: MMLU-PROPredicted

5.2 / 100

Open LLM: MUSRPredicted

26.6 / 100

RE-BenchPredicted

100.0

SimpleBenchPredicted

82.3 / 100

simpleqaPredicted

75.2

SWE-bench LitePredicted

7.2 / 100

SWE-bench VerifiedPredicted

74.5 / 100

τ²-BenchPredicted

0.0 / 100

tau-bench RetailPredicted

98.9 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

65.6 / 100

Vectara Hallucination RatePredicted

34.4 / 100

WebArenaPredicted

0.0 / 100

WeirdMLPredicted

25.6 / 100

WildBenchPredicted

7.7