PALM-2

May 10, 2023Last synced Apr 7, 2026, 4:00 PM

Blended Price

Free/M

Input Price

Free/M

Output Price

Free/M

Speed

0 tok/s

TTFT

0.00s

Benchmark Scores

Intelligence Index

External Benchmarks

AA-Omniscience Accuracy

How PALM-2 Compares

Axes

X Axis

Y Axis

Bubble Size

Filters

Blended Price (USD)$0.00 – $30.0

AgMoBench Overall≥ 3.5

Providers

ai21-labsalibabaanthropicawsazurebaiducoheredeepseek

Show quadrants

anthropic

openai

google

meta

mistral

nvidia

kimi

xai

azure

deepseek

aws

cohere

baidu

ai21-labs

zai

reka-ai

xiaomi

alibaba

minimax

ibm

Bubble size = Context Window

16384.00

2000000.00

Compare with other models

GPQA Diamond

— / 100

LiveCodeBench

— / 100

Terminal-Bench Hard

— / 100

τ²-Bench

— / 100

AA-Omniscience Hallucination RatePredicted

95.1 / 100

Aider PolyglotPredicted

16.6 / 100

AIMEPredicted

0.0 / 30

AIME 2025Predicted

0.1 / 30

AlpacaEval 2.0 LCPredicted

31.5 / 100

AlpacaEval 2.0 RawPredicted

24.8 / 100

ARC-AGI-1Predicted

6.4 / 100

ARC-AGI-1 Cost per TaskPredicted

0.0

ARC-AGI-2Predicted

60.0 / 100

ARC-AGI-2 Cost per TaskPredicted

0.0

BFCL (Berkeley Function Calling)Predicted

29.5

BigCodeBench CompletePredicted

46.8 / 100

BigCodeBench InstructPredicted

37.7 / 100

AA Intelligence Index (Matrix)Predicted

61.7

AA Long Context Reasoning (Matrix)Predicted

71.8

AIME 2024Predicted

36.5

AIME 2025 (Matrix)Predicted

36.3

Arena-Hard AutoPredicted

39.3

BrowseCompPredicted

68.1

BRUMO 2025Predicted

89.8

CMIMC 2025Predicted

76.6

GPQA Diamond (Matrix)Predicted

49.3

HLE (Matrix)Predicted

14.6

HMMT Feb 2025Predicted

40.7

HMMT Nov 2025Predicted

90.2

HumanEvalPredicted

76.1

IFBench (Matrix)Predicted

30.5

IFEvalPredicted

77.7

IMO 2025Predicted

15.4

LiveCodeBench (Matrix)Predicted

38.3

MATH-500 (Matrix)Predicted

89.1

MathArena Apex 2025Predicted

1.6

MMLU-Pro (Matrix)Predicted

62.7

MMMU-ProPredicted

78.9

MRCR v2Predicted

76.0

OSWorldPredicted

52.0

SimpleQAPredicted

24.6

SMT 2025Predicted

81.6

SWE-bench ProPredicted

40.9

Tau-Bench Telecom (Matrix)Predicted

96.6

Terminal-Bench 2.0Predicted

29.1

Terminal-Bench 1.0Predicted

15.6

USAMO 2025Predicted

5.7

Video-MMUPredicted

85.4

browsecompPredicted

67.3

BullshitBenchPredicted

8.8 / 100

Aider PolyglotPredicted

0.0

Apex AgentsPredicted

2.6

Arc Agi 2Predicted

60.0

BIG-Bench HardPredicted

3.0

CAD-EvalPredicted

7.5

Chess PuzzlesPredicted

0.2

CyBenchPredicted

0.1

DeepResearchBenchPredicted

0.3

FictionLiveBenchPredicted

0.3

GeoBenchPredicted

0.0

GSM8K (Epoch)Predicted

1.5

Lech Mazur WritingPredicted

6.9

METR Time HorizonsPredicted

1.8

OTIS Mock AIME 2024–2025Predicted

0.1

PosttrainbenchPredicted

0.0

SimpleQA Verified (Epoch)Predicted

0.3

The Agent CompanyPredicted

1.1

FrontierMathPredicted

16.2 / 100

GAIA Level 1Predicted

21.1

GAIA Level 2Predicted

9.4

GAIA Level 3Predicted

0.0

GAIAPredicted

13.2 / 100

GPQA DiamondPredicted

0.4 / 100

HLEPredicted

0.0 / 100

IFBenchPredicted

0.2 / 100

LCRPredicted

0.0 / 100

LegalBenchPredicted

67.6 / 100

LiveBench CodingPredicted

67.7 / 100

LiveBench Data AnalysisPredicted

46.0 / 100

LiveBench LanguagePredicted

56.7 / 100

LiveBench MathPredicted

65.1 / 100

LiveBench OverallPredicted

48.9 / 100

LiveBench ReasoningPredicted

43.9 / 100

LiveCodeBenchPredicted

0.2 / 100

LongBench v2 EasyPredicted

36.9

LongBench v2 HardPredicted

34.4

LongBench v2Predicted

31.4 / 100

MATH-500Predicted

0.6 / 100

MathVistaPredicted

51.2 / 100

MedQA (USMLE)Predicted

66.4

MLE-benchPredicted

23.1 / 100

MMLU ProPredicted

0.6 / 100

MMMUPredicted

58.8 / 100

MMTU Table UnderstandingPredicted

47.1 / 100

NoLiMa (NIAH)Predicted

89.3 / 100

OCRBench v2Predicted

72.2 / 100

Open LLM AveragePredicted

34.8 / 100

Open LLM: BBHPredicted

60.7 / 100

Open LLM: GPQAPredicted

35.9 / 100

Open LLM: IFEvalPredicted

67.2 / 100

Open LLM: MATH Level 5Predicted

30.7 / 100

Open LLM: MMLU-PROPredicted

45.0 / 100

Open LLM: MUSRPredicted

42.5 / 100

RE-BenchPredicted

62.3

SciCodePredicted

0.1 / 100

SimpleBenchPredicted

24.7 / 100

simpleqaPredicted

21.5

SWE-bench LitePredicted

63.8 / 100

SWE-bench VerifiedPredicted

41.6 / 100

τ²-BenchPredicted

0.0 / 100

tau-bench RetailPredicted

80.7 / 100

Terminal-Bench HardPredicted

0.0 / 100

Vectara Factual ConsistencyPredicted

92.7 / 100

Vectara Hallucination RatePredicted

7.3 / 100

WebArenaPredicted

1.8 / 100

WeirdMLPredicted

21.9 / 100

WildBenchPredicted

23.4

HellaSwagepoch_ai

1.0

OpenBookQAepoch_ai

0.6

Parameter Countepoch_ai

340000000000.0

Training Computeepoch_ai

7.34e+24

TriviaQAepoch_ai

1.0

WinoGrandeepoch_ai

0.8

MT-Benchmtbench

6.4 / 10