Human Frontier
—
Human-calibrated frontier signal, backed by Arena-style preference evidence and separate from raw AgMoBench benchmark composite scores.
Blended Price
$4.00/M
Input Price
$2.00/M
Output Price
$10.00/M
Speed
81 tok/s
TTFT
108.85s
Axes
Filters
Providers
v2026.06 · official-100-task · Claude Sonnet 5 (max) · harness mini-swe-agent · effort max · 1 attempt · pass@1 · harbor:snorkel-ai/senior-swe-bench-v2026.06 · provider anthropic/claude-sonnet-5 · record sonnet-5-bed-mini-swe · run 7f13b0ad9a70cf6c02d279345f50812ad030149bea9991d3eac8101cbf78ef43
{
"taskCount": 100,
"agentGroup": "mini-swe-agent:claude-sonnet-5",
"basicPassAt1": 50.53763440860215,
"basicPassAt3": 59.13978494623656,
"datasetPackage": "snorkel-ai/senior-swe-bench-v2026.06",
"publicTaskCount": 50,
"tastefulPassAt1": 27.956989247311824,
"tastefulPassAt3": 37.634408602150536,
"agentDescription": "TEMP: Sonnet 5 @bedrock half of the provider split (effort=max)",
"privateTaskCount": 50,
"upstreamProvider": "anthropic",
"upstreamRunCount": 49,
"averageAgentSteps": 318.4623655913978,
"averageOutputTokens": 180719.59139784946,
"averageTotalCostUsd": 23.426825863225808,
"averageOutputCostUsd": 2.7107938709677417,
"basicAllThreePassRate": 34.40860215053764,
"tastefulAllThreePassRate": 13.978494623655912
}Evidence observed 2026-07-22
v2026.06 · official-100-task · Claude Sonnet 5 (max) · harness mini-swe-agent · effort max · 1 attempt · pass@1 · harbor:snorkel-ai/senior-swe-bench-v2026.06 · provider anthropic/claude-sonnet-5 · record sonnet-5-mini-swe · run 223953bb4638ed366183df51d3cce69709ef29fe264a65921e7ed96e4db8a307
{
"taskCount": 100,
"agentGroup": "mini-swe-agent:claude-sonnet-5",
"basicPassAt1": 39.53488372093023,
"datasetPackage": "snorkel-ai/senior-swe-bench-v2026.06",
"publicTaskCount": 50,
"tastefulPassAt1": 17.441860465116278,
"agentDescription": "Claude Sonnet 5 via mini-swe-agent at adaptive-thinking effort=max (headline)",
"privateTaskCount": 50,
"upstreamProvider": "anthropic",
"upstreamRunCount": 48,
"averageAgentSteps": 333.1190476190476,
"averageOutputTokens": 445451.7619047619,
"averageTotalCostUsd": 21.683269077142857,
"averageOutputCostUsd": 6.681776428571428
}Evidence observed 2026-07-04