Skip to content
K = 0.731
Benchmark sources

PRBench · Finance

Scale AI / Professional work · Answers real financial decision questions, assessing professional judgment, derivations and risk explanations.
Official benchmark
Across e/accUnder observation
Evidence budgetNot scored
Upstream data timeUnverified
Last successful syncCollection not started

What it measures and how

Fix either all 600 Finance tasks or the 300 Hard tasks, with consistent search tools, reasoning tiers and judge versions. Use the task set’s aggregate rubric score. Do not double-count full and hard sets or treat professional Q&A as end-to-end office work.

How this evidence is used

Under observation: could add financial judgment evidence. Task sets, tool conditions, stable exports and display terms need verification. Only the source is listed; no automated collection or ranking yet.

Limitations and attribution

Model judgments do not establish completion of financial modeling or spreadsheet work. PRBench Legal and MCP Atlas also belong to Scale; additional boards do not increase the organization’s weight.

Data license: Official tasks and evaluation code are public. Their licenses do not automatically cover live leaderboard results. Stable exports and display terms for the latest results remain to be confirmed.

Results are published by Scale AI. Raw scores and the e/acc consensus index use different scales and cannot be added directly.