arXiv cs.AIbenchmarkgpt*7h agoenergy 99

DeepFinance: Can AI Diligence a $100MM Deal?

image: arXiv cs.AI

arXiv:2611.10926v1 Announce Type: cross Abstract: Existing evaluations of AI models on high-finance work focus on retrieving answers from financial documents and producing numerically correct outputs. Real private equity (PE) and investment banking (IB) work also depends on choosing between conflicting sources, making sound assumptions, and keeping every step auditable. We introduce DeepFinance, an ultra long-horizon benchmark of 21 end-to-end PE and IB tasks that take a human professional an average of 27.1 hours. Each task pairs a request with a data room averaging 19 files and is graded against an average of 84 expert-written rubric criteria covering output, workflow, and judgment. We evaluate 22 model configurations, each in its native agent harness. The best configuration, GPT-6 Astra with max reasoning, satisfies 57.6% of rubric criteria, and the top four configurations are not statistically distinguishable. Frontier models often calculate correctly from the wrong inputs and find decision-relevant evidence without acting on it.

read the original at arXiv cs.AI →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.

more from the stream

AVCORP: Identifying and Resisting Deception via Communication Theory and Theory of Mind (arXiv cs.AI) Coding or Cheating? An Investigation of Frontier Coding LLMs (arXiv cs.AI) Double Blind Evals: Resolving the Dual Confidentiality Dilemma in AI Safety Auditing (arXiv cs.AI) ← back to upsy.si