Frontier AI performance across the business disciplines: a case-grounded benchmark of knowledge work and analytical reasoning

LLM Other LLM NLP Benchmarks
2026年07月17日
大语言模型(LLMs)的性能正以基准测试分数为标志迅速提升;然而,当前主流的人工智能基准测试主要考察的是事实性记忆、狭义问答、数学解题、编程能力以及代理式工具调用等特定能力。相比之下,白领专业人士日常从事的分析型知识工作——例如整合复杂信息、在不确定性与信息不充分条件下作出判断、在多方利益相关者环境中开展战略思维与对抗性思考、权衡取舍,并产出可辩护、结构清晰的分析成果——却长期缺乏有效衡量。这一测量缺口在涉及此类工作的主观维度时尤为突出,因为其成功标准本身往往难以明确定义。“案例教学法”是顶尖商学院普遍采用的教学范式,天然适合作为弥补上述评估空白的基础。为此,我们构建了“商业案例评测基准”(BusinessCaseBench):该基准涵盖十八个学科领域的数百道真实商业案例题目,每道题均配有源自专家撰写的教师版案例解答所提炼出的详细评分量规。在BusinessCaseBench上,当前最先进的AI模型已能高度契合教师评分量规;而在同一模型家族内部,其能力在两年间亦实现了显著提升。这些结果有力表明,人工智能在这一类分析型知识工作上的实际表现不仅已达到较高水平,且正快速演进——这对商学院具有深远影响,因其案例教学法正是用以培养本科生与MBA学员此类分析推理能力的核心路径;同时,这也对初级专业岗位构成重要启示,因为此类技能历来是职场新人早期职业发展的核心能力基础。
Large language models (LLMs) are improving rapidly as reflected in benchmark scores, yet these AI benchmarks largely test capabilities such as factual recall, narrow question answering, mathematical problem-solving, and coding and agentic tool-use. What remains poorly measured is AI progress on the analytical knowledge work white-collar professionals perform daily, including synthesizing complex information, exercising judgment under uncertainty and incomplete information, applying strategic and adversarial thinking in multi-stakeholder settings, weighing trade-offs, and producing defensible, structured analyses. This gap is even more pronounced for subjective components of such work, where success can be challenging to define. The "case method" form of education practiced by top business schools provides a natural foundation for addressing this measurement gap, and we construct BusinessCaseBench, a benchmark spanning hundreds of questions drawn from business cases across eighteen disciplines, each paired with a grading rubric derived from the expert-written instructor case solution. On BusinessCaseBench, frontier AI models already score highly against instructor rubrics, and capability within one model family improves substantially over two years. These results provide strong evidence that AI performance on this class of work is already high and rapidly improving, with implications for business schools, where case pedagogy trains undergraduates and MBAs in this kind of analytical reasoning, and for entry-level professional roles, where such skills have historically anchored early-career work.
许愿