arXiv:2609.05905cs.CLcs.LG2026-09

让AI预测更可审计,通过结构化流程提升准确性和透明度。

From Narrative to Auditable Forecasts: A Structured Scaffold for Agentic Forecasting

论文配图:From Narrative to Auditable Forecasts: A Structured Scaffold for Agentic Forecasting
图 1 · 摘自论文原文
  • 用基准模型定起点,再机械式更新概率,路径清晰可追溯。
  • 在多个实时预测任务中,准确率和校准性优于主流方法。
  • 报告可审计,适合需要透明决策过程的研究与风控场景。

大语言模型代理正被用于实时预测,但现有方法依赖隐式叙事整合:代理收集证据、以文字讨论后给出概率,缺乏从证据到预测的显式推理路径,影响准确性与可审计性。本文提出AuditForecast,一种结构化的概率预测框架。该框架首先以合适的定量基准模型锚定初始预测,通过模型引导的数据检索获取基础概率,再在模型能力之外,通过几率空间中的机械聚合方式引入情境因素调整。这将预测从基于文字段落的判断转变为具有显式中间结果的结构化过程。在多个实时预测基准测试中,AuditForecast在准确性与校准性上优于强基线模型,部分场景超越市场隐含参考值,且显著优于更昂贵的深度研究型代理,同时在成本-准确率权衡中保持帕累托优势。此外,该框架生成可审计的预测报告,使预测构建过程透明,支持系统性事后分析。

原文摘要 · Abstract (English)

LLM agents are increasingly used for live forecasting, where they retrieve up-to-date information and produce estimates for unresolved future events. However, current agentic forecasting often relies on implicit narrative aggregation: agents collect evidence, discuss it in prose, and often assign a probability without an explicit update path from evidence to forecast. This limits both forecasting accuracy and auditability. We propose AuditForecast, an agentic scaffold for structured probabilistic forecasting. AuditForecast first anchors the forecast with a suitable quantitative baseline model, uses model-guided data retrieval to derive a base probability, and then applies situational factor updates outside the model's scope through mechanical aggregation in odds space. This turns forecasting from a prose-based judgment into a structured process with explicit intermediate objects. Across multiple live forecasting benchmarks, AuditForecast improves forecasting accuracy and calibration relative to strong agentic baselines, surpasses market-implied references in several settings, and outperforms substantially more expensive deep-research agents while remaining Pareto-dominant in the cost--accuracy tradeoff. Beyond performance gains, AuditForecast produces an auditable forecasting report that makes forecast construction explicit and supports systematic post hoc analysis.

AI预测可解释性结构化推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。