arXiv:2607.13393cs.PFcs.AI2026-07

当旧系统输出变成标准,新设计就难被评估,需显式定义独立需求。

The Café in Amsterdam: When the Incumbent Becomes the Oracle

  • 识别‘基准捕获’现象:旧系统输出被当成果标准,阻碍新方案评估
  • 提出‘购买验证器’策略:将需求显式化、独立于旧系统,支持可评估性
  • 案例显示速度提升1.64倍至3.29倍,能耗降低最多3.03倍,适合硬件优化研究者

一个领域在表达需求时可自由重构计算逻辑,但一旦旧系统输出悄然成为规范,重构便难以评估。本文以现代加速器为例,指出将问题转化为硬件友好形式虽能带来显著性能与能效提升,但前提是新方案必须可被判断。基于测试-规约问题(Weyuker;Barr等)、需求工程中的实现偏见(Zave和Jackson),以及用可接受性而非数值接近度评估近似设计的观点(Felzmann等),本文提出“基准捕获”病理:旧系统从证据变为定义。区分两个关键问题——能否评估改革结果,取决于是否存在独立于旧系统的明确需求;是否可自动化发现,则还依赖于该需求的评估成本。短案例包括最短路径路由、可学习音频前端、ZIP-215用于Ed25519签名验证、CESM-ECT气候模型,以及单个GEMM音频前端实测达1.64x–3.29x加速与最高3.03x节能。核心贡献非单一组件创新,而在于建立统一提问框架:任何改革结果的验收测试是否提及旧系统输出?

原文摘要 · Abstract (English)

A field can reformulate its computations freely exactly where its demand is stated independently of any incumbent implementation, and finds itself unable to when the incumbent's own output has quietly become the specification. This note offers that observation as a lens on computational reformulation for modern accelerators, where posing a problem in a hardware-friendly form can yield large speed and energy gains, but only if a replacement can be judged at all. Building on the test-oracle problem (Weyuker; Barr et al.), on requirements engineering's notion of implementation bias (Zave and Jackson), and on the case for judging approximate designs by acceptability rather than numerical proximity (Felzmann et al.), it names the pathology "baseline capture": the moment an incumbent stops being evidence that a demand can be met and becomes the definition of meeting it. It then separates two questions that are easily confused: whether a reformulation can be judged at all, which turns on the existence of an incumbent-independent demand, and whether its discovery can be automated, which turns additionally on the cost of evaluating that demand. Short cases -- shortest-path routing, learnable audio frontends, ZIP-215 for Ed25519 signature validation, CESM-ECT for climate models, and a single-GEMM audio frontend measured at 1.64x-3.29x speedup and up to 3.03x less energy -- illustrate the pattern and the move of "buying a verifier": making a demand explicit, operational, and independent of the incumbent. No component is claimed novel in isolation; the contribution is the synthesis and the single question it makes easy to ask of any reformulation result -- does its acceptance test mention the incumbent's output?

硬件优化基准捕获可验证性性能评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。