用分层推理与对抗性测试提升大模型在机械设计中的可靠性。
R-APS: Compositional Reasoning and In-Context Meta-Learning for Constrained Design via Reflective Adversarial Pareto Search

- 将不同推理模式分离到独立上下文,分阶段验证设计可行性。
- 在32条轨迹上实现3.5倍更紧的鲁棒性证明,迭代速度提升46%。
- 无需微调,小模型(4B)也能媲美大模型(70B),适合工程优化场景。
大语言模型在开放任务中表现流畅,但在需要长期规划、工具使用和自主行动的智能体场景中,流畅性并不保证可靠输出。我们指出这一差距源于三个相互关联的结构性缺陷:错误传播缺乏定位、最坏情况扰动未被评估、累积知识从未被否定。这些缺陷的根源在于:溯因、反事实、元归纳、修正和归纳等推理方式对共享上下文施加了不兼容的拉力。为此,我们提出反射式对抗帕累托搜索(R-APS),据我们所知是首个通过推理模式解耦,同时解决三大缺陷的方法。该方法为每种推理模式分配独立上下文,并在三重时间尺度上协调交互:基于类型化验证批评者的组合式分阶段推理(定位失败)、以敏感性引导的反事实压力测试作为首类帕累托目标(增强鲁棒性),以及带显式否定机制的元归纳规则提取(持久记忆)。R-APS无需微调,仅通过结构化协议设计即可在冻结的LLM上运行。我们在平面机构合成(机器人、假肢、机械设计)任务上评估,每个候选方案均经运动学求解器验证。在32个目标轨迹上,R-APS实现的鲁棒性证书比均匀扰动基线紧3.5倍,首次通过迭代速度提升46%,且在联合控制杆件数量与最坏情况鲁棒性的前提下,比枚举+遗传算法(Enum+GA)减少2.1倍的Chamfer距离。小型4B推理专用模型在协议内表现可媲美通用70B主干模型,表明结构化协议可在一定程度上弥补模型规模差距。
原文摘要 · Abstract (English)
Large language models (LLMs) are fluent on open-ended tasks, yet in agentic settings, where a system must plan, use tools, and act over extended horizons, fluency does not ensure reliable delivery. We trace this gap to three coupled structural failures: errors propagate without localization, worst-case perturbations go unevaluated, and accumulated knowledge is never invalidated. We argue these share a root cause: abductive, counterfactual, meta-inductive, corrective, and inductive reasoning pull a shared context in incompatible directions. We introduce Reflective Adversarial Pareto Search (R-APS), to our knowledge the first method addressing all three failures jointly via reasoning-mode decomposition, allocating each reasoning mode its own context and orchestrating interaction across three timescales: staged compositional reasoning with a typed validation critic (failure localization), sensitivity-guided counterfactual stress-testing as a first-class Pareto objective (robustness), and meta-inductive rule extraction with explicit invalidation (persistent memory). R-APS requires no fine-tuning and operates on a frozen LLM purely via structured protocol design. We evaluate on planar mechanism synthesis (robotics, prosthetics, mechanical design), with every candidate checked by a kinematic solver. On 32 target trajectories, R-APS delivers robustness certificates 3.5x tighter than uniform-perturbation baselines, 46% faster iterations-to-first-admission, and 2.1x Chamfer-distance reduction over Enum+GA while jointly controlling bar-count and worst-case robustness. Small 4B reasoning-specialized models prove competitive with general-purpose 70B backbones inside the protocol, suggesting structured protocols can partially offset model scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。