揭示具身智能的神经症行为,提出检测与修复方法。
The Irrational Machine: Neurosis and the Limits of Algorithmic Safety
- 构建神经症行为框架,识别多种内洽但脱实的行为模式。
- 发现即使可见全貌,恐惧成本仍可导致长期绕行。
- 用演化测试生成对抗场景,暴露系统深层缺陷。
我们提出一个刻画具身人工智能中神经症行为的框架:这些行为内部自洽却与现实脱节,源于规划、不确定性处理和厌恶记忆之间的相互作用。在网格导航任务中,我们归纳出包括来回切换、计划反复、强迫循环、僵直、过度警觉、徒劳搜寻、信念不一致、决策挣扎、走廊震荡、最优性执念、度量错配、策略振荡及有限视野变体在内的多种典型模式。针对每种模式,我们设计轻量级在线检测器与可复用的逃生策略(短承诺、切换余量、平滑处理、合理仲裁)。进一步表明,当习得的厌恶代价主导局部选择时,即使全局路径安全,持久的恐惧回避仍可能持续存在,造成长距离绕行。通过将第一/二/三定律作为安全延迟、指令服从与资源效率的工程隐喻,我们指出局部修补无法解决根本问题;全局失效可能依然潜藏。为此,我们提出基于遗传编程的破坏性测试,通过演化世界与扰动以最大化法则压力与神经症得分,生成对抗性训练集与反事实轨迹,揭示架构层面重构的必要性,而非仅限于症状修复。
原文摘要 · Abstract (English)
We present a framework for characterizing neurosis in embodied AI: behaviors that are internally coherent yet misaligned with reality, arising from interactions among planning, uncertainty handling, and aversive memory. In a grid navigation stack we catalogue recurrent modalities including flip-flop, plan churn, perseveration loops, paralysis and hypervigilance, futile search, belief incoherence, tie break thrashing, corridor thrashing, optimality compulsion, metric mismatch, policy oscillation, and limited-visibility variants. For each we give lightweight online detectors and reusable escape policies (short commitments, a margin to switch, smoothing, principled arbitration). We then show that durable phobic avoidance can persist even under full visibility when learned aversive costs dominate local choice, producing long detours despite globally safe routes. Using First/Second/Third Law as engineering shorthand for safety latency, command compliance, and resource efficiency, we argue that local fixes are insufficient; global failures can remain. To surface them, we propose genetic-programming based destructive testing that evolves worlds and perturbations to maximize law pressure and neurosis scores, yielding adversarial curricula and counterfactual traces that expose where architectural revision, not merely symptom-level patches, is required.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。