arXiv:2606.13705cs.LGcs.AI2026-06

只改一个神经元,就能解决大模型的重复循环问题。

When Can One Neuron Fix Repetition Loops in LLMs?

论文配图:When Can One Neuron Fix Repetition Loops in LLMs?
图 1 · 摘自论文原文
  • 通过定位关键神经元并反转其权重,直接抑制重复生成。
  • 在Gemma 4模型上,重复率从46/384降至12/384,效果显著。
  • 适用于训练后修复,无需额外惩罚项,适合快速调试模型缺陷。

Gemma 4指令微调模型在长篇事实列举任务(如151只宝可梦、88个国际天文学联合会星座)中存在可复现的崩溃现象:生成陷入重复循环,最高达87.5%(7/8次生成)。本文探索通过修改少数内部组件来直接缓解该问题,不依赖重复惩罚机制。结合逐层消融与神经元级归因,发现对特定神经元进行权重反向调整即可显著减少循环。在Gemma 4 E2B中,仅需一个符号反转的神经元即有效;四款模型整体重复率从46/384降至12/384,主要由E4B和31B驱动。通用基准测试未见显著性能下降。跨模型实验(Qwen3.5、LFM2.5)也显示稀疏编辑有抑制作用,但效果差异较大。结果表明,小规模权重编辑具因果干预潜力,但无法揭示通用循环电路或保证终止清洁性。

原文摘要 · Abstract (English)

The Gemma 4 instruction-tuned models share a reproducible failure: on long factual enumeration prompts, such as TV episodes, the 88 IAU constellations, or the 151 original Pokemon, they collapse into repetition, either a tight verbatim loop or a list whose entries decay onto one answer. These loops reach 87.5% (7/8 generations) and survive prompt rewording and most sampling adjustments. In this paper, we explore whether edits to a few internal model components can directly reduce this failure, without relying on repetition penalties, which can distort valid repetition and degrade task performance. To locate such targets, we combine per-layer ablation with per-neuron or routed-expert attribution, then evaluate weight edits over complete generations. We find that these edits substantially reduce detected loops on the prompts and seeds used to select them; in Gemma 4 E2B, for example, one sign-inverted neuron suffices. Across all four Gemma models, detected loops fall from 46/384 to 12/384 on frozen held-out prompts and seeds, driven mainly by E4B and 31B, while general-purpose benchmarks show no statistically detectable regressions. Our attribution methodology identifies useful candidates, but rankings vary across examples. At longer generation budgets, edits remain effective for E2B and E4B, whereas remaining failures in 26B and 31B shift toward doom looping: non-convergent self-correction over facts the model cannot recall. In exploratory experiments on Qwen3.5 and LFM2.5, sparse edits also reduce repetition, providing preliminary cross-family evidence, although effect strength and selectivity vary. Overall, our results show the promise and limits of targeted, small-scale weight editing: it can suppress specific repetition failures and provide a training-free causal intervention, but does not reveal a universal loop circuit, guarantee clean termination, or supply missing knowledge.

大模型缺陷重复循环权重编辑神经元干预

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。