用异或折叠压缩反馈信息,让小设备上的时序模型更高效
Compressed Recurrent Feedback in Tsetlin Machines: A Reproducible Boolean-FSM Study

- 用异或操作将480个布尔子句压缩成96位反馈信号
- 压缩后模型准确率达61.47%~62.94%,与原始反馈差距小于1%
- 适合资源受限场景下的可复现时序建模研究
在小型设备上进行序列推理需要模型保留有用的历史信息,而无需重复处理长输入。递归式Tsetlin机(RTM)通过将前一时刻的布尔子句输出作为下一时刻输入来实现记忆。然而,直接反馈会随子句数量增长,导致递归输入过宽。本文提出一种固定宽度的替代方案:通过异或(XOR)折叠合并子句激活值,分别在两个时间尺度上保留折叠后的比特,并将其阈值化回二进制状态。该设计将480个子句激活值压缩至96个递归比特。我们在一个具有明确转移规则、数据划分和随机种子的可复现布尔有限状态机基准上评估该方法。在144次运行中,压缩模型在两个任务族上的准确率分别为61.47±6.74%和62.94±9.92%。原始子句反馈仅使均值提升不足1个百分点,但递归宽度增加十倍,主机执行时间分别增加4.38倍和3.71倍。门控神经模型仍更准确,而无反馈对照组仅保留短时输入历史,其表现相当或略优。在该基准上,折叠方法在极窄接口下与原始反馈结果接近;这些发现也强调了在评测序列模型时使用无反馈控制的重要性。
原文摘要 · Abstract (English)
Sequential inference on small devices requires a model to retain useful history without repeatedly processing a long input record. A Recurrent Tsetlin Machine (RTM) provides this memory by returning Boolean clause outputs from one time step as inputs to the next. Direct feedback, however, grows with the clause bank and can make the recurrent input unnecessarily wide. This paper investigates a fixed-width alternative. We combine clause activations by exclusive-OR (XOR) folding, retain the folded bits at two time scales, and threshold them back to a binary state. The resulting design reduces 480 clause activations to 96 recurrent bits. We evaluate the method on a reproducible Boolean finite-state-machine benchmark with explicit transition rules, data splits, and random seeds. Across 144 runs, the compressed model obtains $61.47 \pm 6.74\%$ and $62.94 \pm 9.92\%$ accuracy on the two task families. Raw clause feedback changes these means by less than one percentage point, while increasing the recurrent width tenfold and measured host execution time by $4.38\times$ and $3.71\times$. Gated neural models remain more accurate, and a no-feedback control retaining only short input history achieves comparable or slightly higher accuracy. On this benchmark, folding matches raw feedback within small empirical margins at a much narrower interface; these findings also underscore the critical necessity of no-feedback recurrence controls when benchmarking sequence models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。