arXiv:2603.22855cs.ARcs.LG2026-03中稿 · DAC 2026

用类脑缓存机制降低视觉推理能耗,实现实时低功耗边缘部署。

TorR: Towards Brain-Inspired Task-Oriented Reasoning via Cache-Oriented Algorithm-Architecture Co-design

  • 用超维计算替代密集对齐,通过查询缓存和增量更新减少计算量。
  • 在28nm芯片上实现每帧50毫焦能量消耗,30/60帧率下延迟抖动小。
  • 适合资源受限的实时边缘设备,支持运行时灵活调节精度与功耗。

基于CLIP的任务导向目标检测(TOOD)虽具备开放词汇与提示驱动语义能力,但每窗口密集计算和高内存流量限制了其在实时、低功耗边缘设备上的部署。本文提出脑启发的算法-架构协同设计TorR,将CLIP式密集对齐替换为超维(HDC)关联推理,并利用时间一致性实现结果复用。算法层面,将对齐重构为HDC相似性与图组合,引入部分相似性复用:(i) 按类别累积得分的查询缓存,(ii) 仅少量超矢量位变化时的精确δ更新,(iii) 高负载下的相似性/载荷门控旁路。架构层面,采用可扩展流水线、位切片项目内存,结合银行/精度门控及轻量控制器,动态调度旁路/δ/全路径以满足不同物体数量下的实时性目标(RT-30/RT-60)。在TSMC 28nm工艺下综合并经周期精准仿真验证,TorR在60帧/秒时每窗能耗约50毫焦,30帧/秒时约113毫焦,保持低延迟抖动,且在五个任务提示下平均[email protected]达44.27%,与强基线差距有限,但能效提升数个数量级。设计支持部署时配置(有效维度D'、阈值、精度),可在准确率、延迟与能耗间权衡以适配边缘预算。

原文摘要 · Abstract (English)

Task-oriented object detection (TOOD) atop CLIP offers open-vocabulary, prompt-driven semantics, yet dense per-window computation and heavy memory traffic hinder real-time, power-limited edge deployment. We present \emph{TorR}, a brain-inspired \textbf{algorithm--architecture co-design} that \textbf{replaces CLIP-style dense alignment with a hyperdimensional (HDC) associative reasoner} and turns temporal coherence into reuse. On the \emph{algorithm} side, TorR reformulates alignment as HDC similarity and graph composition, introducing \emph{partial-similarity reuse} via (i) query caching with per-class score accumulation, (ii) exact $δ$-updates when only a small set of hypervector bits change, and (iii) similarity/load-gated bypass under high system load. On the \emph{architecture} side, TorR instantiates a lane-scalable, bit-sliced item memory with bank/precision gating and a lightweight controller that schedules bypass/$δ$/full paths to meet RT-30/RT-60 targets as object counts vary. Synthesized in a TSMC 28\,nm process and exercised with a cycle-accurate simulator, TorR sustains real-time throughput with millijoule-scale energy per window ($\approx$50\,mJ at 60\,FPS; $\approx$113\,mJ at 30\,FPS) and low latency jitter, while delivering competitive [email protected] across five task prompts (mean 44.27\%) within a bounded margin to strong VLM baselines, but at orders-of-magnitude lower energy. The design exposes deployment-time configurability (effective dimension $D'$, thresholds, precision) to trade accuracy, latency, and energy for edge budgets.

类脑计算边缘推理能效优化超维计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。