通过多尺度sinc卷积增强局部检索,让大模型代理更精准定位关键信息。
Spectral Retrieval: Multi-Scale Sinc Convolution over Token Embeddings for Localized Retrieval in LLM Multi-Agent Systems

- 在词嵌入上使用多尺度sinc卷积,动态融合逐词最大相似度与平均池化。
- 在合成数据上召回率从0.02提升至1.0,真实数据Recall@10达0.90。
- 无需重训练,适合大模型多智能体系统中角色化的精准检索场景。
Spectral Retrieval是一种可插拔的重排序阶段,通过在词嵌入上施加多尺度sinc卷积,在逐词最大相似度与平均池化检索之间进行插值。标准稠密检索将文档视为单一均值池化向量;当相关性集中在短子片段时,信号会被平均成噪声。Spectral Retrieval复用晚交互索引中的逐词嵌入,以归一化sinc核在多个尺度上进行卷积。当L=1时,核为恒等操作,恢复逐词最大相似度;随着L增大,趋近于均匀滤波器,恢复平均池化。位置与尺度上的最大余弦得分,其信息量不劣于任一端点。在含1,000个文档的合成基准上,平均池化检索始终处于随机水平(Recall@10 ~ 0.02),而Spectral Retrieval在植入选项余弦超过语料噪声阈值后,Recall@10可达1.0。在LIMIT-small数据集上,使用冻结的all-mpnet-base-v2编码器,该方法将Recall@10从0.33提升至0.90,MRR从0.22提升至0.79,strict Success@10从0.12提升至0.84,且无需重新训练。该方法自然融入多智能体大模型系统,使各智能体能基于共享语料获得更紧密、角色特定的检索窗口。
原文摘要 · Abstract (English)
[Abridged] - Spectral Retrieval is a plug-in re-ranking stage that interpolates between per-token MaxSim and mean-pool retrieval through a multi-scale sinc convolution over token embeddings. In standard dense retrieval each document is one mean-pooled vector; when relevance localises into a short subspan, the signal averages into noise. Spectral Retrieval reuses per-token embeddings from a late-interaction index and convolves them with a normalised sinc kernel at multiple scales. At L=1 the kernel acts as the identity, recovering per-token MaxSim; as L grows it approaches a uniform filter, recovering mean pooling. The maximum cosine over positions and scales yields a score provably no less informative than either endpoint. On a controlled synthetic benchmark with 1,000 documents and planted single-position spikes, mean-pool retrieval sits at chance (Recall@10 ~ 0.02) regardless of spike strength, while Spectral Retrieval reaches Recall@10 = 1.0 once the planted cosine exceeds the corpus-level token noise floor. On LIMIT-small with a frozen all-mpnet-base-v2 encoder, Spectral Retrieval lifts Recall@10 from 0.33 to 0.90, MRR from 0.22 to 0.79, and strict Success@10 from 0.12 to 0.84, without retraining. The method fits naturally into multi-agent LLM systems, where each agent benefits from a tighter, role-specific retrieval window over a shared corpus.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。