arXiv:2606.05489cs.CVcs.DB2026-06

用大模型指导神经网络索引优化,显著提升人-物交互检索效率

LLM-Guided ANN Index Optimization for Human-Object Interaction Retrieval

论文配图:LLM-Guided ANN Index Optimization for Human-Object Interaction Retrieval
图 1 · 摘自论文原文
  • 基于大模型的分阶段优化策略,动态适应参数耦合关系
  • 在HICO-DET上比TPE快33.3%,吞吐量提升15.3倍
  • 跨数据库平台通用,适合复杂检索系统调优

检索系统支撑现代AI应用,涵盖视觉搜索、推荐引擎和多模态问答。现代多阶段检索系统需联合优化高度耦合的参数,但传统超参优化方法(如TPE、高斯过程贝叶斯优化)依赖独立性假设,难以处理此类耦合空间。本文提出一种分阶段的大型语言模型(LLM)代理,基于完整优化历史生成建议,分探索、利用与精调阶段导航耦合参数空间。在HICO-DET基准上使用Intel VDMS评估,该代理在SIEVE(质量约束下的向量搜索效率指标)下相较Optuna TPE提升33.3%,较VDTuner提升34.2%,吞吐量达UniIR的15.3倍。三个基准验证表明,代理优势随参数耦合度增加而增强:HICO-DET(高耦合)提升33.3%;GLDv2(中等耦合)收敛于1%内;SIFT1M(近独立)收敛于3.6%内。跨系统验证在Milvus上同样排名第一,无需修改,证明其在不同向量数据库管理系统(VDBMS)间的可迁移性。

原文摘要 · Abstract (English)

Retrieval systems underpin modern AI applications -- spanning visual search, recommendation engines, and multi-modal question answering. Modern multi-stage retrieval systems require the joint optimization of highly coupled parameters, yet traditional hyperparameter optimization (HPO) methods -- including Tree-structured Parzen Estimators (TPE) and Gaussian Process Bayesian Optimization -- rely on an independence assumption that fundamentally prevents them from navigating these coupled configuration spaces. We address this limitation with a phase-aware large language model (LLM) agent that conditions each proposal on its full optimization history, navigating the coupled parameter space across phase-partitioned exploration, exploitation, and fine-tuning stages. Evaluated on the HICO-DET human-object interaction retrieval benchmark using Intel VDMS (Visual Data Management System), our agent outperforms Optuna TPE by +33.3% and VDTuner by +34.2% under SIEVE (Safeguarded Index Evaluation of Vector-search Efficiency, a quality-constrained throughput metric), delivering a 15.3x throughput gain over UniIR. Validation across three benchmarks confirms that the agent's advantage grows with the degree of parameter coupling: +33.3% on HICO-DET (high coupling), methods converge within 1% on GLDv2 (moderate coupling) and within 3.6% on SIFT1M (near-independent control). Cross-system validation on Milvus confirms the optimizer ranks first on all three datasets without modification, demonstrating transferability across vector database management system (VDBMS) platforms.

检索优化大模型索引多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。