arXiv:2604.16915cs.CV2026-04被引 1

KIRA解决专业视觉领域图文检索与推理难题,实现高精度、可验证的答案生成。

KIRA: Knowledge-Intensive Image Retrieval and Reasoning Architecture for Specialized Visual Domains

论文配图:KIRA: Knowledge-Intensive Image Retrieval and Reasoning Architecture for Specialized Visual Domains
图 1 · 摘自论文原文
  • 构建多粒度视觉知识库,结合区域检测与分层语义切分
  • 在四个专业领域中实现0.97的检索精度和1.0的生成可信度
  • 支持多跳视觉推理与事后幻觉验证,适合医疗、工程等严谨场景

检索增强生成(RAG)已革新文本问答,但其在视觉领域的拓展受限于模态鸿沟、知识库语义构建难、多跳推理与答案可信性验证等核心挑战。本文提出KIRA(知识密集型图像检索与推理架构),一个统一的五阶段框架,系统解决视觉RAG在专业领域中的十大问题。KIRA引入:(1) 基于DINO的区域检测实现多粒度知识库构建;(2) 少样本适配的领域自适应对比编码器处理罕见视觉概念;(3) 双路径跨模态检索与思维链查询扩展;(4) 支持时序与多视角的多跳视觉推理(ChainOfRetrieval);(5) 基于证据的生成与事后幻觉验证。我们还提出DOMAINVQAR基准,从检索精度、推理忠实性、领域正确性三方面评估。在医学X光、电路图、卫星影像、组织病理学四个领域上,KIRA平均取得0.97的检索精度、1.0的生成可信度得分和0.707的领域正确性,消融实验揭示各模块作用及精度多样性权衡关系。

原文摘要 · Abstract (English)

Retrieval augmented generation (RAG) has transformed text based question answering, yet its extension to visual domains remains hindered by fundamental challenges: bridging the modality gap between image queries and text heavy knowledge bases, constructing semantically meaningful visual knowledge bases, performing multihop reasoning over retrieved images, and verifying that generated answers are faithfully grounded in visual evidence. We present KIRA (Knowledge Intensive Image Retrieval and Reasoning Architecture), a unified five stage framework that addresses ten core problems in visual RAG for specialized domains. KIRA introduces: (1) hierarchical semantic chunking with DINO based region detection for multi granularity knowledge base construction, (2) domain adaptive contrastive encoders with fewshot adaptation for rare visual concepts, (3) dualpath crossmodal retrieval with chainOfThought query expansion, (4) chainOfRetrieval for multihop visual reasoning with temporal and multiview support, and (5) evidence conditioned grounded generation with posthoc hallucination verification. We also propose DOMAINVQAR, a benchmark suite that evaluates visual RAG along three axes (retrieval precision, reasoning faithfulness, and domain correctness) going beyond standard recall metrics. Experiments across four specialized domains (medical Xray, circuit diagrams, satellite imagery, and histopathology) with a progressive six variant ablation demonstrate that KIRA achieves 0.97 retrieval precision, 1.0 grounding scores, and 0.707 domain correctness averaged across domains, while the ablation reveals actionable insights about when each component helps and when components introduce precision diversity tradeoffs that must be managed. Code will be released upon acceptance.

视觉推理检索增强知识库构建多跳推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。