arXiv:2604.05866cs.IRcs.CL2026-04中稿 · IJCNN-2026

用结构化专家画像提升论文与审稿人匹配精度

Beyond Paper-to-Paper: Structured Profiling and Rubric Scoring for Paper-Reviewer Matching

  • 用大模型构建论文和审稿人的主题、方法、应用三维度画像
  • 混合检索+LLM评审团,召回率高且评分更全面
  • 无需训练,适用于学术会议审稿系统

随着会议投稿量持续增长,精准推荐合适审稿人成为挑战。现有方法多采用‘论文到论文’匹配范式,隐式通过作者发表论文来表征审稿人,但单一文本相似性难以捕捉多维专业能力。为此,我们提出P2R——一种无需训练的框架,将匹配方式从隐式转为显式结构化画像。P2R利用通用大模型为论文和审稿人分别生成包含主题、方法、应用三个维度的结构化画像。基于此,采用粗到精的两阶段流程:先结合语义与细粒度特征进行混合检索,形成高召回候选池;再由基于LLM的评审委员会依据严格评分标准评估候选人,融合多维专家意见与区域主席的全局视角。在NeurIPS、SIGIR和SciRepEval数据集上的实验表明,P2R持续优于当前最优基线。消融实验验证了各模块必要性。整体上,P2R凸显了显式结构化专家建模的价值,并为大模型在审稿匹配中的应用提供实用指导。

原文摘要 · Abstract (English)

As conference submission volumes continue to grow, accurately recommending suitable reviewers has become a challenge. Most existing methods follow a ``Paper-to-Paper'' matching paradigm, implicitly representing a reviewer by their publication history. However, effective reviewer matching requires capturing multi-dimensional expertise, and textual similarity to past papers alone is often insufficient. To address this gap, we propose P2R, a training-free framework that shifts from implicit paper-to-paper matching to explicit profile-based matching. P2R uses general-purpose LLMs to construct structured profiles for both submissions and reviewers, disentangling them into Topics, Methodologies, and Applications. Building on these profiles, P2R adopts a coarse-to-fine pipeline to balance efficiency and depth. It first performs hybrid retrieval that combines semantic and aspect-level signals to form a high-recall candidate pool, and then applies an LLM-based committee to evaluate candidates under strict rubrics, integrating both multi-dimensional expert views and a holistic Area Chair perspective. Experiments on NeurIPS, SIGIR, and SciRepEval show that P2R consistently outperforms state-of-the-art baselines. Ablation studies further verify the necessity of each component. Overall, P2R highlights the value of explicit, structured expertise modeling and offers practical guidance for applying LLMs to reviewer matching.

审稿匹配大模型专家画像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。