arXiv:2608.05026cs.HCcs.AI2026-08

用双向人机协作提升艺术隐含语义标注效率

ArtAnno: Annotating Implicit Semantics in Artworks through LLM Agent-Driven Bidirectional Human-AI Augmentation

论文配图:ArtAnno: Annotating Implicit Semantics in Artworks through LLM Agent-Driven Bidirectional Human-AI Augmentation
图 1 · 摘自论文原文
  • 构建双向人机增强框架,实现人与AI实时互促
  • 用户研究显示标注效率提升,新手验证负担降低
  • 适合艺术数据标注、跨文化研究者使用

高质量的艺术品标注对计算艺术研究至关重要,但提取隐含语义仍具挑战,因需依赖文化背景意义和深层上下文知识。现有AI辅助标注工具常缺乏有效支持或采用单向流程,专家需额外手动校准模型,效率受限。为此,我们提出双向人机增强(BiHAA)框架,通过闭环机制实现技能与领域知识的实时演化。基于20位不同背景标注者的前期研究,我们构建了由多智能体架构驱动的ArtAnno系统。系统包含主动代理支持模块,由AI进行语义挖掘与标签建议;以及互动驱动进化模块,将人类标注轨迹提炼为可复用经验反哺AI。用户研究与两个案例研究表明,该框架显著提升标注效率,实现知识积累,并降低领域知识有限者的检索与验证负担。最后讨论了更广泛影响与未来方向。

原文摘要 · Abstract (English)

High-quality annotation of artworks is essential for computational art research, yet extracting implicit semantics remains challenging due to the reliance on culturally grounded meanings and deep contextual knowledge behind the images. Current AI-assisted annotation tools often lack assistance or rely on one-way workflows where experts have to perform extra manual calibrations to improve AI models, resulting in limited efficiency. To address this, we propose Bidirectional Human-AI Augmentation(BiHAA), a closed-loop framework in which skills and domain knowledge base evolve through real-time interaction and bidirectional HAI augmentation. Informed by a formative study with 20 artwork annotators from different backgrounds, we implement this framework in ArtAnno, an artwork annotation system driven by a multi-agent architecture. The system includes a Proactive Agentic Support Module, where AI augments humans through semantic mining and label suggestion, and an Interaction-Driven Evolution Module, where human expertise continuously enhances the AI through distilling annotation trajectories into reusable experience. Evaluation through a user study and two case studies demonstrates that our framework and system improve annotation efficiency, enable knowledge accumulation, and reduce the effort of information seeking and verification for annotators with limited domain expertise. We conclude by discussing broader implications and future directions.

艺术标注人机协作多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。