人机协作重构破碎文物,解决真实世界拼图难题
Solving Jigsaw Puzzles in the Wild: Human-Guided Reconstruction of Cultural Heritage Fragments
- 引入人机协同框架,结合自动求解与交互引导
- 在RePAIR数据集上准确率显著优于全自动和纯人工方法
- 适合文化遗产修复专家处理数千片碎片的大规模拼图
从真实考古文物碎片中重新组合实物面临严峻挑战,因侵蚀、缺失区域、不规则形状及大规模模糊性所致。传统拼图求解器多针对清洁合成场景设计,在碎片数量达数千片(如RePAIR基准)时表现不佳。本文提出一种人机协同(HIL)拼图求解框架,融合自动松弛标记求解器与交互式人类引导,支持用户迭代锁定已验证位置、修正错误并引导系统生成语义与几何一致的拼合结果。提出两种互补交互策略:迭代锚定与连续交互优化,适用于不同模糊度与规模的拼图。在多个RePAIR组上的实验表明,该混合方法在准确率与效率上显著优于全自动化及纯人工基线,为大规模专家参与的文物复原提供可行解决方案。
原文摘要 · Abstract (English)
Reassembling real-world archaeological artifacts from fragmented pieces poses significant challenges due to erosion, missing regions, irregular shapes, and large-scale ambiguity. Traditional jigsaw puzzle solvers, often designed for clean synthetic scenarios, struggle under these conditions, especially when the number of fragments grows into the thousands, as in the RePAIR benchmark. In this paper, we propose a human-in-the-loop (HIL) puzzle solving framework designed to address the complexity and scale of real-world cultural heritage reconstruction. Our approach integrates an automatic relaxation-labeling solver with interactive human guidance, allowing users to iteratively lock verified placements, correct errors, and guide the system toward semantically and geometrically coherent assemblies. We introduce two complementary interaction strategies, Iterative Anchoring and Continuous Interactive Refinement, which support scalable reconstruction across varying levels of ambiguity and puzzle size. Experiments on several RePAIR groups demonstrate that our hybrid approach substantially outperforms both fully automatic and manual baselines in accuracy and efficiency, offering a practical solution for large-scale expert-in-the-loop artifact reassembly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。