arXiv:2501.19325cs.CV2025-01被引 3

用深度学习+遗传算法重构破损拼图,效果优于现有方法。

A Generic Hybrid Framework for 2D Visual Reconstruction

  • 用深度网络评估拼图片对整体匹配度,不只看边缘
  • 在葡萄牙瓷砖和破损大拼图上达到顶尖准确率
  • 适合图像修复、历史文物复原等真实场景应用

本文提出一种通用混合框架,用于解决基于方形非重叠碎片的2D真实世界重建问题(拼图问题,JPP)。该方法融合基于深度学习(DL)的兼容性度量(CM)模型,能整体评估拼图片对的匹配程度,而非仅关注相邻边缘。该CM与优化的遗传算法(GA)求解器结合,利用片对间CM得分迭代搜索全局最优排列。大量实验表明,该框架在多个真实场景中具备良好适应性和鲁棒性。尤其在葡萄牙瓷砖面板及边界侵蚀严重的大型拼图重建任务中,实现了当前最优(SOTA)性能。

原文摘要 · Abstract (English)

This paper presents a versatile hybrid framework for addressing 2D real-world reconstruction tasks formulated as jigsaw puzzle problems (JPPs) with square, non-overlapping pieces. Our approach integrates a deep learning (DL)-based compatibility measure (CM) model that evaluates pairs of puzzle pieces holistically, rather than focusing solely on their adjacent edges as traditionally done. This DL-based CM is paired with an optimized genetic algorithm (GA)-based solver, which iteratively searches for a global optimal arrangement using the pairwise CM scores of the puzzle pieces. Extensive experimental results highlight the framework's adaptability and robustness across multiple real-world domains. Notably, our unique hybrid methodology achieves state-of-the-art (SOTA) results in reconstructing Portuguese tile panels and large degraded puzzles with eroded boundaries.

图像重建拼图恢复深度学习遗传算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。