用机器人和AI修复古籍碎片,定位精度达0.57mm
A Vision Based System for Guided and Collaborative Reconstruction of Fragmented Documents

- 机器人配真空吸盘,可自动或手动精准定位碎片
- 系统实现8cm²碎片0.57mm重复定位精度,支持人机协作
- 选用地检测的SE2-LoFTR算法,适应破损与变形文档
本文提出并评估了一套面向文化遗产保护的实时协同纸张碎片重建系统。系统包含一个协作机器人(cobot),配备专用真空吸附装置,可对纸片碎片进行温和且精确的定位,确保脆弱材料不受损。该装置使8cm²碎片的定位重复性达到0.57mm。用户可选择人工视觉引导或由机器人完全自动化定位。为提升重建效率,研究评估了多种图像解析方法在模板式纸片碎片重建中的适用性,重点分析不同局部特征匹配方法在旋转、尺度鲁棒性及碎片损伤程度下的表现。针对受损和光学变形档案材料,实验优选无需检测器的SE2-LoFTR方法,因其在各类条件下均表现稳健。
原文摘要 · Abstract (English)
This paper presents the development and evaluation of a collaborative system for real-time reconstruction of fragmented paper documents in the context of cultural heritage preservation. The developed system includes a collaborative robot, or cobot, that can fully manage the positioning of paper fragments using a specially designed vacuum-based suction attachment. This attachment enables gentle and precise positioning, ensuring the preservation of fragile materials. With this device, we are able to achieve a positioning repeatability of 0.57mm for fragments of 8cm^2. The system offers users the flexibility to choose between manual positioning, with visual guidance, or fully automated positioning performed by the cobot. To further improve the reconstruction process, AI methods for image interpretation, specifically for segmentation and positioning tasks, were applied and evaluated for their applicability to template-based reconstruction of damaged paper fragments. Our investigation provides critical insights into the performance of different local feature matching methods under different document types, taking into account rotation, scale robustness, and the degree of damage to the fragments. With a focus on the reconstruction of damaged and optically altered archival material, SE2-LoFTR, a detector-free local feature matching method, was chosen as the preferred method for the system due to its robust performance in our experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。