用OCR识别的文本位置估算图像几何变换,无需原始图片。
Words as Geometric Features: Estimating Homography using Optical Character Recognition as Compressed Image Representation
- 用OCR提取的文本位置和内容作为几何特征
- 在测试集上精度高于传统图像方法
- 适合仅能获取OCR结果的文档处理场景
文档对齐与注册在自动化表单处理、异常检测和工作流自动化等实际应用中至关重要。传统方法依赖图像特征(如关键点、边缘、纹理)估计仿射或单应性变换,但通常需要原始图像数据,而该数据可能因隐私、存储或传输限制无法获取。本文提出一种新方法,利用OCR输出作为特征进行单应性估计。通过结合OCR检测到的文本空间位置与内容,实现无需像素级图像数据的文档对齐。该方法对OCR噪声具有鲁棒性,引入RANSAC处理异常值和误差。在一组测试文档上,我们的方法表现优于传统图像基方法,在保证精度的同时降低对高维图像数据的依赖,为文档注册提供更高效、可扩展的解决方案。
原文摘要 · Abstract (English)
Document alignment and registration play a crucial role in numerous real-world applications, such as automated form processing, anomaly detection, and workflow automation. Traditional methods for document alignment rely on image-based features like keypoints, edges, and textures to estimate geometric transformations, such as homographies. However, these approaches often require access to the original document images, which may not always be available due to privacy, storage, or transmission constraints. This paper introduces a novel approach that leverages Optical Character Recognition (OCR) outputs as features for homography estimation. By utilizing the spatial positions and textual content of OCR-detected words, our method enables document alignment without relying on pixel-level image data. This technique is particularly valuable in scenarios where only OCR outputs are accessible. Furthermore, the method is robust to OCR noise, incorporating RANSAC to handle outliers and inaccuracies in the OCR data. On a set of test documents, we demonstrate that our OCR-based approach even performs more accurately than traditional image-based methods, offering a more efficient and scalable solution for document registration tasks. The proposed method facilitates applications in document processing, all while reducing reliance on high-dimensional image data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。