无需源数据,让文档版面分析模型轻松适应新场景。
SFDLA: Source-Free Document Layout Analysis
- 提出无源数据版面分析框架DLAdapter,仅用目标域无标签数据优化模型。
- 在跨数据集迁移中提升4.21%性能,比现有方法高出2.26%。
- 适合医疗、金融等隐私敏感领域,推动真实场景落地。
文档版面分析(DLA)是文档理解的基础任务,但现有方法通常需大量源数据和目标标签,限制了其在金融报表、医疗记录等隐私敏感及资源受限场景的应用。我们观察到,直接将源域微调的模型迁移到目标域会带来显著性能下降(平均-32.64%)。为此,本文提出无源文档版面分析(SFDLA),旨在不访问任何源数据的情况下,将预训练源模型适配至无标签目标域。我们建立了首个SFDLA基准,涵盖三个主流DLA数据集,支持几何与内容感知的适配。同时提出新型框架DLAdapter,实现跨文档域的高效无源适应。实验表明,该方法在从PubLayNet到DocLayNet的迁移中,相比源模型基线提升4.21%,优于现有无源方法2.26%。为促进后续研究,相关基准、模型与代码已公开于https://github.com/s3setewe/sfdla-DLAdapter。
原文摘要 · Abstract (English)
Document Layout Analysis (DLA) is a fundamental task in document understanding. However, existing DLA and adaptation methods often require access to large-scale source data and target labels. This requirements severely limiting their real-world applicability, particularly in privacy-sensitive and resource-constrained domains, such as financial statements, medical records, and proprietary business documents. According to our observation, directly transferring source-domain fine-tuned models on target domains often results in a significant performance drop (Avg. -32.64%). In this work, we introduce Source-Free Document Layout Analysis (SFDLA), aiming for adapting a pre-trained source DLA models to an unlabeled target domain, without access to any source data. To address this challenge, we establish the first SFDLA benchmark, covering three major DLA datasets for geometric- and content-aware adaptation. Furthermore, we propose Document Layout Analysis Adapter (DLAdapter), a novel framework that is designed to improve source-free adaptation across document domains. Our method achieves a +4.21% improvement over the source-only baseline and a +2.26% gain over existing source-free methods from PubLayNet to DocLayNet. We believe this work will inspire the DLA community to further investigate source-free document understanding. To support future research of the community, the benchmark, models, and code will be publicly available at https://github.com/s3setewe/sfdla-DLAdapter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。