用少量真实图像提升仿真模型的光学对准精度。
Towards Real-world Lens Active Alignment with Unlabeled Data via Domain Adaptation
- 通过自监督域适应,从无标签真实图像中学习退化特征。
- 在两种镜片上使对准准确率提升46%,接近有标签数据效果。
- 大幅减少现场数据采集时间,适合工业级自动化装配。
主动对准(AA)是高精度光学系统大规模自动化装配的关键技术。相比耗时的逐模型现场标定,基于光学仿真的数字孪生流程可生成大量带标签数据,但复杂成像条件导致仿真与真实图像间存在域差距,限制模型泛化能力。为此,本文提出在仿真基线基础上引入少量随机错位位置拍摄的真实世界无标签图像,从域适应视角缓解域差距。提出域适应主动对准(DA3),采用自回归域变换生成器与对抗性特征对齐策略,通过自监督学习提取真实域信息,实现域不变的图像退化特征,提升错位预测鲁棒性。在两种镜片上的实验表明,DA3相比纯仿真方案准确率提升46%,接近使用3个样本精确标注的真实数据表现,同时将现场数据采集时间减少98.7%。结果验证了域适应能有效赋予仿真训练模型强现实泛化能力,证明数字孪生流程是显著提升大规模光学装配效率的可行方案。
原文摘要 · Abstract (English)
Active Alignment (AA) is a key technology for the large-scale automated assembly of high-precision optical systems. Compared with labor-intensive per-model on-device calibration, a digital-twin pipeline built on optical simulation offers a substantial advantage in generating large-scale labeled data. However, complex imaging conditions induce a domain gap between simulation and real-world images, limiting the generalization of simulation-trained models. To address this, we propose augmenting a simulation baseline with minimal unlabeled real-world images captured at random misalignment positions, mitigating the gap from a domain adaptation perspective. We introduce Domain Adaptive Active Alignment (DA3), which utilizes an autoregressive domain transformation generator and an adversarial-based feature alignment strategy to distill real-world domain information via self-supervised learning. This enables the extraction of domain-invariant image degradation features to facilitate robust misalignment prediction. Experiments on two lens types reveal that DA3 improves accuracy by 46% over a purely simulation pipeline. Notably, it approaches the performance achieved with precisely labeled real-world data collected on 3 lens samples, while reducing on-device data collection time by 98.7%. The results demonstrate that domain adaptation effectively endows simulation-trained models with robust real-world performance, validating the digital-twin pipeline as a practical solution to significantly enhance the efficiency of large-scale optical assembly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。