用域适应技术让模型看懂真实棋盘,省去人工标注
Unsupervised Domain Adaptation Approaches for Chessboard Recognition
- 用合成数据训练模型,通过域适应迁移到真实棋盘图像
- DANN模型准确率仅比直接标注低3%,大幅减少标注成本
- 适合想自动化记录棋局的开发者和研究者
国际象棋对弈中手动记录棋局耗时且易分心。由于高质量标注棋盘图像稀缺,且人工标注繁琐,深度学习在自动记录中的应用受限。本文提出端到端流程:利用合成带标签图像,通过域适应(DA)预测真实、俯视视角的未标注棋盘图像。流程包括预处理阶段——检测棋盘、裁剪方格,并逐个输入深度学习模型;模型预测方格内容,后处理生成棋局标准记法FEN。比较三种方法:基于ImageNet预训练的VGG16(Base-Source)、加入CORAL损失的改进版、以及使用对抗训练的域判别器的DANN。虽未使用目标域标签,仍训练了直接在目标域上训练的基线模型(Base-Target)作为性能上限。结果表明,DANN模型相比基线仅损失3%准确率,显著节省标注工作量。
原文摘要 · Abstract (English)
Chess involves extensive study and requires players to keep manual records of their matches, a process which is time-consuming and distracting. The lack of high-quality labeled photographs of chess boards, and the tediousness of manual labeling, have hindered the wide application of Deep Learning (DL) to automating this record-keeping process. This paper proposes an end-to-end pipeline that employs domain adaptation (DA) to predict the labels of real, top-view, unlabeled chessboard images using synthetic, labeled images. The pipeline is composed of a pre-processing phase which detects the board, crops the individual squares, and feeds them one at a time to a DL model. The model then predicts the labels of the squares and passes the ordered predictions to a post-processing pipeline which generates the Forsyth-Edwards Notation (FEN) of the position. The three approaches considered are the following: A VGG16 model pre-trained on ImageNet, defined here as the Base-Source model, fine-tuned to predict source domain squares and then used to predict target domain squares without any domain adaptation; an improved version of the Base-Source model which applied CORAL loss to some of the final fully connected layers of the VGG16 to implement DA; and a Domain Adversarial Neural Network (DANN) which used the adversarial training of a domain discriminator to perform the DA. Also, although we opted not to use the labels of the target domain for this study, we trained a baseline with the same architecture as the Base-Source model (Named Base-Target) directly on the target domain in order to get an upper bound on the performance achievable through domain adaptation. The results show that the DANN model only results in a 3% loss in accuracy when compared to the Base-Target model while saving all the effort required to label the data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。