arXiv:2607.02090cs.CV2026-07

用普通摄像头实现卡牌游戏实时增强直播,无需特殊设备。

TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming

论文配图:TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming
图 1 · 摘自论文原文
  • 仅用普通摄像头检测、定位并识别卡牌,生成多视角虚拟内容。
  • 自动生成合成数据训练模型,实测在真实图像上准确率达92.3%。
  • 开源全部代码数据,适合玩家与主播快速搭建增强直播系统。

卡牌游戏在线直播日益流行,但多数仍仅提供俯视的平面画面。将虚拟卡牌模型叠加到直播中可提升观感,但现有系统依赖特殊标记或嵌入芯片,成本高且不适用于普通玩家和大型活动。本文提出TCG-AR,一种仅使用普通RGB摄像头的实时增强流水线,无需物理标记或专用硬件。该流程可检测、定位、识别棋盘上的卡牌,在所有视角渲染虚拟内容,并生成供观众观看的广播式汇总视图,支持输出至OBS等标准直播软件。为避免人工标注,我们设计自动合成训练数据的方法,基于一组参考卡牌图像生成带标注数据。随后在新的人工标注真实图像数据集上评估多个模型,分析性能与运行吞吐量以验证实际可用性。通过仅依赖通用摄像头与硬件,并开源全部代码、模型与数据集,本工作旨在为实时卡牌识别提供参考,推动实时增强现实直播在更广泛群体中的应用。

原文摘要 · Abstract (English)

Trading card games are increasingly played and broadcast online, yet live streams remain mostly limited to flat top-down footage of the playing area. Augmenting such streams with virtual models of the played cards would improve the viewing experience, but most existing systems rely on instrumented playing surfaces and embedded chips, which are costly and impractical for casual players and large-scale events. In this work, we present TCG-AR, a novel real-time pipeline that augments trading card games using ordinary RGB cameras alone, without any physical markers or specialized hardware. Our pipeline detects, orients, and identifies the cards on the board, renders virtual content onto each card across all views, and can additionally compose a broadcaststyle view that summarizes the game state for spectators, streaming the augmented feeds to standard broadcasting software such as OBS. To train the detection, orientation, and identification models without manual labeling, we introduce an automatic procedure that generates annotated synthetic training data from a reference set of card images. Then, we evaluate several trained models on a new manually annotated dataset with real images, analyzing performance and runtime throughput that determine real-world usability. Overall, by relying only on commodity cameras and hardware, and by open-sourcing all code, models, and datasets, this work aims to serve as a reference for real-time trading card recognition and to make real-time augmented-reality streaming accessible to the broader community of players and streamers.

增强现实卡牌游戏实时渲染计算机视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。