分析公共空间手势交互的运行时故障，提出事件级确认机制
From Frame-Level Recognition to Event-Level Confirmation: Repair Traces and Runtime Failure Analysis of Public-Space Gesture Interaction
- 从帧级识别转向事件级确认，捕捉真实使用中的失败模式
- 归纳出6类运行时故障，涵盖模型输出、时间同步等维度
- 适合关注落地系统可靠性的工程师和交互设计研究者
公共空间手势交互常被当作帧级识别问题评估，但实际部署系统面临不同的失败边界。在景区导览机、展厅装置和服务终端中，用户关心的是意图动作是否成为稳定交互事件，而非单帧手部关键点是否准确。我们称此为识别到交互的差距。本文分析了景区互动导览机项目中的8个工程修复记录，覆盖4种手势任务：双手作揖、单手握拳摇动、双手抓取控制、知识图谱节点悬停。从中提取20个故障实例，并归纳为六类非互斥的运行时故障类型：模型输出退化、时间错位、几何尺度不稳、坐标渲染错位、运行时生命周期失败、反馈同步与恢复失败。进一步将常见修复策略抽象为手部关键点模型与交互任务间的事件级运行时框架。贡献限定为：基于部署经验的故障分类体系、事件确认运行时抽象及案例研究发现。未宣称提出新识别模型、大规模用户评测或量化精度提升。
原文摘要 · Abstract (English)
Public-space gesture interaction is often evaluated as a frame-level recognition problem, but deployed systems expose a different failure boundary. In scenic kiosks, exhibition halls, and service terminals, users experience whether an intended action becomes a stable interaction event, not whether individual hand-landmark frames are correct. We call this the recognition-to-interaction gap. This paper analyzes 8 engineering repair records from a scenic-area interactive kiosk project, covering 4 gesture tasks: two-hand bowing, single-hand fist shaking, two-hand catching control, and knowledge-graph node hovering. From these traces, we extract 20 failure instances and organize them into six non-exclusive working failure classes: model-output degeneration, temporal mismatch, geometric-scale instability, coordinate-rendering mismatch, runtime lifecycle failure, and feedback synchronization and recovery failure. We further organize recurring repair mechanisms into an event-level runtime abstraction between the hand-landmark model and the interaction task. The contribution is deliberately bounded: a deployment-grounded failure taxonomy, an event-confirmation runtime abstraction, and case-study findings. We do not claim a new recognition model, large-scale user evaluation, or quantified accuracy gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。