arXiv:2508.06000cs.HCcs.AI2025-08IJCAI被引 1

用AI+电刺激让飞行员训练更高效,用户接受度高

Hand by Hand: LLM Driving EMS Assistant for Operational Skill Learning

  • 用LLM结合电刺激引导手臂动作,辅助飞行技能学习
  • 训练时间显著缩短,用户反馈感知错误更明显
  • 适合需要身体反馈的实操技能培训场景

操作技能学习本质上是物理性的,依赖亲身实践和本体感觉反馈,但现有大语言模型(LLM)训练助手主要生成文本反馈,忽略了关键的本体感觉模态。这一差距源于LLM的文本属性与不确定性,以及用户对LLM控制身体的接受度顾虑。为弥合此鸿沟并实现人-LLM协同行动潜力,本文探索了用户对LLM驱动本体感觉辅助的体验。提出“对齐-分析-调整”策略,开发了FlightAxis系统,将LLM与电肌肉刺激(EMS)结合,用于飞行技能习得这一典型操作技能领域。FlightAxis通过解析飞行手册,指导模拟飞行任务中的前臂运动。结果表明,用户对LLM主导的身体控制接受度高,任务完成时间显著减少。关键发现是,受训者认为该辅助提升了对操作缺陷的觉察力,并增强了训练参与感,而非减轻主观负担。本工作验证了本体感觉式LLM训练在操作技能获取中的潜力。

原文摘要 · Abstract (English)

Operational skill learning, inherently physical and reliant on hands-on practice and kinesthetic feedback, has yet to be effectively replicated in large language model (LLM)-supported training. Current LLM training assistants primarily generate customized textual feedback, neglecting the crucial kinesthetic modality. This gap derives from the textual and uncertain nature of LLMs, compounded by concerns on user acceptance of LLM driven body control. To bridge this gap and realize the potential of collaborative human-LLM action, this work explores human experience of LLM driven kinesthetic assistance. Specifically, we introduced an "Align-Analyze-Adjust" strategy and developed FlightAxis, a tool that integrates LLM with Electrical Muscle Stimulation (EMS) for flight skill acquisition, a representative operational skill domain. FlightAxis learns flight skills from manuals and guides forearm movements during simulated flight tasks. Our results demonstrate high user acceptance of LLM-mediated body control and significantly reduced task completion times. Crucially, trainees reported that this kinesthetic assistance enhanced their awareness of operation flaws and fostered increased engagement in the training process, rather than relieving perceived load. This work demonstrated the potential of kinesthetic LLM training in operational skill acquisition.

操作技能电刺激人机协同大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。