用自然语言控制水下机器人,让深海任务编程快10倍以上。
Word2Wave: Language Driven Mission Programming for Efficient Subsea Deployments of Marine Robots
- 基于小语言模型的自然语言转任务指令框架
- 用户编程时间减少至传统方式的10%以下
- 适合海洋科研与工程人员快速部署水下机器人
本文提出一种基于自然语言的自主水下航行器(AUV)动态任务编程接口——Word2Wave(W2W)。该框架包含:(i)新型语言规则与命令结构,实现高效语言到任务映射;(ii)基于GPT的提示工程模块,用于生成训练数据;(iii)基于T5-Small的小语言模型(SLM)序列到序列学习管道,从语音或文本生成任务指令;(iv)支持2D任务地图可视化的人机交互界面。所提方法通过处理后的语言数据有效学习语言-任务映射,性能稳定高效。在基准测试中优于现有方法,并通过用户交互实验验证:相比商用接口,W2W使任务编程耗时降低90%以上,可用性评分为76.25,被评价为更简单自然的任务编程范式。该研究为无手操作的水下任务编程提供了新方向。
原文摘要 · Abstract (English)
This paper explores the design and development of a language-based interface for dynamic mission programming of autonomous underwater vehicles (AUVs). The proposed `Word2Wave' (W2W) framework enables interactive programming and parameter configuration of AUVs for remote subsea missions. The W2W framework includes: (i) a set of novel language rules and command structures for efficient language-to-mission mapping; (ii) a GPT-based prompt engineering module for training data generation; (iii) a small language model (SLM)-based sequence-to-sequence learning pipeline for mission command generation from human speech or text; and (iv) a novel user interface for 2D mission map visualization and human-machine interfacing. The proposed learning pipeline adapts an SLM named T5-Small that can learn language-to-mission mapping from processed language data effectively, providing robust and efficient performance. In addition to a benchmark evaluation with state-of-the-art, we conduct a user interaction study to demonstrate the effectiveness of W2W over commercial AUV programming interfaces. Across participants, W2W-based programming required less than 10\% time for mission programming compared to traditional interfaces; it is deemed to be a simpler and more natural paradigm for subsea mission programming with a usability score of 76.25. W2W opens up promising future research opportunities on hands-free AUV mission programming for efficient subsea deployments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。