用情境故事揭示人机交互中被忽视的失败场景
Why Report Failed Interactions With Robots?! Towards Vignette-based Interaction Quality
- 通过民族志情境片段记录真实交互中的罕见故障
- 能呈现人类互动中难以量化的失败细节
- 适合研究者提升评估透明度与跨学科沟通
尽管大语言模型提升了人机交互质量，但与人际互动相比仍存在诸多不足。失败的性质和严重性高度依赖具体交互情境，难以在广泛的研究场景中通用化。本文提出在人机交互研究中采用被忽视的民族志情境片段（ethnographic vignettes）技术，以清晰呈现那些鲜有记录的失败。我们描述了撰写情境片段的方法，并基于个人经历创作了相关案例。情境片段具有多学科视角表达失败、促进机器人能力透明化、记录意外行为的优势，有助于弥补传统报告的缺失。我们倡导将情境片段作为现有评估方法的补充。
原文摘要 · Abstract (English)
Although the quality of human-robot interactions has improved with the advent of LLMs, there are still various factors that cause systems to be sub-optimal when compared to human-human interactions. The nature and criticality of failures are often dependent on the context of the interaction and so cannot be generalized across the wide range of scenarios and experiments which have been implemented in HRI research. In this work we propose the use of a technique overlooked in the field of HRI, ethnographic vignettes, to clearly highlight these failures, particularly those that are rarely documented. We describe the methodology behind the process of writing vignettes and create our own based on our personal experiences with failures in HRI systems. We emphasize the strength of vignettes as the ability to communicate failures from a multi-disciplinary perspective, promote transparency about the capabilities of robots, and document unexpected behaviours which would otherwise be omitted from research reports. We encourage the use of vignettes to augment existing interaction evaluation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。