让可穿戴AR助手通过空间记忆减少用户说话次数,提升日常信息获取体验。
SpeechLess: Micro-utterance with Personalized Spatial Memory-aware Assistant in Everyday Augmented Reality
- 基于个性化空间记忆实现语音指令粒度动态控制
- 实验显示可显著降低表达负担且不影响意图识别准确率
- 适合注重隐私、追求高效交互的智能眼镜用户
在公共场合大声对可穿戴AR助手说话可能带来社交不适,每天重复表达同样请求也造成额外负担。我们提出SpeechLess,一种可穿戴AR助手,引入基于个性化空间记忆的语音意图粒度控制范式。SpeechLess帮助用户‘少说话’,仍能获取所需信息,并在需要时逐步明确表达意图。该系统将过往交互与多模态个人上下文(时间、活动、指代对象)绑定形成空间记忆,利用这些记忆从不完整用户查询中推断缺失的意图维度。这使用户可动态调整表达明确程度,从完整语句到微语句甚至零语句交互。我们通过为期一周的预研调查(使用商用智能眼镜平台)验证设计动机,发现公众语音使用存在不适感、重复表达令人沮丧且受硬件限制。基于此洞察,我们构建SpeechLess,并通过受控实验室和真实场景研究进行评估。结果表明,有调控的语音交互可改善日常信息获取效率,降低表达负担,支持社交可接受性使用,且在多样日常环境中未显著影响感知可用性或意图解析准确率。
原文摘要 · Abstract (English)
Speaking aloud to a wearable AR assistant in public can be socially awkward, and re-articulating the same requests every day creates unnecessary effort. We present SpeechLess, a wearable AR assistant that introduces a speech-based intent granularity control paradigm grounded in personalized spatial memory. SpeechLess helps users "speak less," while still obtaining the information they need, and supports gradual explicitation of intent when more complex expression is required. SpeechLess binds prior interactions to multimodal personal context-space, time, activity, and referents-to form spatial memories, and leverages them to extrapolate missing intent dimensions from under-specified user queries. This enables users to dynamically adjust how explicitly they express their informational needs, from full-utterance to micro/zero-utterance interaction. We motivate our design through a week-long formative study using a commercial smart glasses platform, revealing discomfort with public voice use, frustration with repetitive speech, and hardware constraints. Building on these insights, we design SpeechLess, and evaluate it through controlled lab and in-the-wild studies. Our results indicate that regulated speech-based interaction, can improve everyday information access, reduce articulation effort, and support socially acceptable use without substantially degrading perceived usability or intent resolution accuracy across diverse everyday environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。