arXiv:2609.04850cs.AI2026-09

首个面向老年人的手机界面智能体评测基准,揭示真实语言习惯对智能体性能的显著影响

ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults

论文配图:ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults
图 1 · 摘自论文原文
  • 基于249个老年人真实操作任务构建评测数据集
  • 现有智能体在处理老年人模糊指令时性能下降超40%
  • 为适老化交互设计提供可落地的语言理解优化方向

尽管自主移动智能体在帮助老年人使用智能手机方面潜力巨大,但现有图形用户界面(GUI)评测主要依赖明确的目标导向指令,难以捕捉老年人自然交流中的间接表达、指代模糊和指令不完整等特征。这种评测指令与真实老年用户交互之间的错配,可能阻碍智能体的可靠部署。为此,我们提出ElderBench,首个针对老年人情境的移动GUI智能体评测基准。该基准源自20个应用中收集的249个自然产生的智能手机任务。我们首先从句法、语义和语用角度分析了老年人指令与现有基准指令的差异。随后,在在线和离线设置下评估主流GUI智能体和视觉-语言模型,发现其在处理老年人指令时性能显著下降。通过控制指令标准化、故障分析及细粒度语言特征分析,进一步揭示了老年人特有语言模式如何导致智能体失败。研究结果为开发更适应、可解释且包容老龄群体的GUI智能体提供了切实可行的设计启示。

原文摘要 · Abstract (English)

While autonomous mobile agents hold great potential for assisting older adults with smartphone usage, existing GUI benchmarks mainly rely on explicit, goal-oriented instructions and rarely capture the naturally occurring language patterns of older users, such as indirect speech, referential ambiguity, and under-specified requests. This mismatch between benchmark instructions and real-world elderly interactions may hinder reliable agent deployment. To address this gap, we present ElderBench, the first benchmark for evaluating mobile GUI agents in authentic elderly-oriented scenarios. ElderBench is constructed from 249 naturally elicited smartphone tasks collected from older adults across 20 applications. We first characterize the linguistic divergence between elderly instructions and existing GUI benchmark instructions from syntactic, semantic, and pragmatic perspectives. We then evaluate mainstream GUI agents and Vision-Language Models under both online and offline settings, revealing substantial performance degradation when handling elderly-oriented instructions. Through controlled instruction normalization, failure analysis, and fine-grained linguistic feature analysis, we further identify how elderly-specific language patterns contribute to agent failures. Our findings provide actionable design insights toward more adaptive, interpretable, and age-inclusive GUI agents for older adults.

智能体评测适老化设计自然语言理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。