用AI预测点击目标，减少鼠标操作量，缓解重复性劳损
Preview, Accept or Discard? A Predictive Low-Motion Interaction Paradigm
- 提出零点击交互范式PAD，通过预览、切换、按键释放判断选择
- 相比触控板，手部运动减少显著，且在高准确率下任务时间相当
- 适合需要长时间打字或频繁点击的用户，如程序员、客服
重复性劳损影响约五分之一电脑使用者，尽管数十年来不断改进人体工学鼠标，其根本问题仍未解决：仍需精细手部动作。本文探讨是否可通过人工智能辅助输入，将物理指针操作替换为屏幕上的排序建议，以减少手部运动。为保留用户控制权，提出预览-接受-丢弃（PAD）范式，允许用户预览预测的GUI目标，循环浏览少量排名候选，并通过按键释放时机决定接受或放弃。在基于浏览器的邮件客户端和符合ISO 9241-9标准的键盘预测任务中评估，不同前3名准确率条件下，PAD显著降低手部运动，当准确率接近最佳拼写检查器水平时，任务耗时与触控板相当。
原文摘要 · Abstract (English)
Repetitive strain injury (RSI) affects roughly one in five computer users and remains largely unresolved despite decades of ergonomic mouse redesign. All such devices share a fundamental limitation: they still require fine-motor motion to operate. This work investigates whether predictive, AI-assisted input can reduce that motion by replacing physical pointing with ranked on-screen suggestions. To preserve user agency, we introduce Preview Accept Discard (PAD), a zero-click interaction paradigm that lets users preview predicted GUI targets, cycle through a small set of ranked alternatives, and accept or discard them via key-release timing. We evaluate PAD in two settings: a browser-based email client and a ISO 9241-9 keyboard-prediction task under varying top-3 accuracies. Across both studies, PAD substantially reduces hand motion relative to trackpad use while maintaining comparable task times with the trackpad only when accuracies are similar to those of the best spell-checkers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。