用手势直接在手机上操控大模型改写文字，更自然高效。
Exploring Mobile Touch Interaction with Large Language Models
- 通过手势（展开/捏合）直接控制大模型生成或精简文本。
- 用户研究显示，同时显示字数和关键词提示效果最佳。
- 适合希望无缝编辑的移动写作用户，推动手势交互新方向。
目前在移动设备上使用大语言模型进行文本编辑，需跳出当前写作环境切换到对话界面。本文提出直接在文本上通过触摸手势控制大模型的新方式。我们首先构建了涵盖基础触控输入与文本变换的设计空间，并具体探索了两种控制映射：展开生成与捏合缩短，均配有视觉反馈循环。在一项包含14名用户的实验中，对比了三种反馈设计：无可视化、仅字数指示、字数+词语指示。结果表明，基于触控的大模型控制既可行又易用，其中结合字数与关键词提示的反馈最有效。该工作为触控设备上基于手势的大型语言模型交互研究奠定了基础。
原文摘要 · Abstract (English)
Interacting with Large Language Models (LLMs) for text editing on mobile devices currently requires users to break out of their writing environment and switch to a conversational AI interface. In this paper, we propose to control the LLM via touch gestures performed directly on the text. We first chart a design space that covers fundamental touch input and text transformations. In this space, we then concretely explore two control mappings: spread-to-generate and pinch-to-shorten, with visual feedback loops. We evaluate this concept in a user study (N=14) that compares three feedback designs: no visualisation, text length indicator, and length + word indicator. The results demonstrate that touch-based control of LLMs is both feasible and user-friendly, with the length + word indicator proving most effective for managing text generation. This work lays the foundation for further research into gesture-based interaction with LLMs on touch devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。