arXiv:2606.25247cs.HCcs.LG2026-06

让输入法能自动适配任意手机键盘布局,无需重新训练。

FUTO Swipe: Layout-Agnostic Neural Swipe Decoding

论文配图:FUTO Swipe: Layout-Agnostic Neural Swipe Decoding
图 1 · 摘自论文原文
  • 用空间+时间预测代替固定布局训练,推理时动态匹配键盘位置。
  • 在12000+次会话中收集超100万条滑动轨迹,构建最大开源数据集。
  • 通过几何增强实现跨布局泛化,性能甚至优于原生训练布局。

神经滑动解码器通常绑定于特定键盘布局,需为每种布局重新训练。本文提出FUTO Swipe,使模型可适配任意连续手机键盘布局。在滑动过程中,编码器预测用户是否指向某个字符及其在键盘上的位置,键盘布局在推理时提供,不参与训练。为解决数据稀缺问题,我们发布了swipe.futo.org,包含超过12,000名用户贡献的100万条滑动轨迹,是目前最大且可自由使用的开源滑动数据集。为提升对非QWERTY布局的泛化能力,我们在每一步训练中对滑动轨迹和键盘布局应用几何增强,迫使模型依赖手势特征而非布局本身进行判断。实验表明,模型可在未见过的布局上表现良好,部分情况下甚至优于其训练所用的QWERTY布局。该方法结合了算法解码器的布局灵活性与神经模型的高精度。训练好的模型已公开可用。

原文摘要 · Abstract (English)

Neural swipe decoders are typically tied to the keyboard they were trained on, requiring a new corpus and training run for each layout. In this report, we document our approach toward training models that can function on any contiguous mobile keyboard layout. At each point along the swipe, our encoder predicts whether the user is indicating a character and where on the keyboard that character lies. The keyboard layout is supplied at inference time and used to map the spatial and temporal prediction to a logit at each key, rather than being learned during training. Training neural models requires substantial data, but public swipe data is limited, particularly for non-QWERTY layouts. We release swipe.futo.org, the largest MIT-licensed swipe corpus we are aware of, containing over 1M donated swipes from more than 12k donor sessions. To generalize beyond the English QWERTY layout, we apply geometric augmentations to both the swipe trajectory and the keyboard layout at every training step, forcing the model to make predictions based on characteristics of the swipe gesture rather than the training layout. The model generalizes to layouts absent from training, in some cases more accurately than the layout it was trained on. This combines the layout-flexibility of an algorithmic decoder with the accuracy of a neural model. Trained models are publicly available.

输入法滑动识别泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。