用凸优化方法实现超低功耗可穿戴手势识别
Resource-Efficient Gesture Recognition through Convexified Attention
- 采用凸化注意力机制,通过单纯形投影与凸损失函数保证全局收敛
- 仅需120-360个参数,实现100%手势识别准确率
- 适合资源受限的电子纺织品设备,支持毫秒级实时响应
可穿戴电子纺织品界面需要手势识别能力,但受功耗、算力和形态限制,传统深度学习难以应用。尽管轻量级架构如MobileNet提升效率,仍需数千参数,限制在纺织品集成平台部署。本文提出一种适用于可穿戴场景的凸化注意力机制,通过非扩张单纯形投影与凸损失函数动态加权特征,保持凸性。与传统使用非凸Softmax的注意力不同,本方法采用欧氏投影到概率单纯形并结合多类合页损失,确保全局收敛。在四端点电容式传感器上实现,对点击和滑动手势在十折交叉验证及留出测试中均达到100.00%准确率,参数量仅为120–360,较常规方法减少97%。推理时间低于1毫秒(290–296μs),存储需求低于7KB,可在电子纺织品内直接完成手势识别,无需外部处理。实验在单用户受控实验室环境下进行,验证了基础手势交互的可行性。真实场景部署需进一步验证多用户、环境变化及复杂手势词汇。结果表明,凸优化可为纺织品界面提供高效的本地机器学习方案。
原文摘要 · Abstract (English)
Wearable e-textile interfaces require gesture recognition capabilities but face severe constraints in power consumption, computational capacity, and form factor that make traditional deep learning impractical. While lightweight architectures like MobileNet improve efficiency, they still demand thousands of parameters, limiting deployment on textile-integrated platforms. We introduce a convexified attention mechanism for wearable applications that dynamically weights features while preserving convexity through nonexpansive simplex projection and convex loss functions. Unlike conventional attention mechanisms using non-convex softmax operations, our approach employs Euclidean projection onto the probability simplex combined with multi-class hinge loss, ensuring global convergence guarantees. Implemented on a textile-based capacitive sensor with four connection points, our approach achieves 100.00\% accuracy on tap gestures and 100.00\% on swipe gestures -- consistent across 10-fold cross-validation and held-out test evaluation -- while requiring only 120--360 parameters, a 97\% reduction compared to conventional approaches. With sub-millisecond inference times (290--296$μ$s) and minimal storage requirements ($<$7KB), our method enables gesture interfaces directly within e-textiles without external processing. Our evaluation, conducted in controlled laboratory conditions with a single-user dataset, demonstrates feasibility for basic gesture interactions. Real-world deployment would require validation across multiple users, environmental conditions, and more complex gesture vocabularies. These results demonstrate how convex optimization can enable efficient on-device machine learning for textile interfaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。