arXiv:2602.09209cs.CV2026-02

用可穿戴摄像头提前预测脚踩地时的受力中心和时间,提升助行系统响应速度。

Wearable environmental sensing to forecast how legged systems will interact with upcoming terrain

  • 用深度相机+卷积循环网络,提前250毫秒预测脚部着地状态。
  • 50毫秒前预测误差仅23.7毫米(压力中心)和17.7毫秒(着地时间)。
  • 模型轻量可在笔记本或边缘设备上实时运行,适合智能助行器。

计算机视觉常用于步态中的环境分类并指导辅助系统控制,但对脚与环境接触方式的预测仍研究不足。本研究评估了在平地转上楼梯过程中,提前预测足部前后向中心受力点(COP)和着地时间(TOI)的可行性。8名受试者佩戴右小腿处的RGB-D相机与传感器鞋垫,完成上楼梯动作。采用CNN-RNN模型,在脚触地前250毫秒窗口内持续预测COP与TOI。在150、100、50毫秒预测窗口下,COP的平均绝对误差分别为29.42毫米、26.82毫米、23.72毫米;TOI的误差分别为21.14毫秒、20.08毫秒、17.73毫秒。躯干速度对误差无显著影响,但着地前趾部摆动速度越快,COP预测越准,而对TOI影响不显著。足部更靠前着地会降低COP预测精度,但不影响TOI。此外,该轻量模型可在消费级笔记本或边缘设备上以60帧/秒运行。结果表明,基于视觉数据的COP与TOI预测可行,对助行系统的前瞻控制具有重要意义。

原文摘要 · Abstract (English)

Computer-vision (CV) has been used for environmental classification during gait and is often used to inform control in assistive systems; however, the ability to predict how the foot will contact a changing environment is underexplored. We evaluated the feasibility of forecasting the anterior-posterior (AP) foot center-of-pressure (COP) and time-of-impact (TOI) prior to foot-strike on a level-ground to stair-ascent transition. Eight subjects wore an RGB-D camera on their right shank and instrumented insoles while performing the task of stepping onto the stairs. We trained a CNN-RNN to forecast the COP and TOI continuously within a 250ms window prior to foot-strike, termed the forecast horizon (FH). The COP mean-absolute-error (MAE) at 150, 100, and 50ms FH was 29.42mm, 26.82, and 23.72mm respectively. The TOI MAE was 21.14, 20.08, and 17.73ms for 150, 100, and 50ms respectively. While torso velocity had no effect on the error in either task, faster toe-swing speeds prior to foot-strike were found to improve the prediction accuracy in the COP case, however, was insignificant in the TOI case. Further, more anterior foot-strikes were found to reduce COP prediction accuracy but did not affect the TOI prediction accuracy. We also found that our lightweight model was capable at running at 60 FPS on either a consumer grade laptop or an edge computing device. This study demonstrates that forecasting COP and TOI from visual data was feasible using a lightweight model, which may have important implications for anticipatory control in assistive systems.

可穿戴传感步态预测助行系统实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。