用手机手表传感器生成带上下文的日常活动日志,更准更快。
DailyLLM: Context-Aware Activity Log Generation Using Multi-Modal Sensors and LLMs
- 融合位置、动作、环境和生理四维信息,用轻量LLM理解活动
- 用1.5B参数模型实现比70B模型高17%的生成准确率,快近10倍
- 适合健康监测与行为分析场景,可在树莓派上部署
丰富的上下文感知活动日志有助于用户行为分析与健康监测,是普适计算领域的关键研究方向。大型语言模型(LLMs)强大的语义理解与生成能力为活动日志生成带来了新机遇。然而,现有方法在准确性、效率和语义丰富度方面仍存在明显局限。为此,我们提出DailyLLM。据我们所知,这是首个仅使用智能手机和智能手表常见传感器,全面整合位置、运动、环境和生理四维上下文信息的活动日志生成与摘要系统。DailyLLM采用轻量级LLM框架,结合结构化提示与高效特征提取,实现高层次活动理解。大量实验表明,DailyLLM优于当前最优(SOTA)日志生成方法,且可高效部署于个人电脑和Raspberry Pi。仅使用1.5B参数的LLM模型,相比70B参数的SOTA基线,日志生成的BERTScore精度提升17%,推理速度接近10倍加快。
原文摘要 · Abstract (English)
Rich and context-aware activity logs facilitate user behavior analysis and health monitoring, making them a key research focus in ubiquitous computing. The remarkable semantic understanding and generation capabilities of Large Language Models (LLMs) have recently created new opportunities for activity log generation. However, existing methods continue to exhibit notable limitations in terms of accuracy, efficiency, and semantic richness. To address these challenges, we propose DailyLLM. To the best of our knowledge, this is the first log generation and summarization system that comprehensively integrates contextual activity information across four dimensions: location, motion, environment, and physiology, using only sensors commonly available on smartphones and smartwatches. To achieve this, DailyLLM introduces a lightweight LLM-based framework that integrates structured prompting with efficient feature extraction to enable high-level activity understanding. Extensive experiments demonstrate that DailyLLM outperforms state-of-the-art (SOTA) log generation methods and can be efficiently deployed on personal computers and Raspberry Pi. Utilizing only a 1.5B-parameter LLM model, DailyLLM achieves a 17% improvement in log generation BERTScore precision compared to the 70B-parameter SOTA baseline, while delivering nearly 10x faster inference speed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。