用文件操作记录训练个性化AI助理,解决隐私限制下的智能记忆难题。
FileGram: Grounding Agent Personalization in File-System Behavioral Traces
- 通过模拟真实文件操作生成细粒度多模态行为数据
- 构建基准测试发现现有记忆系统仍难以应对复杂行为追踪
- 从原子操作直接建模用户画像,适合研究文件系统智能代理
在本地文件系统中协作的AI代理正成为人机交互新范式,但有效个性化受限于严重的数据约束:严格的隐私屏障及多模态真实行为轨迹联合收集困难,导致可扩展训练与评估受阻;现有方法仍以交互为中心,忽视文件系统操作中的密集行为痕迹。为此,我们提出FileGram框架,将代理记忆与个性化扎根于文件系统行为痕迹,包含三个核心组件:(1) FileGramEngine,可扩展的人物驱动数据引擎,能大规模生成逼真的工作流与细粒度多模态动作序列;(2) FileGramBench,基于文件系统行为痕迹的诊断基准,用于评估记忆系统在个人资料重建、痕迹解耦、人物漂移检测与多模态对齐上的表现;(3) FileGramOS,自底向上的记忆架构,直接从原子操作和内容变化构建用户画像,通过查询时抽象,将痕迹编码为程序化、语义化和情景化通道。大量实验表明,FileGramBench对当前最先进的记忆系统仍具挑战性,而FileGramEngine与FileGramOS均表现有效。通过开源该框架,我们期望推动面向个性化记忆的文件系统智能代理研究。
原文摘要 · Abstract (English)
Coworking AI agents operating within local file systems are rapidly emerging as a paradigm in human-AI interaction; however, effective personalization remains limited by severe data constraints, as strict privacy barriers and the difficulty of jointly collecting multimodal real-world traces prevent scalable training and evaluation, and existing methods remain interaction-centric while overlooking dense behavioral traces in file-system operations; to address this gap, we propose FileGram, a comprehensive framework that grounds agent memory and personalization in file-system behavioral traces, comprising three core components: (1) FileGramEngine, a scalable persona-driven data engine that simulates realistic workflows and generates fine-grained multimodal action sequences at scale; (2) FileGramBench, a diagnostic benchmark grounded in file-system behavioral traces for evaluating memory systems on profile reconstruction, trace disentanglement, persona drift detection, and multimodal grounding; and (3) FileGramOS, a bottom-up memory architecture that builds user profiles directly from atomic actions and content deltas rather than dialogue summaries, encoding these traces into procedural, semantic, and episodic channels with query-time abstraction; extensive experiments show that FileGramBench remains challenging for state-of-the-art memory systems and that FileGramEngine and FileGramOS are effective, and by open-sourcing the framework, we hope to support future research on personalized memory-centric file-system agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。