arXiv:2606.24196cs.AI2026-06

让AI理解用户行为,自动生成符合心意的图文视频。

Navigating User Behavior toward Personalized Multimodal Generation

论文配图:Navigating User Behavior toward Personalized Multimodal Generation
图 1 · 摘自论文原文
  • 用双编码表示用户行为,融合互动数据与语义信息
  • 两阶段训练提升指令生成能力,使内容更贴合用户意图
  • 适用于电商、游戏、短视频场景,提升个性化生成效果

当前AIGC流水线能生成高质量图像和视频,但依赖明确的创作指令,而用户通常不提供具体视觉细节,导致生成结果与需求不符。本文研究个性化内容生成,将用户交互历史转化为可执行的生成指令,并识别出两大挑战:行为需转化为语言推理可理解的形式,且模型缺乏从预训练和行为数据中获取的指令撰写能力。为此提出NaviGen,通过双标识符(协作码+文本码)在单个令牌流中构建行为基底与语义桥梁。在此表示基础上,采用两阶段SFT+RL训练:先从进化搜索获得的监督信号中蒸馏偏好推理与指令写作能力,再通过层级化、自洽的奖励机制对齐生成内容与用户意图。跨产品、游戏和短视频领域的实验表明,NaviGen显著提升个性化图像与视频生成质量,增强下一步项目预测能力,并生成更具针对性、相关性及可生成性的指令。代码已开源:https://github.com/iLearn-Lab/NaviGen。

原文摘要 · Abstract (English)

Modern AIGC pipelines deliver high-fidelity images and videos but presuppose a well-formed creation instruction, while end users rarely articulate visual details, leaving generators misaligned with user demand. We study personalized content generation, which turns a user's interaction history into an executable instruction for downstream synthesis, and identify two obstacles: behavior must be encoded in a form legible to language reasoning, and the model must acquire instruction-writing skill absent from both pretraining and behavior data. We propose NaviGen, which represents each item with a dual identifier coupling a collaborative code and a textual code as a behavioral substrate and a semantic bridge in one token stream. On this representation, a two-stage SFT+RL pipeline first distills preference reasoning and instruction writing from evolutionarily searched supervision, then aligns generation with user intent through hierarchical and self-consistent rewards. Experiments across product, game, and short-video domains show that NaviGen improves personalized image and video generation, strengthens next-item prediction, and yields more specific, relevant, and visually generatable instructions. Our code is released at: https://github.com/iLearn-Lab/NaviGen.

个性化生成多模态用户行为建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。