arXiv:2606.23643cs.AI2026-06

让AI根据用户行为生成定制化多模态内容,无需现成素材

TailorMind: Towards Preference-Aligned Multimodal Content Generation

论文配图:TailorMind: Towards Preference-Aligned Multimodal Content Generation
图 1 · 摘自论文原文
  • 用超图协同过滤补全稀疏用户历史,生成可控制的文本偏好
  • 在五个维度上优于基线模型,最高提升29%重排召回率
  • 适合需要个性化内容生成的平台,尤其无现成素材时

个性化内容系统依赖可用的用户生成内容(UGC),但在合适内容缺失、延迟或创建成本高时难以应对。尽管多模态生成器可按需合成内容,如何将用户行为轨迹转化为生成可用的偏好仍缺乏研究。本文提出TailorMind,将协同偏好建模与可控多模态生成结合。该方法通过超图协同过滤丰富稀疏用户历史,并利用排序误差反馈和文本梯度下降优化文本画像。检索增强的风格控制使输出贴近真实UGC模式,跨模态一致性反射减少语义漂移。我们构建了TailorBench基准,涵盖三个主流平台,从连贯性、新颖性、美学、幻觉和画像准确性五个维度评估。实验表明,TailorMind在连贯性上达到竞争性或更强表现,显著提升新颖性和美学质量,优于代表性生成基线及真实UGC,在重排任务中最高实现29%的召回率提升。代码已开源:https://github.com/iLearn-Lab/TailorMind。

原文摘要 · Abstract (English)

Personalized content systems depend on available UGC and struggle when suitable content is absent, delayed, or costly to create. Although multimodal generators can synthesize content on demand, how to translate behavioral traces into generation-ready preferences remains underexplored. We study personalized multimodal content generation: creating user-tailored multimodal content without existing item pools or waiting for matching UGC. We propose TailorMind, linking collaborative preference modeling with controllable multimodal generation. TailorMind enriches sparse user histories via hypergraph collaborative filtering and optimizes textual profiles with ranking-error feedback and textual gradient descent. Retrieval-augmented style control grounds outputs in authentic UGC patterns, while cross-modal cohesion reflection reduces semantic drift. We construct TailorBench, a benchmark from three mainstream platforms evaluated along five dimensions: coherence, novelty, aesthetic, hallucination, profiling. Experiments show that TailorMind achieves competitive or stronger coherence, improves novelty and aesthetic quality over representative generation baselines and ground-truth UGC, demonstrating advantages over retrieving available content or comparable UGC, while achieving up to 29% Recall gains in reranking. Our code is released at: https://github.com/iLearn-Lab/TailorMind.

多模态生成个性化推荐偏好建模内容生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。