arXiv:2509.18864cs.AI2025-09被引 2

无需标签也能精准用户画像,靠的是可信度驱动的推理框架。

Conf-Profile: A Confidence-Driven Reasoning Paradigm for Label-Free User Profiling

  • 用置信度提示生成高质量伪标签,再加权投票提升准确率。
  • 在Qwen3-8B上F1提升13.97,实现无监督下可靠画像。
  • 适合缺乏标注数据的推荐系统、内容平台等场景使用。

用户画像作为理解用户的核心技术,旨在从用户信息中推断结构化属性。大语言模型(LLMs)为用户画像提供了新路径,但进展受限于缺乏全面的基准测试。为此,我们构建了基于真实视频平台的工业级基准ProfileBench,涵盖异构用户数据和结构化画像分类体系。然而,由于大规模真实标签难以获取,且用户数据异构且噪声多,导致LLM可靠性下降。为此,我们提出置信度驱动的画像推理框架Conf-Profile,采用两阶段范式:首先利用先进LLM结合置信度提示合成高质量伪标签;随后通过置信度加权投票提升精度,并进行置信度校准以获得更均衡分布。最终将多组画像结果、推理过程与置信度得分聚合并蒸馏至轻量级LLM。进一步通过置信度引导的无监督强化学习增强推理能力,利用置信度筛选难度、生成类真标签投票、优化奖励权重。实验表明,该框架在两阶段训练下显著提升性能,在Qwen3-8B上F1提升13.97。

原文摘要 · Abstract (English)

User profiling, as a core technique for user understanding, aims to infer structural attributes from user information. Large Language Models (LLMs) provide a promising avenue for user profiling, yet the progress is hindered by the lack of comprehensive benchmarks. To bridge this gap, we propose ProfileBench, an industrial benchmark derived from a real-world video platform, encompassing heterogeneous user data and a well-structured profiling taxonomy. However, the profiling task remains challenging due to the difficulty of collecting large-scale ground-truth labels, and the heterogeneous and noisy user information can compromise the reliability of LLMs. To approach label-free and reliable user profiling, we propose a Confidence-driven Profile reasoning framework Conf-Profile, featuring a two-stage paradigm. We first synthesize high-quality labels by leveraging advanced LLMs with confidence hints, followed by confidence-weighted voting for accuracy improvement and confidence calibration for a balanced distribution. The multiple profile results, rationales, and confidence scores are aggregated and distilled into a lightweight LLM. We further enhance the reasoning ability via confidence-guided unsupervised reinforcement learning, which exploits confidence for difficulty filtering, quasi-ground truth voting, and reward weighting. Experimental results demonstrate that Conf-Profile delivers substantial performance through the two-stage training, improving F1 by 13.97 on Qwen3-8B.

用户画像大模型无监督学习置信度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。