arXiv:2505.06325cs.LGcs.AI2025-05被引 2

让用户交互式调整模型隐空间,提升训练效果并发现潜在偏差

Human in the Latent Loop (HILL): Interactively Guiding Model Training Through Human Intuition

  • 用户通过交互修改隐空间,以人类直觉引导模型训练
  • 改进后模型性能提升,且保持泛化能力
  • 适合希望融合领域经验的开发者与研究人员

隐空间表征对理解与改进机器学习模型行为至关重要,但通常晦涩复杂。本研究提出HILL框架,使用户能通过交互方式重塑隐空间表示,将人类直觉融入模型训练过程。该方法受知识蒸馏启发,将用户修改视为教师信号,指导模型优化其内在隐空间表示。实验表明,人类引导的隐空间调整可有效提升模型性能并维持泛化性,但也揭示了引入用户偏见的风险。本工作构建了一种新型人机协同范式,深入探讨了人类干预对训练策略及潜在偏见的影响。

原文摘要 · Abstract (English)

Latent space representations are critical for understanding and improving the behavior of machine learning models, yet they often remain obscure and intricate. Understanding and exploring the latent space has the potential to contribute valuable human intuition and expertise about respective domains. In this work, we present HILL, an interactive framework allowing users to incorporate human intuition into the model training by interactively reshaping latent space representations. The modifications are infused into the model training loop via a novel approach inspired by knowledge distillation, treating the user's modifications as a teacher to guide the model in reshaping its intrinsic latent representation. The process allows the model to converge more effectively and overcome inefficiencies, as well as provide beneficial insights to the user. We evaluated HILL in a user study tasking participants to train an optimal model, closely observing the employed strategies. The results demonstrated that human-guided latent space modifications enhance model performance while maintaining generalization, yet also revealing the risks of including user biases. Our work introduces a novel human-AI interaction paradigm that infuses human intuition into model training and critically examines the impact of human intervention on training strategies and potential biases.

人机交互隐空间模型训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。