让AI理解个人感知差异,性能超越基础模型一倍以上。
Shifting Attention to You: Personalized Brain-Inspired AI Models
- 用人类行为与脑电数据微调CLIP模型,实现个性化感知建模。
- 在个体感知判断预测上性能超基线模型2倍以上。
- 适合神经科学、个性化医疗及人机交互研究者使用。
人机智能融合为理解信息处理提供了强大路径,双方各自提供独特的计算视角。然而,当前的AI模型主要基于大规模数据训练,优化目标为群体平均表现,缺乏与个体用户感知语义和神经动态对齐的机制。本文通过在微调的CLIP模型中整合人类行为洞察与毫秒级神经数据,不仅捕捉到感知的通用性与个体化特征,还使行为表现相比未修改的CLIP基线提升超过两倍。通过嵌入人类先验偏见并模拟训练过程中的动态神经过程,个性化神经微调显著提升了对人类相似性判断的预测能力,并能追踪个体神经反应的时间演变。本研究建立了一种新颖、可解释的自适应AI系统设计框架,对神经科学、个性化医学和人机交互具有广泛影响。
原文摘要 · Abstract (English)
The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI integration, current AI models are largely trained on massive datasets, optimized for population-level performance, lacking mechanisms to align their computations with individual users' perceptual semantics and neural dynamics. Here we show that integrating human behavioral insights and millisecond scale neural data within a fine tuned CLIP based model not only captures generalized and individualized aspects of perception but also over doubles behavioral performance compared to the unmodified CLIP baseline. By embedding human inductive biases and mirroring dynamic neural processes during training, personalized neural fine tuning improves predictions of human similarity judgments and tracks the temporal evolution of individual neural responses. Our work establishes a novel, interpretable framework for designing adaptive AI systems, with broad implications for neuroscience, personalized medicine, and human-computer interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。