arXiv:2512.00557cs.CV2025-12

用神经目标引导生成图像,揭示脑区协同与对抗关系。

NeuroVolve: Evolving Visual Stimuli toward Programmable Neural Objectives

  • 在预训练视觉语言模型嵌入空间中优化神经目标函数生成图像。
  • 可生成单区域或多个脑区协同/拮抗激活的语义一致图像。
  • 支持个性化脑图谱驱动的图像合成,适合神经科学与生成模型研究者。

现有方法多聚焦于孤立脑区对特定类别(如面孔)的选择性建模,但难以揭示自然视觉下脑区间的动态交互。本文提出NeuroVolve,一种基于预训练视觉语言模型嵌入空间的生成框架,通过编程化神经目标函数指导图像生成——可激活或抑制单个脑区或多个脑区组合。该方法验证了已知脑区选择性,同时能合成满足复杂多区域约束的连贯场景。通过追踪优化路径,揭示嵌入空间中的语义演化轨迹,统一了脑引导图像编辑与偏好刺激生成。实验表明,NeuroVolve可生成针对单个感兴趣区域(ROI)的低级特征与语义特征刺激,并实现脑区间的共激活与解相关调控,揭示合作与拮抗调谐关系。尤其可捕捉个体差异偏好,支持个性化脑驱动合成,为神经表征的映射、分析与探测提供可解释约束。

原文摘要 · Abstract (English)

What visual information is encoded in individual brain regions, and how do distributed patterns combine to create their neural representations? Prior work has used generative models to replicate known category selectivity in isolated regions (e.g., faces in FFA), but these approaches offer limited insight into how regions interact during complex, naturalistic vision. We introduce NeuroVolve, a generative framework that provides brain-guided image synthesis via optimization of a neural objective function in the embedding space of a pretrained vision-language model. Images are generated under the guidance of a programmable neural objective, i.e., activating or deactivating single regions or multiple regions together. NeuroVolve is validated by recovering known selectivity for individual brain regions, while expanding to synthesize coherent scenes that satisfy complex, multi-region constraints. By tracking optimization steps, it reveals semantic trajectories through embedding space, unifying brain-guided image editing and preferred stimulus generation in a single process. We show that NeuroVolve can generate both low-level and semantic feature-specific stimuli for single ROIs, as well as stimuli aligned to curated neural objectives. These include co-activation and decorrelation between regions, exposing cooperative and antagonistic tuning relationships. Notably, the framework captures subject-specific preferences, supporting personalized brain-driven synthesis and offering interpretable constraints for mapping, analyzing, and probing neural representations of visual information.

脑机接口生成模型神经表征视觉认知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。