arXiv:2508.09852q-bio.NCcs.AI2025-08

用神经网络模拟8种视觉感知障碍,让健康人体验患者视角。

Perceptual Reality Transformer: Neural Architectures for Simulating Neurological Perception Conditions

  • 六种神经架构学习自然图像到病态视觉的映射关系。
  • ViT在ImageNet和CIFAR-10上表现最佳,优于传统CNN与生成模型。
  • 首个系统性基准,适合医学教育与共情训练使用。

影响视觉感知的神经系统疾病造成了患者与照料者、家人及医疗人员之间的深刻体验鸿沟。我们提出感知现实变换器(Perceptual Reality Transformer),一个采用六种不同神经架构的综合框架,可基于科学依据对八种神经系统感知障碍进行视觉仿真。该系统学习从自然图像到特定病理感知状态的映射,使他人能够体验包括同时性失认症、面孔识别障碍、注意力缺陷(如ADHD)、视觉失认、抑郁相关变化、焦虑性隧道视野以及阿尔茨海默病记忆效应等病症的近似视觉感受。在ImageNet和CIFAR-10数据集上的系统评估表明,视觉变换器(Vision Transformer)架构表现最优,显著优于传统卷积网络(CNN)与生成式方法。本工作建立了首个神经系统感知仿真的系统性基准,提出了基于临床文献的新型条件特异性扰动函数,并提供了量化评估仿真保真度的指标。该框架在医学教育、共情训练和辅助技术开发中具有直接应用价值,同时推动了神经网络建模异常人类感知的基本理解。

原文摘要 · Abstract (English)

Neurological conditions affecting visual perception create profound experiential divides between affected individuals and their caregivers, families, and medical professionals. We present the Perceptual Reality Transformer, a comprehensive framework employing six distinct neural architectures to simulate eight neurological perception conditions with scientifically-grounded visual transformations. Our system learns mappings from natural images to condition-specific perceptual states, enabling others to experience approximations of simultanagnosia, prosopagnosia, ADHD attention deficits, visual agnosia, depression-related changes, anxiety tunnel vision, and Alzheimer's memory effects. Through systematic evaluation across ImageNet and CIFAR-10 datasets, we demonstrate that Vision Transformer architectures achieve optimal performance, outperforming traditional CNN and generative approaches. Our work establishes the first systematic benchmark for neurological perception simulation, contributes novel condition-specific perturbation functions grounded in clinical literature, and provides quantitative metrics for evaluating simulation fidelity. The framework has immediate applications in medical education, empathy training, and assistive technology development, while advancing our fundamental understanding of how neural networks can model atypical human perception.

神经仿真感知建模共情训练视觉障碍

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。