用生理特性指导高光谱重建,提升医学成像精度。
PHASE: Physiology-Aware Hyperspectral Reconstruction via Object-to-Human Domain Adaptation
- 基于生理机理重构光谱,而非依赖物体反射特性。
- 在仅1.5%标注数据下,性能优于现有方法2.20 SSIM、3.06 SAM。
- 适合医疗影像、无创生理监测等场景的高光谱重建应用。
尽管高光谱成像能提供无创生理信息,但其设备庞大、采集缓慢且受监管限制,严重制约临床应用。一种自然解法是从常见的RGB或CASSI测量中重建高光谱信息。然而,现有以物体为中心的方法依赖反射率特征对齐,假设光谱相似性即语义一致,这一假设在生理成像中失效——视觉相似的RGB响应可能源自不同且纠缠的生理状态。为此,本文提出PHASE,一种生理感知的高光谱重建框架,通过生理通道重解释(Physiological Channel Reinterpretation)解耦跨通道生理语义,并利用生理约束对齐(Physiologically Constrained Alignment)确保重建结果符合生理合理性。在两种源到目标迁移设置下,仅需1.5%标注数据,性能较当前最优方法提升最高2.20 SSIM、降低3.06 SAM,显著克服了跨通道语义偏移(C1)与基于RGB采集的信息不可逆损失(C2)两大挑战。
原文摘要 · Abstract (English)
Although hyperspectral imaging offers unparalleled non-invasive physiological insight, its bulky hardware, slow acquisition, and regulatory burden severely limit its clinical availability. A natural workaround is to reconstruct hyperspectral information from ubiquitous RGB or CASSI measurements. However, existing paradigms, developed for object-centric scenes, rely on reflectance-based feature alignment, assuming that spectral similarity preserves semantic meaning. This assumption breaks down in physiological imaging, where visually similar RGB responses may arise from distinct and entangled physiological states. This mismatch motivates a shift from reflectance alignment to physiology-aware representation learning, grounded in shared light-matter interaction principles -- a shift that introduces fundamental challenges from cross-channel semantic shifts (C1) and irreversible information loss in RGB-based acquisition (C2). We therefore design PHASE, a physiology-aware hyperspectral reconstruction paradigm that fundamentally redefines object-to-human transfer by disentangling cross-channel physiological semantics via Physiological Channel Reinterpretation and restricting reconstruction to physiologically plausible solutions through Physiologically Constrained Alignment. Under two source-to-target transfer protocols, PHASE consistently outperforms state-of-the-art methods by up to +2.20 SSIM and -3.06 in SAM with merely 1.5% labeled supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。