arXiv:2602.16950cs.CV2026-02被引 1

用固定相机+旋转物体实现高通量农产三维与光谱重建。

HS-3D-NeRF: 3D Surface and Hyperspectral Reconstruction From Stationary Hyperspectral Images Using Multi-Channel NeRFs

  • 固定相机拍摄旋转物体,结合多通道NeRF联合优化光谱与几何。
  • 在可见光与近红外波段实现高精度空间重建与光谱保真。
  • 适合自动化农业检测流程,无需复杂移动设备。

高光谱成像(HSI)与三维重建技术的进步,为农产品质量与植物表型的高通量精准表征提供了可能,对推动农业可持续发展和育种计划至关重要。HSI可捕捉农产品详细的生化特征,而三维几何数据显著提升了形态分析能力。然而,大规模整合这两种模态仍面临挑战,传统方法依赖复杂的硬件装置,难以兼容自动化表型系统。近年来,神经辐射场(NeRF)在计算效率方面取得进展,但通常需要移动相机,限制了室内农业环境下的通量与可重复性。为此,本文提出基于固定相机的多通道NeRF框架——HSI-SC-NeRF,用于高通量农产三维与光谱重建,适用于采后检测。通过在定制的特氟龙成像舱内,利用固定相机捕获旋转物体的多视角高光谱数据,实现均匀漫射光照。采用ArUco标定标记估计物体姿态,并通过模拟姿态变换映射至相机坐标系,从而支持标准NeRF训练。采用多通道NeRF结构,通过复合光谱损失联合优化所有高光谱波段,结合两阶段训练策略,解耦几何初始化与辐射度精修。在三种农产品样本上的实验表明,该方法在可见光与近红外波段均实现了高空间重建精度与强光谱保真度,验证了其集成于自动化农业工作流的可行性。

原文摘要 · Abstract (English)

Advances in hyperspectral imaging (HSI) and 3D reconstruction have enabled accurate, high-throughput characterization of agricultural produce quality and plant phenotypes, both essential for advancing agricultural sustainability and breeding programs. HSI captures detailed biochemical features of produce, while 3D geometric data substantially improves morphological analysis. However, integrating these two modalities at scale remains challenging, as conventional approaches involve complex hardware setups incompatible with automated phenotyping systems. Recent advances in neural radiance fields (NeRF) offer computationally efficient 3D reconstruction but typically require moving-camera setups, limiting throughput and reproducibility in standard indoor agricultural environments. To address these challenges, we introduce HSI-SC-NeRF, a stationary-camera multi-channel NeRF framework for high-throughput hyperspectral 3D reconstruction targeting postharvest inspection of agricultural produce. Multi-view hyperspectral data is captured using a stationary camera while the object rotates within a custom-built Teflon imaging chamber providing diffuse, uniform illumination. Object poses are estimated via ArUco calibration markers and transformed to the camera frame of reference through simulated pose transformations, enabling standard NeRF training on stationary-camera data. A multi-channel NeRF formulation optimizes reconstruction across all hyperspectral bands jointly using a composite spectral loss, supported by a two-stage training protocol that decouples geometric initialization from radiometric refinement. Experiments on three agricultural produce samples demonstrate high spatial reconstruction accuracy and strong spectral fidelity across the visible and near-infrared spectrum, confirming the suitability of HSI-SC-NeRF for integration into automated agricultural workflows.

三维重建光谱成像农业表型NeRF

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。