arXiv:2505.09368cs.CVcs.LG2025-05被引 9

构建首个统一评估光流等任务抗图像退化能力的基准

RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereo

  • 在高分辨率Spring数据集上系统施加20类真实退化,保持时序与立体一致性
  • 生成2万张带退化的图像,提出新鲁棒性度量支持精度与鲁棒性双维度评估
  • 验证模型在真实退化场景下的表现,助力开发更稳健的视觉算法

现有光流、场景流和立体视觉基准主要关注模型精度,忽视对噪声、雨滴等图像退化的真实鲁棒性评估。为此,我们提出RobustSpring,一个全面的数据集与基准,用于评估这些任务对图像退化的鲁棒性。RobustSpring在高分辨率Spring数据集上以时序、立体和深度一致的方式施加20种图像退化(包括噪声、模糊、色彩变化、质量下降及天气畸变),生成20,000张退化图像,模拟严苛现实条件。该基准引入新的退化鲁棒性度量,并与Spring基准集成,支持精度与鲁棒性的双轴评估。我们评测了若干代表性模型,发现鲁棒性随退化类型差异显著,且在RobustSpring上的表现能有效反映真实世界性能。RobustSpring将鲁棒性提升为首要考量,推动更准确且抗干扰的模型发展。项目地址:https://spring-benchmark.org。

原文摘要 · Abstract (English)

Standard benchmarks for optical flow, scene flow, and stereo vision algorithms generally focus on model accuracy rather than robustness to image corruptions like noise or rain. Hence, the resilience of models to such real-world perturbations is largely unquantified. To address this, we present RobustSpring, a comprehensive dataset and benchmark for evaluating robustness to image corruptions for optical flow, scene flow, and stereo models. RobustSpring applies 20 different image corruptions, including noise, blur, color changes, quality degradations, and weather distortions, in a time-, stereo-, and depth-consistent manner to the high-resolution Spring dataset, creating a suite of 20,000 corrupted images that reflect challenging conditions. RobustSpring enables comparisons of model robustness via a new corruption robustness metric. Integration with the Spring benchmark enables two-axis evaluations of both accuracy and robustness. We benchmark a curated selection of initial models, observing that robustness varies widely by corruption type, and experimentally show that evaluations on RobustSpring indicate real-world robustness. RobustSpring is a new computer vision benchmark to treat robustness as a first-class citizen, fostering models that are accurate and resilient. It is available at https://spring-benchmark.org.

鲁棒性评估光流立体视觉数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。