arXiv:2511.13132cs.CVcs.AI2025-11被引 2

用真实室内灯光干扰,暴露视觉语言导航模型的脆弱性。

Shedding Light on VLN Robustness: A Black-box Framework for Indoor Lighting-based Adversarial Attack

论文配图:Shedding Light on VLN Robustness: A Black-box Framework for Indoor Lighting-based Adversarial Attack
图 1 · 摘自论文原文
  • 通过改变全局光照制造对抗攻击,模拟真实家居环境
  • 攻击使导航失败率上升,路径效率显著下降
  • 适合关注智能机器人鲁棒性的研究者和开发者

视觉-语言导航(VLN)代理虽取得显著进展,但其鲁棒性仍缺乏充分研究。现有对抗评估多依赖现实中罕见的异常纹理扰动,导致结果缺乏实际意义。本文聚焦于室内光照这一内在且常被忽视的场景属性,提出基于室内光照的对抗攻击(ILA)框架,通过黑盒方式操纵全局照明以干扰VLN代理。基于家庭照明使用习惯,设计两种攻击模式:静态光照攻击(SILA),光照强度全程恒定;动态光照攻击(DILA),在关键节点开关灯光引发突变光照。在两个先进VLN模型上,对三种导航任务进行评估,结果显示ILA显著提升失败率并降低轨迹效率,揭示了VLN代理对真实室内光照变化的未被认识的脆弱性。

原文摘要 · Abstract (English)

Vision-and-Language Navigation (VLN) agents have made remarkable progress, but their robustness remains insufficiently studied. Existing adversarial evaluations often rely on perturbations that manifest as unusual textures rarely encountered in everyday indoor environments. Errors under such contrived conditions have limited practical relevance, as real-world agents are unlikely to encounter such artificial patterns. In this work, we focus on indoor lighting, an intrinsic yet largely overlooked scene attribute that strongly influences navigation. We propose Indoor Lighting-based Adversarial Attack (ILA), a black-box framework that manipulates global illumination to disrupt VLN agents. Motivated by typical household lighting usage, we design two attack modes: Static Indoor Lighting-based Attack (SILA), where the lighting intensity remains constant throughout an episode, and Dynamic Indoor Lighting-based Attack (DILA), where lights are switched on or off at critical moments to induce abrupt illumination changes. We evaluate ILA on two state-of-the-art VLN models across three navigation tasks. Results show that ILA significantly increases failure rates while reducing trajectory efficiency, revealing previously unrecognized vulnerabilities of VLN agents to realistic indoor lighting variations.

视觉导航对抗攻击光照扰动机器人鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。