arXiv:2607.09971cs.AI2026-07

通过拓扑检测避免进入封闭区域,提升探索效率。

TopoExplore: Topological Discrimination for Archive-Based Exploration

论文配图:TopoExplore: Topological Discrimination for Archive-Based Exploration
图 1 · 摘自论文原文
  • 用洪水填充识别被包围的未探索区,只奖励其入口点。
  • 在复杂门控环境中速度提升达10.9倍,整体平均快1.52倍。
  • 适合需判断封闭结构是否可进入的任务,如游戏关卡探索。

基于档案的探索方法如Go-Explore依赖访问稀有性选择回溯状态,而前沿方法则返回未知区域边界;二者均未判断边界后方的未探索区域是否真正可进入。探索不仅是寻找奖励,更是为下游学习与规划积累结构完整的经验。本文提出TopoExplore,通过周期性拓扑遍历增强Go-Explore的状态选择:利用洪水填充(立方复形的H1类)检测已访问区域占用网格中的封闭未探索区(空洞),仅对严格入口(间隙或门单元)施加递减选择奖励,确保密封区域永不被目标和进入,已进入区域自动退出。在包含18个环境的可控MiniGrid基准(15个种子,固定超参数)上,TopoExplore相较精确的Go-Explore消融版本实现1.52倍几何平均首次进入步数加速,优于前沿基线的1.37倍;当出现密封诱饵结构时,前沿探索性能下降至0.83–1.48倍,而TopoExplore仍保持1.65–2.11倍优势,尤其在多交互门难例中达10.9倍。报告了蒙特祖马复仇中的真实负面结果——无墙知识时,不可达的占据伪影捕获奖励,导致性能随其增长而恶化,凸显墙感知入口检测的关键作用;并在HM3D扫描建筑场景中呈现初步正面结果,相较于Go-Explore的速度提升与场景难度相关(r=0.69),即使前沿选择主导全覆盖也依然有效。证据支持一个谨慎主张:拓扑感知选择在需区分封闭结构是否可进入的场景中表现优异,且在开放覆盖场景中仍具竞争力,尽管未为此情形调优。

原文摘要 · Abstract (English)

Archive-based exploration methods such as Go-Explore select which visited state to return to using visitation rarity, and frontier methods return to the boundary of the unknown; neither asks whether the unexplored region behind a boundary is enterable at all. Exploration is not just about finding reward - it is about collecting a structurally complete experience for downstream learning and planning. We introduce TopoExplore, which augments Go-Explore cell selection with a periodic topological pass: enclosed unexplored regions (voids) of the visited-set occupancy grid are detected by flood fill (the H1 classes of its cubical complex), and a decaying selection bonus is placed only on their strict entrances (gap or door cells), so sealed regions are never targeted and entered regions retire. On a controlled 18-environment MiniGrid suite (15 seeds, frozen hyperparameters) TopoExplore attains a 1.52x geometric-mean speedup in median steps-to-first-entry over its exact Go-Explore ablation, versus 1.37x for a frontier baseline; frontier exploration degrades when sealed decoy structure appears (0.83-1.48x on decoy environments vs. 1.65-2.11x for TopoExplore), while TopoExplore holds its largest win on hard multi-interaction doors (10.9x). We report an honest negative on Montezuma's Revenge - without wall knowledge, unreachable occupancy artifacts capture the bonus and performance degrades as it grows, isolating the wall-aware entrance test as the load-bearing component - and a preliminary positive on HM3D scanned buildings, where the speedup over Go-Explore tracks scene difficulty (r=0.69) even as frontier selection dominates blanket coverage. The evidence supports a deliberately scoped claim: topology-aware selection pays off where enclosed structure must be discriminated, and remains competitive at open coverage, where frontier methods are strongest, despite not being tuned for that regime.

探索算法拓扑感知强化学习结构探索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。