动态激活场景图节点,缓解机器人长时间任务中的感知过载问题。
Just-In-Time Scene Graph Growth: Combating Perceptual Saturation in Long-Horizon Robotics

- 根据任务需求实时激活场景图局部节点,避免全局冗余感知。
- 相比传统方法,主动图规模减少67%,标注延迟降低52%。
- 适合长期复杂任务的边缘机器人系统,尤其关注实时性与资源效率。
尽管3D场景图(3DSGs)为具身智能体提供了关键的结构化表示,但传统的预先构建、全量映射再过滤的流程难以满足边缘平台的实时低延迟需求,导致严重观测冗余引发感知饱和。为此,我们提出JITOMA(即时按需记忆激活)框架,将任务推理、感知与记忆统一为即时生长机制。不预先完整映射环境,而是前端利用自上而下的任务热力图筛选连续观测,仅向系统注入最小数据流以维持低成本、休眠状态的全局锚点。当触发认知查询时,后端大语言模型解析机器人意图,动态唤醒相关锚点,仅在激活的局部子图中执行密集节点标注和功能推理等高开销操作。为评估该动态能力并研究感知饱和的权衡,我们引入JITOMA-Bench,一个面向长时程多任务与复杂多步推理的综合性评测套件。大量实验表明,JITOMA显著降低活跃图规模与标注延迟,同时在长时程任务切换下保持稳定的处理时间。
原文摘要 · Abstract (English)
While 3D Scene Graphs (3DSGs) provide crucial structured representations for embodied agents, conventional Ahead-of-Time, build-everything-then-filter pipelines conflict with the real-time, low-latency demands of edge platforms, inducing a perceptual saturation effect via severe observation redundancy. To resolve this, we present JITOMA (Just-In-Time On-demand Memory Activation), a closed-loop framework that unifies task reasoning, perception, and memory into a just-in-time growth process. Instead of exhaustively mapping the entire environment, JITOMA leverages a top-down task heatmap at the frontend to filter continuous observations, routing minimal streams to maintain a global foundation of low-cost, dormant anchors. Upon a cognitive query, the backend Large Language Model (LLM) parses the robotic intent to dynamically awaken task-relevant anchors, triggering resource-intensive operations -- such as dense node captioning and functional inference -- exclusively within the activated local subgraph. To evaluate these dynamic capabilities and study perceptual saturation trade-offs, we introduce JITOMA-Bench, a comprehensive suite for long-horizon multi-tasking and complex multi-step reasoning. Extensive experiments demonstrate that JITOMA substantially reduces active graph size and captioning latency, while maintaining stable processing time under long-horizon task switching.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。