让视觉模型像人一样反复推敲,提升复杂场景下的识别能力
PRISM: Progressive Reasoning through Iterative Slot Memory for Vision

- 通过多尺度迭代记忆重构,逐步优化图像表示
- 在遮挡等不完整输入下仍保持稳定性能
- 适合需要高鲁棒性的视觉任务应用
现代视觉模型通常采用单次前馈处理图像,难以在观测不全时恢复缺失信息或修正不确定表征。受人类感知的迭代特性启发,我们提出PRISM(Progressive Reasoning through Iterative Slot Memory),一种基于金字塔结构的视觉架构,通过迭代精炼实现对图像的逐步推理。该模型将视觉特征组织为以对象为中心的表征,从学习到的记忆中检索相关模式,并在多尺度上反复进行‘组织-回忆-精炼’,逐步消除歧义并恢复缺失信息。在图像分类、目标检测和语义分割等标准任务上,PRISM表现优异,且在遮挡等不完整观测条件下展现出更强的鲁棒性。结果表明,结合结构化表征与记忆的迭代推理是构建更适应、更稳健视觉模型的重要方向。源代码与模型将公开发布。
原文摘要 · Abstract (English)
Modern vision models process images in a single feed-forward pass, which limits their ability to recover missing evidence or refine uncertain representations under incomplete observations. Inspired by the iterative nature of human perception, we introduce PRISM (Progressive Reasoning through Iterative Slot Memory), a pyramid vision architecture that reasons over images through iterative refinement. At a high level, PRISM groups visual features into object-centric representations, retrieves relevant patterns from a learned memory, and iteratively refines the representation to resolve ambiguity and recover missing information. This organize-recall-refine process operates recurrently across multiple scales, enabling progressive improvement of visual representations. Across standard vision tasks, including image classification, object detection, and semantic segmentation, PRISM achieves competitive performance while demonstrating improved robustness under incomplete observations such as occlusion. These results suggest that iterative reasoning with structured representations and memory is a promising direction for building more resilient and adaptive vision models. Source code and models will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。