arXiv:2605.21472cs.CV2026-05被引 4

让单视图3D生成模型稳定处理连续视频流,保持时间一致性。

Stream3D: Sequential Multi-View 3D Generation via Evidential Memory

论文配图:Stream3D: Sequential Multi-View 3D Generation via Evidential Memory
图 1 · 摘自论文原文
  • 用证据评分机制动态缓存关键历史帧,构建紧凑记忆
  • 在真实与合成数据上优于现有基线,几何与光影指标均提升
  • 无需重训练或修改模型,适合快速部署到现有3D生成系统

单视图3D生成模型如SAM 3D、TRELLIS和Hunyuan3D能从单帧生成高质量物体重建,但现实视觉输入通常是长序列的单目视频流。若对每一帧独立应用这些模型,会导致生成结果严重的时间不一致。为此,我们提出Stream3D,首个无需训练的流式生成机制,将冻结的单视图3D生成器转变为具备恒定跨块记忆的流式生成器。Stream3D通过维护一个紧凑的证据记忆,基于提出的证据评分机制选择性缓存最具信息量的历史帧。随着流的推进,记忆动态更新以固定数量保留高信息帧,避免内存随序列长度线性增长。这既防止长期生成退化,又完全保持底层生成器不变,无需重训练、架构修改或辅助损失。在真实与合成流式基准上评估,Stream3D在光度与几何指标上均优于基于隐空间传输的基线方法,包括KV缓存复用与基于流的特征编辑。

原文摘要 · Abstract (English)

View-conditioned 3D generators such as SAM 3D, TRELLIS, and Hunyuan3D produce high-quality object reconstructions from a single view, but real-world visual observation often arrives as long monocular streams. Naively applying these generators to each streaming frame independently leads to severe temporal inconsistency in the generated results. To address this problem, we propose Stream3D, the first training-free streaming mechanism that turns a frozen view-conditioned 3D generator into a streaming generator with constant cross-chunk memory. Stream3D achieves this by maintaining a compact evidential memory, which selectively caches the most informative historical frames based on a proposed evidence score mechanism. As the stream progresses, the memory dynamically updates to retain a fixed number of informative frames, preventing the memory footprint from growing linearly with sequence length. This also prevents degradation over long sequences and keeps the underlying generator completely unchanged without retraining, architectural modifications, or auxiliary losses. Evaluated on both realistic and synthetic streaming benchmarks, Stream3D outperforms latent-transport baselines, including KV-cache reuse and flow-based feature editing, across both photometric and geometric metrics. More details can be found at: https://stream-3d.github.io/stream3d.github.io/.

3D生成视频流记忆机制一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。