arXiv:2608.20335cs.CV2026-08

仅用一段单目视频,就能重建出可任意视角观看的4D人体模型。

4DAnyone: Create Anyone in 4D from a Casual Monocular Video

论文配图:4DAnyone: Create Anyone in 4D from a Casual Monocular Video
图 1 · 摘自论文原文
  • 通过压缩参考视图上下文和动态路由目标视图组,解决多视角生成一致性难题。
  • 在多个数据集上生成视频质量与4DGS重建精度均优于现有方法。
  • 适合需要低成本3D/4D人体建模的研究者和开发者使用。

我们提出4DAnyone,一种从非标定单目视频重建4D人体的方法,通过生成高质量多视角一致视频并将其提升为4D高斯点云(4DGS)。现有相机控制的视频扩散模型在生成数十个目标视角时会因注意力上下文受限而出现不一致。我们识别出该问题源于双重瓶颈:参考上下文随视图数量线性增长,削弱跨视角外观引导;目标视图分组间信息隔离,导致全局结构漂移。4DAnyone采用两项互补设计:参考上下文打包(RCP)将不断增长的参考视图压缩为固定长度、多分辨率上下文,复杂度恒为$O(1)$;目标上下文路由(TCR)在去噪过程中轮换目标视图分组,于高噪声阶段共享上下文,低噪声阶段稳定细节。我们还构建了MVGameHuman数据集,结合光照扫描与真实场景视频进行训练。在DNA-Rendering和DyMVHumans数据集上的实验表明,4DAnyone在新视角视频质量和下游4DGS重建方面均优于现有方法,并具备良好的真实场景泛化能力。

原文摘要 · Abstract (English)

We present 4DAnyone, a framework for reconstructing 4D humans from an uncalibrated monocular video by generating reconstruction-grade multiview-consistent videos and lifting them into 4D Gaussian Splatting (4DGS). Existing camera-controlled video diffusion models synthesize plausible novel-view videos but fail to maintain consistency when scaled to the tens of target views required for 4DGS reconstruction. We identify this failure as a bounded-attention-context problem: when target views exceed the capacity of a single DiT forward pass, they must be split into groups, exposing two coupled bottlenecks. On the reference-context side, conditioning on all previously generated views grows as $O(N)$, weakening cross-view appearance guidance. On the target-context side, disjoint groups cannot directly exchange information, causing global structural drift. 4DAnyone addresses both bottlenecks with two complementary designs: Reference Context Packing (RCP) compresses growing reference views into a fixed-length mixed-resolution context with $O(1)$ reference-context complexity, while Target Context Routing (TCR) rotates target-view groupings during denoising to share context across groups at high-noise steps and stabilize details at low-noise steps. We further build the MVGameHuman dataset using our in-house game engine and combine it with light-stage and in-the-wild video datasets for training. Experiments on DNA-Rendering and DyMVHumans show that 4DAnyone outperforms prior methods in both novel-view video quality and downstream 4DGS reconstruction, with robust in-the-wild generalization. See our project page for video results and source code: https://4danyone.github.io.

4D重建视频生成高斯点云单目视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。