让虚拟人物在任意场景中自然移动，支持镜头变化和光影融合。
AnimateScene: Camera-controllable Animation in Any Scene
- 自动定位人物位置，避免穿模且符合真实尺度。
- 无需训练实现光照风格匹配，合成画面更自然。
- 支持动态镜头轨迹，生成流畅连贯的动画视频。
近年来，3D场景重建与4D人体动画的发展推动了应用普及，但两者融合仍具挑战：需在无穿模前提下合理放置人物，对齐人物与背景的光照与风格，并处理动态相机轨迹。本文提出统一框架AnimateScene，首先通过精准定位模块自动确定人物3D位置并防止运动中碰撞；其次设计免训练的风格对齐方法，使4D人体适应背景光照与外观，实现视觉一致的合成；最后采用联合后重建策略，融入相机轨迹以生成平滑、视觉吸引人的运动视频。在多样场景与动作上实验表明，AnimateScene能生成具有高几何细节和强时空一致性的动态结果。
原文摘要 · Abstract (English)
Recent advances in 3D scene reconstruction and 4D human animation have broadened adoption, but integrating the two remains difficult. Key challenges include placing humans at plausible locations and scales without interpenetration, aligning lighting and style between humans and background, and handling dynamic camera trajectories. We introduce AnimateScene, a unified framework addressing these issues. First, an accurate placement module automatically determines realistic 3D positions and prevents collisions during motion. Second, we propose a training-free style alignment method that adapts the 4D human to match background illumination and appearance, achieving coherent composites. Finally, we design a joint post-reconstruction approach that incorporates camera trajectories for smooth, visually engaging motion videos. Experiments across diverse scenes and actions demonstrate that AnimateScene generates dynamic results with high geometric detail and strong spatiotemporal coherence. The project page is available at https://whynothaha.github.io/AnimateScene/AnimateScene.html.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。