让视频生成更符合物理规律,解决物体运动不真实问题。
PhysCorr: Dual-Reward DPO for Physics-Constrained Text-to-Video Generation with Automated Preference Selection
- 用双维度奖励模型评估物体自身稳定性和互动合理性
- 通过对比反馈和物理加权优化,提升生成视频的物理一致性
- 可适配各类视频生成模型,适合机器人与仿真领域使用
近期文本到视频生成技术在视觉质量上取得显著进展,但生成内容常违背基本物理规律,表现为物体运动不自然、交互不合理和动作模式失真。这些问题限制了视频生成模型在具身智能、机器人和高仿真场景中的应用。为此,我们提出 PhysCorr 框架,统一建模、评估与优化视频生成中的物理一致性。具体地,我们引入 PhysicsRM——首个双维度奖励模型,量化物体内部稳定性与物体间相互作用。在此基础上,我们设计 PhyDPO,一种新颖的直接偏好优化流程,利用对比反馈与物理感知重加权引导生成更符合物理规律的结果。该方法具备模型无关性与可扩展性,可无缝集成于多种视频扩散模型与 Transformer 架构中。多基准测试结果表明,PhysCorr 在保持视觉保真度与语义一致性的前提下,显著提升物理真实性。本工作为实现可信、物理驱动的视频生成迈出关键一步。
原文摘要 · Abstract (English)
Recent advances in text-to-video generation have achieved impressive perceptual quality, yet generated content often violates fundamental principles of physical plausibility - manifesting as implausible object dynamics, incoherent interactions, and unrealistic motion patterns. Such failures hinder the deployment of video generation models in embodied AI, robotics, and simulation-intensive domains. To bridge this gap, we propose PhysCorr, a unified framework for modeling, evaluating, and optimizing physical consistency in video generation. Specifically, we introduce PhysicsRM, the first dual-dimensional reward model that quantifies both intra-object stability and inter-object interactions. On this foundation, we develop PhyDPO, a novel direct preference optimization pipeline that leverages contrastive feedback and physics-aware reweighting to guide generation toward physically coherent outputs. Our approach is model-agnostic and scalable, enabling seamless integration into a wide range of video diffusion and transformer-based backbones. Extensive experiments across multiple benchmarks demonstrate that PhysCorr achieves significant improvements in physical realism while preserving visual fidelity and semantic alignment. This work takes a critical step toward physically grounded and trustworthy video generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。