用强化学习让地面机器人自动完成电影推镜镜头。
Reinforcement Learning of Dolly-In Filming Using a Ground-Based Robot
- 用强化学习联合控制机器人运动与摄像机，实现精准推镜。
- 仿真和真实测试中均优于传统PID控制器性能。
- 适合影视自动化、机器人拍摄方向的研究者参考。
自由移动的滑轨车能提升电影拍摄的动态感，但自动化摄像控制仍面临挑战。本文通过强化学习（RL）实现基于地面拍摄机器人的自动推镜动作，克服了传统控制难题。通过对比联合控制与独立控制策略，验证了联合控制在精确完成电影任务中的有效性。所提出的鲁棒强化学习流程在仿真中表现优于传统比例-微分（PD）控制器，并在改装后的ROSBot 2.0平台（配备相机云台）上完成真实世界测试，证明了该方法的实用性，为复杂拍摄场景下的进一步研究奠定基础，推动技术与电影创作的融合。
原文摘要 · Abstract (English)
Free-roaming dollies enhance filmmaking with dynamic movement, but challenges in automated camera control remain unresolved. Our study advances this field by applying Reinforcement Learning (RL) to automate dolly-in shots using free-roaming ground-based filming robots, overcoming traditional control hurdles. We demonstrate the effectiveness of combined control for precise film tasks by comparing it to independent control strategies. Our robust RL pipeline surpasses traditional Proportional-Derivative controller performance in simulation and proves its efficacy in real-world tests on a modified ROSBot 2.0 platform equipped with a camera turret. This validates our approach's practicality and sets the stage for further research in complex filming scenarios, contributing significantly to the fusion of technology with cinematic creativity. This work presents a leap forward in the field and opens new avenues for research and development, effectively bridging the gap between technological advancement and creative filmmaking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。