arXiv:2503.16629cs.LGcs.CV2025-03中稿 · RLDM 2025

用强化学习分步重建2D线框图,提升准确率与训练稳定性。

Utilizing Reinforcement Learning for Bottom-Up part-wise Reconstruction of 2D Wire-Frame Projections

  • 强化学习代理逐段生成线条,基于四色图像状态决策。
  • 结合奖励函数与课程学习,使重建成功率显著提升。
  • 适合研究2D形状重建或强化学习应用的开发者参考。

本文研究从任意3D线框模型投影到图像平面后的所有边的重建问题。提出一种自底向上的分段式方法,由强化学习(RL)智能体完成分割与重建。环境状态以四色图像表示:背景、目标边、重建线、两者重叠区域。每步中,智能体可在四维动作空间内变换重建线,或通过特定终止动作结束回合。为评估奖励函数设计的影响,测试了回合奖励、增量奖励及混合策略。实验表明,混合奖励方案训练效果最优。为进一步提升效率与稳定性,引入课程学习策略:第一种为动作课程,初期仅允许执行五种动作中的三种,逐步扩展至全动作空间;第二种为任务课程,先解决简化版问题,再过渡到完整复杂任务。后者表现优异,智能体不仅成功完成任务迁移,性能也显著提升。本研究验证了迭代式强化学习在二维线框重建中的潜力,结合优化奖励机制与课程学习,显著提高训练成功率。该方法为类似任务提供有效框架,是未来研究的有前景方向。

原文摘要 · Abstract (English)

This work concerns itself with the task of reconstructing all edges of an arbitrary 3D wire-frame model projected to an image plane. We explore a bottom-up part-wise procedure undertaken by an RL agent to segment and reconstruct these 2D multipart objects. The environment's state is represented as a four-colour image, where different colours correspond to background, a target edge, a reconstruction line, and the overlap of both. At each step, the agent can transform the reconstruction line within a four-dimensional action space or terminate the episode using a specific termination action. To investigate the impact of reward function formulations, we tested episodic and incremental rewards, as well as combined approaches. Empirical results demonstrated that the latter yielded the most effective training performance. To further enhance efficiency and stability, we introduce curriculum learning strategies. First, an action-based curriculum was implemented, where the agent was initially restricted to a reduced action space, being able to only perform three of the five possible actions, before progressing to the full action space. Second, we test a task-based curriculum, where the agent first solves a simplified version of the problem before being presented with the full, more complex task. This second approach produced promising results, as the agent not only successfully transitioned from learning the simplified task to mastering the full task, but in doing so gained significant performance. This study demonstrates the potential of an iterative RL wire-frame reconstruction in two dimensions. By combining optimized reward function formulations with curriculum learning strategies, we achieved significant improvements in training success. The proposed methodology provides an effective framework for solving similar tasks and represents a promising direction for future research in the field.

强化学习线框重建课程学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。