在部分已知结构下,用几何骨架+进度信号实现高效实时控制。
Geometric Distributional Control: Learning Progress with Partial Structural Knowledge

- 将控制分解为可执行骨架与进度权重数据,分离可行性与方向性。
- 仅需短片段和弱进度标签即可学习局部进展信号,训练快且低方差。
- 适合自动驾驶、机器人等部分知识场景,保留约束安全,易扩展。
实时控制常处于两个极端之间:当动力学、参数、目标和规划模型完全已知时,预测优化和基于模型的控制表现强大;而强化学习虽可放宽要求,但需从序列数据中推断长程价值信号,导致训练慢、方差高、难以扩展至大动作空间。这类中间状态常见于自动驾驶、仓储机器人、交通控制和配送无人机等系统:部分几何、物理、规则或约束已知,但任务进展方向仍不确定。本文提出几何分布控制(GDC),专为此类部分知识环境设计。它将控制分解为可行性与进展性:已知的几何、规则、约束和响应映射构成可执行骨架,而带进度权重的可行数据则学习骨架上的缺失方向信号。所学得分作为类似贝尔曼的局部价值梯度,选择推动进展的动作,无需全局贝尔曼递归、完整规划器或黑箱策略。该知识可轻量且部分,如简单动力学、安全过滤器、局部地图、约束投影器或底层响应映射,无需编码全动力学或长程目标。离线阶段,GDC从短时已知可行片段中拟合带进度倾斜的分布,使用弱符号进度证书;在线阶段,其得分通过骨架投影后用于滚动时域反馈。证明该得分会下降由数据诱导的软进展值,并在多层结构优化与SUMO路径进展驾驶任务中验证,相比仅依赖已知信息的求解器和学习基线,性能更优,同时保持骨架强制的可行性。
原文摘要 · Abstract (English)
Real-time control often sits between two limiting regimes. Predictive optimization and model-based control are powerful when dynamics, parameters, objectives, and online planning models are specified; reinforcement learning can relax this requirement, but must infer long-horizon value signals from sequential data and interaction, making training slow, high-variance, and hard to scale in large action spaces. This middle regime is common in systems including autonomous driving, warehouse robotics, traffic control, and delivery drones: partial geometry, physics, rules, or constraints are known, yet the local direction of task progress remains uncertain. Geometric Distributional Control (GDC) is designed for this partial-knowledge setting. It factorizes control into feasibility and progress: known geometry, rules, constraints, and response maps define an executable scaffold, while progress-weighted feasible data learns the missing directional signal on that scaffold. The learned score acts as a Bellman-like local value-gradient, selecting actions that make progress without requiring global Bellman recursion, a fully specified planner, or a black-box policy that absorbs both feasibility and preference. This knowledge can be lightweight and partial, such as simple dynamics, safety filters, local maps, constraint projectors, or lower-level response maps; it need not encode full dynamics or a long-horizon objective. Offline, GDC fits a progress-tilted distribution from short known-feasible snippets with weak signed progress certificates. Online, its score is projected through the scaffold and applied in receding-horizon feedback. We prove that this score descends a data-induced soft progress value and validate GDC on structured multilevel optimization and SUMO route-progress driving, where it improves over known-only solvers and learning baselines while preserving scaffold-enforced feasibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。