arXiv:2605.26720cs.AI2026-05

解析大模型生成CUDA内核时反馈如何影响决策

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

论文配图:Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation
图 1 · 摘自论文原文
  • 通过冻结生成轨迹与选择性注入反馈,实现决策归因分析
  • 发现反馈对齐时显式规划才有效,多反馈协同更关键
  • 强模型的高层计划可部分迁移到弱模型,适用于代码生成研究

大语言模型在自演化生成CUDA内核方面表现优异,依赖于多轮迭代中反馈驱动的规划。然而,规划决策如何响应并整合异构反馈信号仍不清晰。传统端到端消融实验无法准确解答此问题,因迭代规划会放大早期扰动,并混淆反馈效应与轨迹依赖性漂移。本文提出 exttt{CUDAnalyst},一个统一分析层,通过轨迹冻结与选择性反馈注入,实现生成层级的规划决策归因。该方法支持稳定评估与原则性的反馈效应联合分析。结果表明:显式规划仅在反馈对齐时有益;有效规划源于结构化多反馈交互;更强推理模型的高层计划可部分迁移至弱模型。这些规律在不同骨干网络、典型工作负载和诱导范式下均成立,说明所识别的反馈-规划结构在可控维度上具有鲁棒性。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown strong empirical gains as self-evolving agents for CUDA kernel generation, driven by feedback-conditioned planning across generations. However, how planning decisions attribute and combine heterogeneous feedback signals remains opaque. Standard end-to-end ablations fail to resolve this question, as iterative planning amplifies early perturbations and conflates feedback effects with trajectory-dependent drift. We introduce \texttt{CUDAnalyst}, a unified analysis layer for controlled, generation-level attribution of planning decisions to feedback components via trajectory freezing and selective feedback injection. \texttt{CUDAnalyst} enables stable generation-level evaluation and principled coalitional-style attribution of feedback effects and interactions. Our results show that explicit planning is beneficial only when feedback is aligned, that effective planning emerges from structured multi-feedback interactions, and that high-level plans from stronger reasoning models can partially transfer to weaker ones. These trends hold across reference backbones, representative workloads, and reference induction regimes, indicating that the identified feedback-to-plan structure is robust within the controlled axes studied.

代码生成大模型反馈机制归因分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。