用AI助手自动搭建ComfyUI艺术创作流程,新手也能快速上手。
ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development
- 采用多智能体架构,分角色协作完成节点推荐与流程构建。
- 实测可准确推荐节点,显著缩短工作流开发时间。
- 适合初学者降低门槛,也提升熟练用户的工作效率。
我们提出 ComfyUI-Copilot,一个基于大语言模型的插件,旨在提升开源AI艺术创作平台 ComfyUI 的易用性与效率。尽管 ComfyUI 具有灵活性和友好的界面,但对新手仍存在文档不足、模型配置错误及工作流设计复杂等挑战。ComfyUI-Copilot 通过提供智能节点与模型推荐,并实现一键自动化工作流构建来解决这些问题。系统采用分层多智能体框架,包含中央助理代理负责任务分配,以及针对不同用途的专用工作代理,并依托自建的 ComfyUI 知识库,加速调试与部署。我们通过离线量化评估与在线用户反馈验证其有效性,结果表明该系统能准确推荐节点并加快工作流开发。此外,案例展示其能有效降低新手入门门槛,同时提升资深用户的流程效率。安装包与演示视频已发布于 https://github.com/AIDC-AI/ComfyUI-Copilot。
原文摘要 · Abstract (English)
We introduce ComfyUI-Copilot, a large language model-powered plugin designed to enhance the usability and efficiency of ComfyUI, an open-source platform for AI-driven art creation. Despite its flexibility and user-friendly interface, ComfyUI can present challenges to newcomers, including limited documentation, model misconfigurations, and the complexity of workflow design. ComfyUI-Copilot addresses these challenges by offering intelligent node and model recommendations, along with automated one-click workflow construction. At its core, the system employs a hierarchical multi-agent framework comprising a central assistant agent for task delegation and specialized worker agents for different usages, supported by our curated ComfyUI knowledge bases to streamline debugging and deployment. We validate the effectiveness of ComfyUI-Copilot through both offline quantitative evaluations and online user feedback, showing that it accurately recommends nodes and accelerates workflow development. Additionally, use cases illustrate that ComfyUI-Copilot lowers entry barriers for beginners and enhances workflow efficiency for experienced users. The ComfyUI-Copilot installation package and a demo video are available at https://github.com/AIDC-AI/ComfyUI-Copilot.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。