arXiv:2603.05511cs.HCcs.AI2026-03

让机器人成为有互动能力的艺术共创伙伴。

An Embodied Companion for Visual Storytelling

  • 用大语言模型让绘图机器人实时听懂并回应人类指令
  • 专家评估确认作品具备专业展览水准和独特审美
  • 适合艺术创作、人机协作研究者参考

随着人工智能从工具角色转向代理式协作,其在艺术领域的应用可超越机器自主性的探索,迈向人机协同创作。以往的机器人系统常将艺术家意图与最终成果分离,而本文提出 Companion:一个融合绘图机器人与大语言模型(LLMs)的艺术装置,通过上下文学习和实时工具使用,实现语音与手绘的双向交互。该系统使机器人从被动执行者转变为富有创意的协作伙伴,共同探索未知的视觉叙事领域。为验证这一协作转变,我们采用七位艺术界专家组成的共识评估技术(CAT)进行评价。结果表明,系统生成的作品具有独特的美学特征和专业展览价值,证明了人工智能作为高水平艺术合作者的巨大潜力。

原文摘要 · Abstract (English)

As artificial intelligence shifts from pure tool for delegation toward agentic collaboration, its use in the arts can shift beyond the exploration of machine autonomy toward synergistic co-creation. While our earlier robotic works utilized automation to distance the artist's intent from the final mark, we present Companion: an artistic apparatus that integrates a drawing robot with Large Language Models (LLMs) to re-center human-machine presence. By leveraging in-context learning and real-time tool use, the system engages in bidirectional interaction via speech and sketching. This approach transforms the robot from a passive executor into a playful co-creative partner capable of driving shared visual storytelling into unexpected aesthetic territories. To validate this collaborative shift, we employed the Consensual Assessment Technique (CAT) with a panel of seven art-world experts. Results confirm that the system produces works with a distinct aesthetic identity and professional exhibition merit, demonstrating the potential of AI as a highly capable artistic collaborator.

人机协作艺术生成大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。