用历史资料还原艺术创作过程,让AI理解画作背后的思考与操作。
ArtMine: Discovering and Formalizing Artistic Processes

- 从档案、草图等碎片化资料中提取证据,构建结构化创作记录。
- 通过自反思优化生成结果,使还原的创作流程与原作一致。
- 适合艺术史研究、创意教育和人机协同创作场景。
理解艺术作品的创作过程需分析迭代决策、材料操作及背景影响。尽管当前生成式AI能高保真合成作品,但多聚焦于成品分布,而非创作过程本身。现实中,艺术工作流仅通过档案记录、草图、通信等零散资料部分留存,难以计算形式化。本文提出ArtMine框架,从异构历史证据中发现并形式化艺术创作过程。该方法将多元艺术证据整合为结构化库,由皮尔斯式溯因代理推断有依据的创作步骤,并转化为组合图与渲染提示,再通过自反思优化生成与参考作品间的差异。我们基于跨艺术家与艺术流派的开放域史料进行初步概念验证,表明碎片化文献可支持连贯、可解释、可审计的艺术创作流程表征。本研究推动以过程为中心的人机协同共创系统发展,服务于艺术阐释、创意教育、反思协作及文化生产计算研究。
原文摘要 · Abstract (English)
Understanding how artworks are created requires reasoning about the iterative decisions, material operations, and contextual influences that shape artistic production. While recent generative AI systems can synthesize artworks with high fidelity, they primarily model distributions over finished artifacts rather than the creative processes underlying their creation. In practice, artistic workflows are only partially documented through fragmented sources such as archival records, preparatory studies, correspondence, etc., making process-level understanding difficult to formalize computationally. In this work, we introduce ArtMine, a framework for discovering and formalizing artistic processes from heterogeneous historical evidence. Our approach synthesizes heterogeneous artwork evidence into a structured repository, from which a Peircean abductive agent infers evidence-grounded production steps. These steps are converted into a compositional graph and rendering prompt, then optimized through self-reflection over deviations between the generated and reference artworks. We provide a preliminary proof-of-concept case study using open-domain historical sources across multiple artists and artistic movements, demonstrating that fragmented documentary evidence can support coherent, interpretable, and auditable representations of artistic workflows. By modeling creative processes rather than only final artifacts, our work moves toward process-centred human-AI co-creativity systems that can support artistic interpretation, creative education, reflective collaboration, and computational studies of cultural production.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。