用AI实时生成互动水墨画，回应人类世生态危机
Negative Shanshui: Real-time Interactive Ink Painting Synthesis
- 基于微调Stable Diffusion，结合视线追踪与帧插值实现实时交互
- 观众注视处动态生成水墨变化，支持虚拟现实沉浸体验
- 在艺术展中引发观众共情、矛盾与批判性思考
本文提出Negative Shanshui，一种实时交互式AI水墨画生成方法，重新诠释中国传统山水画（shanshui），以回应人类世的生态危机。该方法对微调后的Stable Diffusion模型进行优化，支持实时推理，并融合视线驱动的修复绘制与帧插值技术，使画面能根据观众注视位置动态演变，形成响应式动画效果，构建交互式虚拟现实体验。论文详细阐述了从系统架构、优化策略、视线交互机制到多模态部署的完整技术流程，涵盖其在艺术节中的应用。展览期间收集的观众反馈分析显示，参与者通过共情、矛盾心理和批判性反思等多种方式与作品互动。
原文摘要 · Abstract (English)
This paper presents Negative Shanshui, a real-time interactive AI synthesis approach that reinterprets classical Chinese landscape ink painting, i.e., shanshui, to engage with ecological crises in the Anthropocene. Negative Shanshui optimizes a fine-tuned Stable Diffusion model for real-time inferences and integrates it with gaze-driven inpainting, frame interpolation; it enables dynamic morphing animations in response to the viewer's gaze and presents as an interactive virtual reality (VR) experience. The paper describes the complete technical pipeline, covering the system framework, optimization strategies, gaze-based interaction, and multimodal deployment in an art festival. Further analysis of audience feedback collected during its public exhibition highlights how participants variously engaged with the work through empathy, ambivalence, and critical reflection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。