arXiv:2502.11586cs.CV2025-02

用俳句生成可漫游3D场景,让诗歌变空间。

Syllables to Scenes: Literary-Guided Free-Viewpoint 3D Scene Synthesis from Japanese Haiku

  • 用文学分析法解析俳句的意象与情感
  • 分阶段扩散生成,构建连贯3D场景
  • 适合数字人文与沉浸式文化体验研究

在元宇宙时代,将抽象文学概念转化为可交互的3D环境是保持语义与情感一致性的核心挑战。本文提出HaikuVerse框架,将日本俳句这一极简却富含情感与意象的文学形式作为切入点,通过融合传统诗歌分析与生成技术,实现从文字到空间的转化。该框架包含两项关键创新:(1) 基于文学批评理论的分层解析(H-LCTGP),系统分解俳句的显性意象与隐性情绪;(2) 逐步维度合成(PDS)多阶段流程,通过序列扩散、几何优化与实时增强,将诗意元素转化为连贯3D场景。大量实验表明,该方法在文学契合度与视觉质量上显著优于现有文本到3D模型方法,为沉浸式数字空间中的文化遗产保护提供了新范式。

原文摘要 · Abstract (English)

In the era of the metaverse, where immersive technologies redefine human experiences, translating abstract literary concepts into navigable 3D environments presents a fundamental challenge in preserving semantic and emotional fidelity. This research introduces HaikuVerse, a novel framework for transforming poetic abstraction into spatial representation, with Japanese Haiku serving as an ideal test case due to its sophisticated encapsulation of profound emotions and imagery within minimal text. While existing text-to-3D methods struggle with nuanced interpretations, we present a literary-guided approach that synergizes traditional poetry analysis with advanced generative technologies. Our framework centers on two key innovations: (1) Hierarchical Literary-Criticism Theory Grounded Parsing (H-LCTGP), which captures both explicit imagery and implicit emotional resonance through structured semantic decomposition, and (2) Progressive Dimensional Synthesis (PDS), a multi-stage pipeline that systematically transforms poetic elements into coherent 3D scenes through sequential diffusion processes, geometric optimization, and real-time enhancement. Extensive experiments demonstrate that HaikuVerse significantly outperforms conventional text-to-3D approaches in both literary fidelity and visual quality, establishing a new paradigm for preserving cultural heritage in immersive digital spaces. Project website at: https://syllables-to-scenes.github.io/

文本生成3D俳句文学生成元宇宙

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。