arXiv:2510.26817cs.SDeess.AS2025-10

用图神经网络生成南音音乐,解决口传技艺的数据难题

Oral Tradition-Encoded NanyinHGNN: Integrating Nanyin Music Preservation and Generation through a Pipa-Centric Dataset

  • 将南音旋律转为异构图结构,以琵琶为中心建模
  • 无需标注装饰音,仍能生成符合传统演奏习惯的完整乐段
  • 适合对非遗音乐数字化与创造性传承感兴趣的学者

我们提出 NanyinHGNN,一种用于生成南音器乐音乐的异构图神经网络模型。作为联合国教科文组织认定的人类非物质文化遗产,南音遵循以琵琶为核心的异步复调传统,核心旋律采用传统记谱法记录,而装饰音则通过口传心授传承,给保护与当代创新带来挑战。为此,我们构建了以琵琶为中心的 MIDI 数据集,开发了专用分词方法 NanyinTok,并通过图转换器将符号序列转化为图结构,确保关键音乐特征得以保留。模型的核心创新在于将装饰音生成重构为在异构图中生成装饰节点。首先,图神经网络生成优化后的装饰轮廓;随后,基于南音演奏实践规则引导的系统,将这些轮廓完善为完整的装饰音,且训练过程中无需显式装饰音标注。实验表明,该模型成功生成包含四件传统乐器的逼真异步合奏。结果验证了在模型架构中融入领域知识,可有效应对计算民族音乐学中的数据稀缺问题。

原文摘要 · Abstract (English)

We propose NanyinHGNN, a heterogeneous graph network model for generating Nanyin instrumental music. As a UNESCO-recognized intangible cultural heritage, Nanyin follows a heterophonic tradition centered around the pipa, where core melodies are notated in traditional notation while ornamentations are passed down orally, presenting challenges for both preservation and contemporary innovation. To address this, we construct a Pipa-Centric MIDI dataset, develop NanyinTok as a specialized tokenization method, and convert symbolic sequences into graph structures using a Graph Converter to ensure that key musical features are preserved. Our key innovation reformulates ornamentation generation as the creation of ornamentation nodes within a heterogeneous graph. First, a graph neural network generates melodic outlines optimized for ornamentations. Then, a rule-guided system informed by Nanyin performance practices refines these outlines into complete ornamentations without requiring explicit ornamentation annotations during training. Experimental results demonstrate that our model successfully generates authentic heterophonic ensembles featuring four traditional instruments. These findings validate that integrating domain-specific knowledge into model architecture can effectively mitigate data scarcity challenges in computational ethnomusicology.

南音音乐图神经网络非遗传承音乐生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。