让创作者主导歌词自适应生成,精准控制内容随场景变化。
MultiVerse: A Creator-Centered Approach to Steering Context-Adaptive Lyrics

- 创作者可直接设定歌词如何随情境变化,明确控制规则。
- 10位词作者实验表明,更偏好显式定义适应逻辑而非模糊提示。
- 适合音乐人、创意开发者探索互动式创作与新型作者关系。
生成式AI有望通过动态适配媒介内容至其消费场景,实现新型情境化创作表达。例如,系统可依据听众及其当前活动调整歌曲歌词。然而,现有媒体自适应系统多聚焦观众体验,常忽视艺术家的意图、风格与偏好。本文提出一种以创作者为中心的自适应媒体创作新方法,并构建了名为MultiVerse的系统来实现歌词的可控自适应。该方法允许创作者基于自身意图、歌词结构与受众情境显式编写控制规则,并通过基于规则的验证确保执行。我们对10位词作者开展对照研究,比较MultiVerse与基于提示的创作流程。结果表明,创作者更倾向于通过显式指定相关情境和适应约束来控制歌词演变,尽管承认灵活性与迭代速度存在权衡。访谈进一步揭示,创作者视自适应媒体为建立新形式观众连接的工具,催生独特创作过程,支持新的作曲策略,并重塑作者身份认知。
原文摘要 · Abstract (English)
Generative AI may enable new forms of context-aware creative expression by dynamically tailoring media content to its consumption context. For instance, AI systems could adapt song lyrics to the listener and their current activity. However, existing media adaptation systems primarily optimize for audience experience, often neglecting artists' intent, style, and preference. We address this challenge by introducing a novel creator-centered approach to adaptive media authoring and present MultiVerse, a system that instantiates this approach for steering adaptive lyrics. Our approach allows creators to explicitly author controls based on their intent, lyric structure, and audience context, and uses rule-based validations to ensure controls are followed. We conducted a study with 10 songwriters, comparing MultiVerse with a prompting-based workflow for composing adaptive lyrics. The comparison revealed that creators preferred to author how lyrics adapt by explicitly specifying relevant context and adaptation constraints, while recognizing trade-offs in flexibility and iteration speed. Interviews further revealed that creators viewed adaptive media as enabling new forms of audience connection, introducing a distinct creative process, favoring new compositional strategies, and reshaping notions of authorship.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。