arXiv:2510.10173cs.HCcs.CY2025-10

用颜色实时可视化音乐调性,结合灯光与界面反馈。

Chord Colourizer: A Near Real-Time System for Visualizing Musical Key

  • 基于恒定Q变换提取和弦特征,通过阈值过滤识别根音、三音、五音。
  • 检测置信度高时才显示,确保视觉输出可靠性,延迟低接近实时。
  • 适合音乐教育与艺术表演,支持物理灯光与屏幕双模态呈现。

本文提出Chord Colourizer,一个近实时的音乐调性可视化系统。该系统通过常量Q变换(CQT)提取音频信号的色度特征,经阈值过滤与调性增强后,识别和弦的根音、三音、五音,并计算置信度,仅对中等至强置信度的和弦进行可视化。系统采用牛顿原始色轮为音高分配色彩,保留音高与色调的历史关联,设计了动态更新的颜色键盘界面,并集成由Arduino控制的LED灯阵列,搭配3D打印星形扩散器实现空间光效反馈。多模态输出提升用户对和声内容的交互体验,适用于音乐教育与艺术表演场景。局限包括轻微延迟及无法识别扩展和弦,未来将优化滤波算法、自适应阈值,并支持七和弦、增和弦等复杂和声;同时探索其他可视化风格,对比不同音频分析库以提升速度与精度,并开展正式用户测试,评估色彩-音高映射的感知效果、可用性及跨文化理解差异。

原文摘要 · Abstract (English)

This paper introduces Chord Colourizer, a near real-time system that detects the musical key of an audio signal and visually represents it through a novel graphical user interface (GUI). The system assigns colours to musical notes based on Isaac Newton's original colour wheel, preserving historical links between pitch and hue, and also integrates an Arduino-controlled LED display using 3D-printed star-shaped diffusers to offer a physical ambient media representation. The method employs Constant-Q Transform (CQT) chroma features for chord estimation and visualization, followed by threshold-based filtering and tonal enhancement to isolate the root, third, and fifth. A confidence score is computed for each detection to ensure reliability, and only chords with moderate to very strong certainty are visualized. The graphical interface dynamically updates a colour-coded keyboard layout, while the LED display provides the same colour information via spatial feedback. This multi-modal system enhances user interaction with harmonic content, offering innovative possibilities for education and artistic performance. Limitations include slight latency and the inability to detect extended chords, which future development will aim to address through refined filtering, adaptive thresholds, and support for more complex harmonies such as sevenths and augmented chords. Future work will also explore integration with alternative visualization styles, and the comparison of audio analysis libraries to improve detection speed and precision. Plans also include formal user testing to evaluate perception, usability, and cross-cultural interpretations of colour-pitch mappings.

音乐可视化实时系统人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。