用现代技术重制经典手势音乐控制器，实现低延迟沉浸式交互。
NeoLightning: A Modern Reimagination of Gesture-Based Sound Design
- 基于MediaPipe实现精准实时手势识别
- 结合Max/MSP与Processing构建低延迟多媒体系统
- 适合音乐创作与互动声效设计的表演者使用
本文提出NeoLightning，是对20世纪90年代Don Buchla发明的Buchla Lightning的现代重构。原版设备虽具开创性，但如今已无官方支持，用户只能通过间接方式体验。为解决此问题，NeoLightning采用MediaPipe进行深度学习驱动的手势识别，并借助Max/MSP和Processing实现实时多媒体处理。新系统具备高精度、低延迟的手势识别能力，支持沉浸式3D交互。通过融合原始设备的创意精神与现代技术进步，NeoLightning重新定义了基于手势的音乐交互方式，拓展了表达性表演与交互式声效设计的可能性。
原文摘要 · Abstract (English)
This paper introduces NeoLightning, a modern reinterpretation of the Buchla Lightning. NeoLightning preserves the innovative spirit of Don Buchla's "Buchla Lightning" (introduced in the 1990s) while making its gesture-based interaction accessible to contemporary users. While the original Buchla Lightning and many other historical instruments were groundbreaking in their time, they are now largely unsupported, limiting user interaction to indirect experiences. To address this, NeoLightning leverages MediaPipe for deep learning-based gesture recognition and employs Max/MSP and Processing for real-time multimedia processing. The redesigned system offers precise, low-latency gesture recognition and immersive 3D interaction. By merging the creative spirit of the original Lightning with modern advancements, NeoLightning redefines gesture-based musical interaction, expanding possibilities for expressive performance and interactive sound design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。