构建1万条标注的音效数据集，助力影视后期声音自动化
FoleySet: A Multi-Level Human-Annotated Foley Sound Dataset
- 构建1万条人类标注的音效音频，含两级分类体系
- 提供标准化开源数据集，支持音效分类与生成任务
- 适合音视频生成、影视后期研究者使用
在音视频后期制作中，福莱（Foley）指与人物动作同步的声音效果，如脚步声、布料摩擦声和道具操作声，通常由专业福莱艺术家使用实物道具录制。这一高成本流程推动了数据驱动的福莱研究，包括分类、检索和生成等任务；然而，高质量标注的福莱数据集仍十分稀缺。为填补此空白，我们提出FoleySet，一个包含10,000条音频片段的公开福莱数据集，采用两级福莱分类体系进行人工标注。该数据集提供标准化、基于创意共享许可的资源，可用于数据驱动的福莱分类、检索与生成研究。
原文摘要 · Abstract (English)
In audiovisual post-production, Foley refers to synchronous sound effects associated with human actions, such as footsteps, cloth rustle, and prop handling, that are recreated to match the on-screen movements and interactions of characters. These sounds are often recorded by professional Foley artists using physical props. This resource-intensive workflow has motivated data-driven research on Foley, including tasks such as classification, retrieval, and generation; however, high-quality annotated Foley datasets for training remain scarce. To address this gap, we present FoleySet, a publicly available Foley dataset of 10,000 audio clips annotated with a two-level Foley taxonomy. This dataset provides a standardized, Creative Commons-licensed resource for data-driven Foley classification, retrieval, and generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。