用混合提问方式优化音频滤波器,提升用户满意度
Sample-Constrained Black Box Optimization for Audio Personalization
- 结合评分与元素反馈,用稀疏高斯过程优化滤波器
- 在有限查询下,混合方法比单一方式更高效准确
- 适合需要个性化体验的音频应用,如音乐推荐
本文研究如何通过黑箱优化实现音频个性化以最大化用户体验。目标是找到一个滤波器 $h^*$,作用于任意音乐或语音都能使用户满意度最高。由于用户满意度函数未知,传统方法通过播放不同滤波后的音频样本并获取评分 $f(h_i)$,构建代理函数进行优化。本文提出新思路:在预算 $B$ 次查询内,允许用户对滤波器的每个分量 $h^*[j]$ 进行直接反馈。借鉴烹饪类比,用户可评价整体菜肴或单项食材。基于稀疏高斯过程回归(Sparse GPR),设计混合查询策略,实验证明其优于单一查询方式。通过仿真和真实用户实验(志愿者对音乐/语音反馈),系统能有效提升满意度,展示了混合反馈在黑箱优化中的潜力,可拓展至其他个性化场景。
原文摘要 · Abstract (English)
We consider the problem of personalizing audio to maximize user experience. Briefly, we aim to find a filter $h^*$, which applied to any music or speech, will maximize the user's satisfaction. This is a black-box optimization problem since the user's satisfaction function is unknown. Substantive work has been done on this topic where the key idea is to play audio samples to the user, each shaped by a different filter $h_i$, and query the user for their satisfaction scores $f(h_i)$. A family of ``surrogate" functions is then designed to fit these scores and the optimization method gradually refines these functions to arrive at the filter $\hat{h}^*$ that maximizes satisfaction. In certain applications, we observe that a second type of querying is possible where users can tell us the individual elements $h^*[j]$ of the optimal filter $h^*$. Consider an analogy from cooking where the goal is to cook a recipe that maximizes user satisfaction. A user can be asked to score various cooked recipes (e.g., tofu fried rice) or to score individual ingredients (say, salt, sugar, rice, chicken, etc.). Given a budget of $B$ queries, where a query can be of either type, our goal is to find the recipe that will maximize this user's satisfaction. Our proposal builds on Sparse Gaussian Process Regression (GPR) and shows how a hybrid approach can outperform any one type of querying. Our results are validated through simulations and real world experiments, where volunteers gave feedback on music/speech audio and were able to achieve high satisfaction levels. We believe this idea of hybrid querying opens new problems in black-box optimization and solutions can benefit other applications beyond audio personalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。