用动态适应的适应度变换替代固定规则,让多样性搜索更高效。
Dominated Novelty Search: Rethinking Local Competition in Quality-Diversity
- 通过适应度变换实现局部竞争,无需预设网格或参数
- 在标准测试中表现优于现有方法,尤其在高维无监督场景
- 适合需要自动适应复杂环境的智能体探索任务
质量-多样性算法是一类通过受自然演化启发的局部竞争机制,生成多样且高性能解的进化算法。尽管已有研究聚焦于改进算法特定方面,但对局部竞争机制本身的重新思考却很少。多数方法依赖固定网格或无结构存档等显式收集机制,带来预设边界和难调参数的人为限制。本文揭示,质量-多样性可重构为遗传算法,其中局部竞争通过适应度变换实现,而非显式收集。基于此,提出「被支配新颖性搜索」(Dominated Novelty Search),利用动态适应度变换实现局部竞争,无需预设边界或调参。实验表明,该方法在标准质量-多样性基准上显著优于现有方法,并在高维与无监督等挑战场景中保持优势。
原文摘要 · Abstract (English)
Quality-Diversity is a family of evolutionary algorithms that generate diverse, high-performing solutions through local competition principles inspired by natural evolution. While research has focused on improving specific aspects of Quality-Diversity algorithms, surprisingly little attention has been paid to investigating alternative formulations of local competition itself -- the core mechanism distinguishing Quality-Diversity from traditional evolutionary algorithms. Most approaches implement local competition through explicit collection mechanisms like fixed grids or unstructured archives, imposing artificial constraints that require predefined bounds or hard-to-tune parameters. We show that Quality-Diversity methods can be reformulated as Genetic Algorithms where local competition occurs through fitness transformations rather than explicit collection mechanisms. Building on this insight, we introduce Dominated Novelty Search, a Quality-Diversity algorithm that implements local competition through dynamic fitness transformations, eliminating the need for predefined bounds or parameters. Our experiments show that Dominated Novelty Search significantly outperforms existing approaches across standard Quality-Diversity benchmarks, while maintaining its advantage in challenging scenarios like high-dimensional and unsupervised spaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。