arXiv:2501.15273cs.LGcs.HC2025-01被引 2

通过智能搜索空白区域,发现高维数据中潜在的优质新配置。

Into the Void: Mapping the Unseen Gaps in High Dimensional Data

  • 用新算法找数据空隙中心,定位潜在价值点。
  • 相比随机方法,生成的新配置性能显著更优。
  • 适合需要探索未知空间的科研与工程人员。

我们提出一个综合流程,结合名为GapMiner的可视化分析系统,用于探索和利用高维数据中未开发的空白区域。该方法从初始数据集出发,采用新型空域搜索算法(ESA)识别未探索空隙的中心点,这些点被视为蕴含潜在高价值新配置的资源池。初期过程由用户通过GapMiner交互引导,系统以联动平行坐标图可视化空域配置(ESC),使领域专家可探索并调整这些配置,进而增强数据并迭代训练深度神经网络(DNN)。随着DNN训练完成,其逐步接管高潜力ESC的识别任务,减少人工参与。最终,当DNN达到足够精度后,能自主引导最优配置探索,结合梯度上升与改进的空域搜索进行性能预测与配置优化。领域用户全程参与系统开发。案例研究验证了本方法在参数优化、对抗学习与强化学习等任务中,持续产出显著优于传统随机化方法的新配置。

原文摘要 · Abstract (English)

We present a comprehensive pipeline, augmented by a visual analytics system named ``GapMiner'', that is aimed at exploring and exploiting untapped opportunities within the empty areas of high-dimensional datasets. Our approach begins with an initial dataset and then uses a novel Empty Space Search Algorithm (ESA) to identify the center points of these uncharted voids, which are regarded as reservoirs containing potentially valuable novel configurations. Initially, this process is guided by user interactions facilitated by GapMiner. GapMiner visualizes the Empty Space Configurations (ESC) identified by the search within the context of the data, enabling domain experts to explore and adjust ESCs using a linked parallel-coordinate display. These interactions enhance the dataset and contribute to the iterative training of a connected deep neural network (DNN). As the DNN trains, it gradually assumes the task of identifying high-potential ESCs, diminishing the need for direct user involvement. Ultimately, once the DNN achieves adequate accuracy, it autonomously guides the exploration of optimal configurations by predicting performance and refining configurations, using a combination of gradient ascent and improved empty-space searches. Domain users were actively engaged throughout the development of our system. Our findings demonstrate that our methodology consistently produces substantially superior novel configurations compared to conventional randomization-based methods. We illustrate the effectiveness of our method through several case studies addressing various objectives, including parameter optimization, adversarial learning, and reinforcement learning.

高维数据空域搜索配置优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。