arXiv:2509.00258stat.MLcs.LG2025-09

通过修剪极端点分析一维数据聚类稳定性,提升小样本检测效果。

Assessing One-Dimensional Cluster Stability by Extreme-Point Trimming

  • 用直径收缩比衡量极端点剔除后的范围缩小程度,评估数据尾部行为。
  • 在小样本或噪声环境下,分类准确率优于经典似然比检验。
  • 可直接用于DBSCAN等聚类流程,无需密度估计或调参,适合实际应用。

我们提出一种概率方法,通过追踪极端点被逐步剔除时数据跨度的收缩情况,评估一维独立同分布样本的尾部行为与几何稳定性。核心是直径收缩比,量化范围相对缩减程度。推导了均匀和高斯假设下期望收缩的解析表达式,包含有限样本修正,并证明即使在中等剔除数量下,理论曲线仍具区分性。构建了一个简单决策规则,根据样本最接近的理论收缩轨迹进行归类。该检验在小样本或噪声环境下分类准确率高于经典似然比检验,同时保持大样本一致性。进一步将该准则集成至聚类流程(如DBSCAN),实现无需密度估计或参数调优的一维聚类有效性验证。本工作为稳健分布推断与聚类稳定性分析提供了理论洞见与实用工具。

原文摘要 · Abstract (English)

We develop a probabilistic method for assessing the tail behavior and geometric stability of one-dimensional n i.i.d. samples by tracking how their span contracts when the most extreme points are trimmed. Central to our approach is the diameter-shrinkage ratio, that quantifies the relative reduction in data range as extreme points are successively removed. We derive analytical expressions, including finite-sample corrections, for the expected shrinkage under both the uniform and Gaussian hypotheses, and establish that these curves remain distinct even for moderate number of removal. We construct an elementary decision rule that assigns a sample to whichever theoretical shrinkage profile it most closely follows. This test achieves higher classification accuracy than the classical likelihood-ratio test in small-sample or noisy regimes, while preserving asymptotic consistency for large n. We further integrate our criterion into a clustering pipeline (e.g. DBSCAN), demonstrating its ability to validate one-dimensional clusters without any density estimation or parameter tuning. This work thus provides both theoretical insight and practical tools for robust distributional inference and cluster stability analysis.

聚类稳定性统计推断小样本数据修剪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。