用k均值优化数据推断,发现聚类数越多误差越小。
Inference with K-means
- 采用在线平衡k均值法预测多集群数据的末尾成分。
- 聚类数增加可降低误差,但样本量提升无明显改善。
- 适合关注聚类推断与密度估计融合的研究者。
本论文旨在探索基于k均值算法的新推理方法。k均值是一种迭代聚类算法,通过随机初始化k个中心点,将数据点分配至最近中心点,并根据所属点均值更新中心点,直至收敛,形成k个簇。本研究聚焦于从多集群分布数据中预测数据点的最后分量,采用在线平衡k均值方法进行实验分析。结果表明:增加聚类数可显著降低推理误差,而增加已分配数据点数量对误差影响有限;训练过程中的损失下降并未带来整体推理误差的改善,说明推理误差在学习过程中保持稳定。建议发展专用推理技术以更准确估计多集群数据,并探索在大规模数据集上表现更优的方法。本研究提升了k均值算法的推理精度与可靠性,弥合了聚类与非参数密度估计之间的鸿沟。
原文摘要 · Abstract (English)
This thesis aims to invent new approaches for making inferences with the k-means algorithm. k-means is an iterative clustering algorithm that randomly assigns k centroids, then assigns data points to the nearest centroid, and updates centroids based on the mean of assigned points. This process continues until convergence, forming k clusters where each point belongs to the closest centroid. This research investigates the prediction of the last component of data points obtained from a distribution of clustered data using the online balanced k-means approach. Through extensive experimentation and analysis, key findings have emerged. It is observed that a larger number of clusters or partitions tends to yield lower errors while increasing the number of assigned data points does not significantly improve inference errors. Reducing losses in the learning process does not significantly impact overall inference errors. Indicating that as learning is going on inference errors remain unchanged. Recommendations include the need for specialized inference techniques to estimate better data points derived from multi-clustered data and exploring methods that yield improved results with larger assigned datasets. By addressing these recommendations, this research advances the accuracy and reliability of inferences made with the k-means algorithm, bridging the gap between clustering and non-parametric density estimation and inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。