An Enhanced Stream Clustering Algorithm Based on Affinity Propagation

doi:10.7652/xjtuxb201703018

您当前的位置：

首页 >

文章列表页 >

An Enhanced Stream Clustering Algorithm Based on Affinity Propagation

更新时间：2025-07-09

- An Enhanced Stream Clustering Algorithm Based on Affinity Propagation
- Vol. 51, Issue 3, Pages: 105-110(2017)
- 作者机构：
  
  西安交通大学软件学院,西安,710049
- 作者简介：
- 基金信息：
- DOI：10.7652/xjtuxb201703018
  CLC： TP181
- Online First：10 March 2017，
  
  Published：2017
- 稿件说明：
移动端阅览
An Enhanced Stream Clustering Algorithm Based on Affinity Propagation[J]. 2017, 51(3): 105-110.
DOI：

An Enhanced Stream Clustering Algorithm Based on Affinity Propagation[J]. 2017, 51(3): 105-110. DOI： 10.7652/xjtuxb201703018.

摘要

针对目前流聚类算法无法有效处理数据流离群点的检测和处理

以及增量式数据流聚类效率较低等问题

提出了一种基于密度度量的异常检测、删除的增强型仿射传播流聚类算法。在仿射传播流聚类算法的基础上

所提算法通过引进异常检测和删除机制改善了异常点对聚类精度、聚类效率的影响。利用仿射传播聚类实现在线数据流的聚类过程

同时检测数据漂移现象

即数据流分布特征随时间发生变化

并采用基于密度度量的局部异常因子检测技术(LOF)对储备池数据进行异常检测和删除处理

通过对当前类簇和处理过的储备池数据重聚类来重建动态数据流模型。在真实网络数据(KDD'99)上进行了实验

结果表明

所提算法不仅减少了重聚类构建动态模型的次数

改善了聚类效率

而且在同时考虑聚类精度、纯度和熵3种聚类评价标准下

均优于传统的仿射传播流聚类算法。

Abstract

Aiming at the problem that the traditional stream clustering algorithm cannot effectively deal with the inspection and treatment of outliers

and the incremental data stream clustering efficiency is low

an enhanced stream clustering algorithm based on affinity propagation using density measurement was proposed. Based on the STRAP

the proposed algorithm can improve the clustering accuracy and efficiency by introducing a mechanism for outlier detection and removal. Firstly

the online stream clustering process is realized by the affinity propagation algorithm. Meanwhile

the phenomenon of data drift is detected

i.e.

the distribution of data stream changes with time. In view of this phenomenon

the new algorithm can implement the outlier detection and removal in the reservoir based on local outlier factor

and then re-cluster the current cluster and the treated reservoir to reconstruct the dynamic stream clustering model. Finally

through the validation on the KDD'99 data

the experimental results showed that the proposed algorithm not only reduces the number of re-clustering and improves the clustering efficiency

but also is superior to the STRAP in terms of the three clustering evaluation criteria

i.e.

the clustering accuracy

purity and entropy.

关键词

Keywords

references

SILVA J A, FARIA E R, BARROS R C, et al. Data stream clustering: a survey [J]. ACM Computing Surveys, 2013, 46(1): 125-134.

ZHOU Aoying, CAO Feng, QIAN Weining, et al. Tracking clusters in evolving data streams over sliding windows [J]. Knowledge and Information Systems, 2008, 15(2): 181-214.

ACKERMANN M R, MARTENS M, RAUPACH C, et al. StreamKM++: a clustering algorithm for data streams [J]. Journal of Experimental Algorithmics, 2012, 17: 173-187.

CAO Feng, ESTER M, QIAN Weining, et al. Density-based clustering over an evolving data stream with noise [C]∥SIAM International Conference on Data Mining. Philadelphia, PA, USA: SIAM, 2006: 328-339.

RODRIGUES P P, GAMA J, PEDROSO J P. ODAC: hierarchical clustering of time series data streams [C]∥ Proceedings of the 2006 SIAM International Conference on Data Mining. Philadelphia, PA, USA: SIAM, 2006: 615-627.

GAMA J, RODRIGUES P P, LOPES L M B. Clustering distributed sensor data streams using local processing and reduced communication [J]. Intelligent Data Analysis, 2011, 15(1): 3-28.

FREY B J, DUECK D. Clustering by passing messages between data points [J]. Science, 2007, 315(5814): 972-976.

王羡慧, 覃征, 张选平, 等. 采用仿射传播的聚类集成算法 [J]. 西安交通大学学报, 2011, 45(8): 1-6.WANG Xianhui, QIN Zheng, ZHANG Xuanping, et al. Cluster ensemble algorithm using affinity propagation [J]. Journal of Xi'an Jiaotong University, 2011, 45(8): 1-6.

ZHANG Xiangliang, FURTLEHNER C, SEBAG M. Data streaming with affinity propagation [C]∥ Lecture Notes in Computer Science. Berlin, Germany: Springer, 2008: 628-643.

ZHANG Xiangliang, FURTLEHNER C, GERMAIN-RENAUD C, et al. Data stream clustering with affinity propagation [J]. IEEE Transactions on Knowledge Data Engineering, 2014, 26(7): 1644-1656.

HA J, SEOK S, LEE J S. Robust outlier detection using the instability factor [J]. Knowledge-Based Systems, 2014, 63(2): 15-23.

BREUNIG M M, KRIEGEL H P, NG R T, et al. LOF: identifying density-based local outliers [J]. ACM Sigmod Record, 2000, 29(2): 93-104.

WU Junjie, HUI Xiong, CHEN Jian. Adapting the right measures for K-means clustering [C]∥Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2009: 877-886.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Cluster Ensemble Algorithm Using Affinity Propagation

Numerical Simulation of Heat-Moisture Barrier Performance of a Horizontal Air Curtain in Cold Storage

Diffusion Characteristics and Influencing Factors in Case of Hydrogen Leakage from Fuel Cell Vehicles Running in Tunnels

Electrothermal Coupling Research on the Evolutionary Law of Anti-Corona Performance for High-Altitude Air-Cooled Generators

A Structure-Semantics-Residual Collaborative Image Compression Framework：Towards Privacy Protection and High-Fidelity Reconstruction

Related Author

王羡慧 1

覃征 1

张选平 1

高洪江 4

Related Institution

西安交通大学电子与信息工程学院

新疆大学信息科学与工程学院

⁰