An improved term-committee-based event identification algorithm is presented to meet the requirements of efficiency and accuracy in public opinion monitor system
where the original event identification algorithm can not be applied due to its lower efficiency. While the similarity between the clusters is calculated
the weight is taken into consideration simultaneously. Referencing the examples from normal curve
an evaluation algorithm is proposed to help choosing cluster with a proper term number
thus the improved algorithm only needs clustering once. The experiments indicate the operating efficiency for the required accuracy.
LIU Tao, WU Gongyi, CHEN Zheng. An effective unsupervised feature selection method for text clustering [J]. Journal of Computer Research and Development, 2005, 42(3):381-386.
PENG Liuqing, ZHANG Junying, XU Jin. A robust algorithm for cluster initialization using uniform effect of k-means [J]. Journal of Huazhong University of Science and Technology, 2010,38(8):73-76.
HAO Xiulan, HU Yunfa. Topic detection and tracking oriented to BBS [C]∥Computer, Mechatronics, Control and Electronic Engineering(CMCE), 2010 International Conference on. Piscataway, NJ, USA:IEEE, 2010: 154-157.
KUMARAN G, ALLAN J. Text classification and named entities for new event detection [C]∥The 27th Annual International ACM SIGIR Conference. New York, USA: ACM, 2004: 297-304.
ZENG Yiling, XU Hongbo, WU Gaowei, et al. Clustering algorithm based on the distributions of intrinsic clusters [J]. Journal of Software, 2010, 21(11): 2802-2813.
MOHD M, CRESTANI F, RUTHVEN I. Design of an interface for interactive topic detection and tracking [C]∥Flexible Query Answering Systems 8th International Conference on. Berlin, German: Springer, 2009:227-238.
HOUSHMAND M, NAGHIBZADEH M, ARABAN S. Reliability-based similarity aggregation in ontology matching [C]∥Intelligent Computing and Intelligent Systems(ICIS), 2010 IEEE International Conference on. Piscataway, NJ, USA: IEEE,2010: 744-749.
ALLAN J, CARBONELL J, DODDINGTON G, et al. Topic detection and tracking pilot study final report[C]∥Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop. San Francisco, USA: Morgan Kaufmann Publishers, 1998: 194-218.
ZHANG Meng, WANG Daling, YU Ge. A text clustering method based on auto-selected threshold [J]. Journal of Computer Research and Development, 2004, 41(10): 1748-1753.
ZHANG Kuo, LI Juanzi, WU Gang, et al. Term-committee-based event identification within topics [J]. Journal of Computer Research and Development, 2009,46(2):245-252.
NALLAPATI R, FENG A, PENG F C, et al. Event threading within news topics [C]∥Proc of the 13th ACM Conf on Information and Knowledge Management(CIKM). New York, USA: ACM, 2004: 446-453.