Text representation in text mining plays an important role
but the traditional vector space model based on TF-IDF is a static statistical model and is not flexible for bursty topic detection and tracking since it could not model the bursty dynamic text flow(such as news text flow
blog text flow
etc.)effectively.A new model called dynamic bursty vector space model is proposed to model text flow
and to detect and track bursty topics based on bursty feature detection. The proposed dynamic model has several characteristics in contrast to the traditional static model: 1)The model generates features dynamically in feature selection process; 2)A unified representation of the text and topics is given; 3)The model gives more weights to temporal bursty features. The experiments of bursty topic detection and tracking demonstrate that the dynamic bursty vector space model could be able to get higher precision and recall.
关键词
Keywords
references
CROFT B, METZLER D, STROHMAN T. Search engines: information retrieval in practice [M]. Reading, MA, USA: Addison-Wesley Publishing Company, 2009: 552.
LI Hong, WEI Jinfeng. Netnews bursty hot topic detection based on bursty features [C]∥Proceedings of International Conference on E-Business and E-Government. Washington DC, USA: IEEE, 2010: 1437-1440.
HOLZ F, TERESNIAK S. Towards automatic detection and tracking of topic change [M]∥GELBUKH A. Computational Linguistics and Intelligent Text Processing. Berlin, Germany: Springer-Verlag, 2010: 327-339.
JING Qiu, LIAO Lejian, DONG Xiujie. Topic detection and tracking for Chinese news web pages [C]∥ Proceedings of Seventh International Conference on Advanced Language Processing and Web Information Technology. Washington DC, USA: IEEE Computer Society, 2008: 114-120.
ALLAN J, PAPKA R, LAVRENKO V. On-line new event detection and tracking [C]∥Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 1998: 37-45.
YANG Yiming, PIERCE T, CARBONELL J. A study of retrospective and on-line event detection [C]∥Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information. New York, USA: ACM, 1998: 28-36.
FUNG G P C, YU J X, LIU H, et al. Time-dependent event hierarchy construction [C]∥BERKHIN P, et al. Proceedings of the Thirteenth ACM International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2007: 300-309.
FUNG G P C, YU J X, YU P S, et al. Parameter free bursty events detection in text streams [C]∥Proceedings of the 31st International Conference on Very Large Data Bases. Trondheim, Norway: VLDB Endowment, 2005: 181-192.
WANG Xuanhui, ZHAI Chengxiang, HU Xiao, et al. Mining correlated bursty topic patterns from coordinated text streams [C]∥BERKHIN P, et al. Proceedings of the Thirteenth ACM International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2007: 784-793.
SUBA I, BERENDT B. From bursty patterns to bursty facts: the effectiveness of temporal text mining for news [C]∥Proceedings of 19th European Conference on Artificial Intelligence. Fairfax, VA, USA: IOS Press, 2010: 517-522.
SALTON G, BUCKLEY C. Term-weighting approaches in automatic text retrieval [J]. Inf Process Manage, 1988, 24(5): 513-523.
HE Q, CHANG K Y, LIM E P. Using burstiness to improve clustering of topics in news streams [C]∥RAMAKRISHNAN N, et al. Proceedings of the Seventh IEEE International Conference on Data Mining. Washington DC, USA: IEEE Computer Society, 2007: 493-498.
RIBEIRO M N, NETO M J R, PRUDENCIO R B C. Local feature selection in text clustering [M]∥Advances in Neuro-Information Processing. Heidelberg, Germany: Springer-Verlag, 2009: 45-52.
SWAN R, ALLAN J. Automatic generation of overview timelines [C]∥Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 2000: 49-56.
LIU Bing. A fast density-based clustering algorithm for large databases [C]∥Proceedings of 2006 International Conference on Machine Learning and Cybernetics. Washington DC, USA: IEEE, 2006: 996-1000.
LUO Congnan, LI Yanjun, Chung S M. Text document clustering based on neighbors [J]. Data and Knowledge Engineering, 2009, 68(11): 1271-1288.[本刊相关文献链接]