一种突发性热点话题在线发现与跟踪方法

薛峰; 周亚东; 高峰; 刘霁; 赵俊舟; 党琪

您当前的位置：

首页 >

文章列表页 >

一种突发性热点话题在线发现与跟踪方法

更新时间：2025-07-09

- 一种突发性热点话题在线发现与跟踪方法
- An Online Detection and Tracking Method for Bursty Topics
- 西安交通大学学报 2011年45卷第12期页码：64-69+116
- 作者机构：
  
  西安交通大学智能网络与网络安全教育部重点实验室,西安,710049
- 作者简介：
- 基金信息：
  
  : 2011-04-25. 作者简介: 薛峰(1986-),男,硕士;周亚东(通信作者),男,讲师. 基金项目: 国家自然科学基金资助项目(60921003,60802056,60905018);国家“863计划”资助项目(2007AA01Z480);国家科技支撑计划资助项目(2011BAK08B02)
- DOI：
  中图分类号： TP393.4
- 网络首发：2011-12-10，
  
  纸质出版：2011
- 稿件说明：
移动端阅览
薛峰, 周亚东, 高峰, 等. 一种突发性热点话题在线发现与跟踪方法[J]. 西安交通大学学报, 2011,45(12):64-69+116.

An Online Detection and Tracking Method for Bursty Topics[J]. 2011, 45(12): 64-69+116.
薛峰, 周亚东, 高峰, 等. 一种突发性热点话题在线发现与跟踪方法[J]. 西安交通大学学报, 2011,45(12):64-69+116. DOI：

An Online Detection and Tracking Method for Bursty Topics[J]. 2011, 45(12): 64-69+116. DOI：

摘要

针对在线发现与跟踪动态突发性文本流中的热点话题问题

在突发性热点词发现与度量方法的基础上提出了一种动态文本模型——动态突发性向量空间模型

用于有效描述文本的动态属性

并且结合文本聚类方法

提出了突发性热点话题的在线发现与跟踪方法.该方法可有效解决传统的基于静态向量空间模型的热点话题发现与跟踪方法仅可分析静态文本的缺陷

并具有以下特点:在特征选择阶段动态地生成热点词特征库

利用模型统一文本和话题的表示

在文本表示时给予突发性热点词更大的权重.基于实际网络文本流数据的实验表明

该方法对突发性热点话题发现的精确率与召回率分别达到92.75%和80.34%

显著优于传统的基于静态向量空间模型方法的实验结果

并可有效跟踪突发性热点话题

弥补了传统静态方法不能有效跟踪热点话题的不足.

Abstract

Text representation in text mining plays an important role

but the traditional vector space model based on TF-IDF is a static statistical model and is not flexible for bursty topic detection and tracking since it could not model the bursty dynamic text flow(such as news text flow

blog text flow

etc.)effectively.A new model called dynamic bursty vector space model is proposed to model text flow

and to detect and track bursty topics based on bursty feature detection. The proposed dynamic model has several characteristics in contrast to the traditional static model: 1)The model generates features dynamically in feature selection process; 2)A unified representation of the text and topics is given; 3)The model gives more weights to temporal bursty features. The experiments of bursty topic detection and tracking demonstrate that the dynamic bursty vector space model could be able to get higher precision and recall.

关键词

Keywords

references

CROFT B, METZLER D, STROHMAN T. Search engines: information retrieval in practice [M]. Reading, MA, USA: Addison-Wesley Publishing Company, 2009: 552.

LI Hong, WEI Jinfeng. Netnews bursty hot topic detection based on bursty features [C]∥Proceedings of International Conference on E-Business and E-Government. Washington DC, USA: IEEE, 2010: 1437-1440.

HOLZ F, TERESNIAK S. Towards automatic detection and tracking of topic change [M]∥GELBUKH A. Computational Linguistics and Intelligent Text Processing. Berlin, Germany: Springer-Verlag, 2010: 327-339.

JING Qiu, LIAO Lejian, DONG Xiujie. Topic detection and tracking for Chinese news web pages [C]∥ Proceedings of Seventh International Conference on Advanced Language Processing and Web Information Technology. Washington DC, USA: IEEE Computer Society, 2008: 114-120.

ALLAN J, PAPKA R, LAVRENKO V. On-line new event detection and tracking [C]∥Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 1998: 37-45.

YANG Yiming, PIERCE T, CARBONELL J. A study of retrospective and on-line event detection [C]∥Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information. New York, USA: ACM, 1998: 28-36.

FUNG G P C, YU J X, LIU H, et al. Time-dependent event hierarchy construction [C]∥BERKHIN P, et al. Proceedings of the Thirteenth ACM International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2007: 300-309.

FUNG G P C, YU J X, YU P S, et al. Parameter free bursty events detection in text streams [C]∥Proceedings of the 31st International Conference on Very Large Data Bases. Trondheim, Norway: VLDB Endowment, 2005: 181-192.

WANG Xuanhui, ZHAI Chengxiang, HU Xiao, et al. Mining correlated bursty topic patterns from coordinated text streams [C]∥BERKHIN P, et al. Proceedings of the Thirteenth ACM International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2007: 784-793.

SUBA I, BERENDT B. From bursty patterns to bursty facts: the effectiveness of temporal text mining for news [C]∥Proceedings of 19th European Conference on Artificial Intelligence. Fairfax, VA, USA: IOS Press, 2010: 517-522.

SALTON G, BUCKLEY C. Term-weighting approaches in automatic text retrieval [J]. Inf Process Manage, 1988, 24(5): 513-523.

HE Q, CHANG K Y, LIM E P. Using burstiness to improve clustering of topics in news streams [C]∥RAMAKRISHNAN N, et al. Proceedings of the Seventh IEEE International Conference on Data Mining. Washington DC, USA: IEEE Computer Society, 2007: 493-498.

RIBEIRO M N, NETO M J R, PRUDENCIO R B C. Local feature selection in text clustering [M]∥Advances in Neuro-Information Processing. Heidelberg, Germany: Springer-Verlag, 2009: 45-52.

SWAN R, ALLAN J. Automatic generation of overview timelines [C]∥Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 2000: 49-56.

LIU Bing. A fast density-based clustering algorithm for large databases [C]∥Proceedings of 2006 International Conference on Machine Learning and Cybernetics. Washington DC, USA: IEEE, 2006: 996-1000.

LUO Congnan, LI Yanjun, Chung S M. Text document clustering based on neighbors [J]. Data and Knowledge Engineering, 2009, 68(11): 1271-1288.[本刊相关文献链接]

海量信息异常检测问题的异常概率排序算法. 西安交通大学学报,2011,45(4): 36-40.

应用粒子群优化-条件随机域的文本生物实体识别. 西安交通大学学报,2010,44(12):38-42.

高效的用户访问预测新算法. 西安交通大学学报,2010,44(4):28-33.

具有孤立项过滤的信息检索查询词的分析方法. 西安交通大学学报,2009,43(8):6-10.

采用并行遗传算法的文本分割研究. 西安交通大学学报,2009,43(12):40-44.

面向入侵检测系统的模式匹配算法研究. 西安交通大学学报, 2009,43(2):58-62.

结合受控词汇表的生物基因本体标注与分类. 西安交通大学学报,2008,42(2):171-174.

流量内容词语相关度的网络热点话题提取. 西安交通大学学报, 2007,41(10):1142-1145.

基于免疫记忆克隆的特征选择. 西安交通大学学报,2008,42(6):679-682.

蚁群-遗传融合的文本聚类算法. 西安交通大学学报,2007,41(10):1146-1150.

一种增量式文本软聚类算法. 西安交通大学学报, 2007,41(4):398-401.

一种新颖的基于量化概念格的属性归纳算法. 西安交通大学学报, 2007,41(2):176-179.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

结构-语义-残差协同的图像压缩框架：面向隐私保护与高保真重建

扇贝仿生密封腔室内超临界二氧化碳泄漏流湍动能耗散机理研究

面向高海拔空冷发电机防晕性能演化规律的电热耦合研究

张角凹坑气膜孔对双层壁气膜冷却特性的影响

语义区分和子图整合驱动的知识图谱表示学习方法