A novel clustering method based on hierarchical search results is proposed to facilitate users browsing web search results produced by search engines and to locate the interesting information quickly and efficiently. The snippets are collected and preprocessed. Frequent bigrams are identified based on term co-occurrence information
from which n-grams are obtained. After filtering out the redundant phrases and sorting by significance
candidate cluster labels are obtained. Finally
the snippets are grouped into clusters based on the candidate cluster labels
and a hierarchical result is generated. Experimental results show that the proposed method can generate accurate and highly readable cluster labels
which can help users effectively browse through the search results returned by search engine
and locating their interesting information. The method outperforms Vivisimo
Lingo and STC algorithms on different indexes. A comparison on Chinese dataset further illustrates the validity of the method.
关键词
Keywords
references
SMADJA F. Retrieving collocations from text: Xtract[J]. Computational Linguistics, 1993, 19(1): 143-177.
ZHANG Dell, DONG Yisheng. Semantic hierarchical, online clustering of Web search results [C]∥Proceeding of the 6th Asia Pacific Web Conference(APWEB). Berlin, Germany: Springer-Verlag, 2004:69-78.
ZAMIR O, ETZIONI O. Grouper: a dynamic clustering interface to Web search results [C]∥Proceedings of the 8th International World Wide Web Conference.Toronto, Canada: Elsevier,1999:283-296.
OSINSKI S. An algorithm for clustering of Web search results [D]. Poznan,Poland: Poznan University of Technology, 2003.
ZENG Huajun, HE Qicai, CHEN Zheng, et al. Learning to cluster Web search results [C]∥Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 2004: 210-217.
ZHANG Yun, FENG Boqin, MA Shouqiang, et al. Text clustering based on fusion of ant colony algorithm and genetic algorithm [J]. Journal of Xi'an Jiaotong University, 2007, 41(10): 1146-1150.
GERACI F, PELLEGRINI M, MAGGINI M, et al. Cluster generation and cluster labeling for Web snippets: a fast and accurate hierarchical solution [J]. Internet Mathematics, 2007, 3(4):413-444.