Focusing on the problem that the traditional methods cannot perform well on the short web page fields
a modified edit distance algorithm
referred as MED
is proposed. The proposed algorithm encodes the user query and the short web fields into two strings according to the word match
and then the MED is used to calculate the similarity between the two strings. Because the ‘position'
‘order'
and ‘distance' information that is very important in expressing the modification relationship between the query words are considered
the similarity between the encoding strings can be used to measure the relevance between the corresponding query and short field. Experimental results on large scale search engine data show that the proposed algorithm can significantly outperform the traditional algorithms for relevance ranking on short web fields
especially for very short fields.
关键词
Keywords
references
BRIN S, PAGE L. The anatomy of a large-scale hypertextual web search engine [J]. Computer Networks and ISDN Systems,1998, 30(1/7): 107-117.
OGILVIE P, CALLAN J. Combining structural information and the use of priors in mixed named-page and homepage finding [EB/OL]. [2006-10-11]. http:∥www. scils.rutgers.edu/~muresan/IR/TREC/Notebooks/t12_notebook/papers/cmu-dir.web.pdf.
BAEZA-YATES R A, RIBEIRO-NETO B A. Modern information retrieval [M]. Reading, MA, USA: Addison-Wesley Publishing Company, 1999.
ROBERTSON S E, WALKER S, HANCOCK-BEAULIEU M. Experimentation as a way of life: OKAPI at TREC [J]. Information Processing Management, 2000,36(1):95-108.
BUTTCHER S, CLARKE C L A, LUSHMAN B. Term proximity scoring for ad-hoc retrieval on very large text collections [C]∥Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM, 2006: 621-622.
MITTAL V, BALUJA S, SAHAMI M. The happy searcher: challenges in web information retrieval [EB/OL]. [2006-12-10]. http:∥www.cs.cmu.edu/~har/PRICAI-2004. pdf.
LEVENSHTEIN V I. Binary codes capable of correcting deletions, insertions, and reversals[J]. Soviet Physics Doklady, 1966,10(8):707-710.
CHE Wanxiang, LIU Ting, QIN Bing, et al. Similar Chinese sentence retrieval based on improved edit-distance [J]. High Technology Letters, 2004, 14(7):15.
CORMEN T H, LEISERSON C E, RIVEST R L, at el. Introduction to algorithms[M]. Beijing, China: China Machine Press, 2006.
CRASWELL N, HAWKING D. Overview of the TREC-2002 Web track [EB/OL]. [2006-09-22]. http:∥trec. nist. gov/pubs/trec11/papers/WEB.OVER. pdf.
JARVELIN K, KEKALAINEN J. IR evaluation methods for retrieving highly relevant documents [C]∥Proceedings of the 23rd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM,2000: 41-48.