To address the issues that traditional term co-occurrence models are lack of theoretical basis and poor stabile
a highly stable term co-occurrence model based on term field is proposed. The model uses the concept of field in classical physics for reference to define the term field(terms are the basic units of language
which describe the abstract concepts
and the term field is the area affected by a term in document). Based on the definition
the model regards correlation as a superposition of term fields
and gets the functional relations of terms correlation and the distances between terms. Experimental results show that the terms correlation in this model is almost a constant for small distances and stable enough in window. While the correlation amplitude of the terms in same category is only 26% of the best result obtained with other models
which means the model is stable enough in dataset.
关键词
Keywords
references
BEIGBEDER M, MERCIER A. An information retrieval model using the fuzzy proximity degree of term occurrences [C]∥Proceedings of the 2005 ACM Symposium on Applied Computing. New York, USA: ACM, 2005: 1018-1022.
PETKOVA D, CROFT W B. Proximity-based document representation for named entity retrieval[C]∥Proceedings of the 16th ACM Conference on Information and Knowledge Management. New York, USA: ACM, 2007: 731-740.
RASOLOFO Y, SAVOY J. Term proximity scoring for keyword-based retrieval systems [C]∥Proceedings of 25th European Conference on IR Research. Berlin, Germany: Springer, 2003: 207-218.
YAROWSKY A D. One sense per collocation[C]∥Proceedings of the ARPA Human Language Technology Workshop. Stroudsburg, PA, USA: Association for Computational Linguistics,1993: 266-271.
LU Song,BAI Shuo. Quantitative analysis of context field in natural language processing [J]. Chinese Journal of Computers, 2001,24(7): 742-747.
GAO Jianfeng, ZHOU Ming, NIE Jianyun, et al. Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependence relations [C]∥Proceedings of the 25th Annual International ACM SIGIR. New York, USA: ACM, 2002: 183-190
GUO Feng,LI Shaozi,ZHOU Changle,et al. Co-occurrence word retrieval based on the lexical attraction and repulsion model [J]. Journal of Chinese Information Processing, 2004,18(6): 16-22.