A bilingual word alignment algorithm of Naxi-Chinese based on feature constraint models is proposed to reduce the difficulty of bilingual word alignment for Naxi-Chinese which has huge difference in syntactic structure. Two feature constraint models- interval distortion model and position transformation model are established by counting the traits of interval distortion and position transformation in corpus
and are integrated into a log-linear framework of word alignment. Then parameters in the models are trained using the minimum error rate algorithm and the best alignment results are eventually searched. Experimental results on IBM Model3 show that the proposed algorithm increases the word alignment accuracy of Naxi-Chinese about 21.9%.
关键词
Keywords
references
BROWN P F, PIETRA D V J, PIETRA D S A, et al. The mathematics of statistical machine translation: parameter estimation [J].Computational Linguistics,1993, 19(2):263-311.
VOGEL S, NEY H, TILLMANN C. HMM-based word alignment in statistical translation [C]∥Proceedings of the 16th International Conference on Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 1996: 836-841.
TASKAR B, LACOSTE-JULIEN S, KLEIN D. A discriminative matching approach to word alignment [C]∥Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Porcessing. Stroudsburg, PA, USA: Association for Computational Linguistics, 2005: 73-80.
MOORE R. A discriminative framework for bilingual word alignment [C]∥Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics, 2005: 81-88.
CHERRY C,LIN D. A probability model to improve word alignment [C]∥Proceedings of the 41st Annual Meeting on Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 2003: 88-95.
LIU Yang, LIU Qun, LIN Shouxun. Log-linear models for word alignment[C]∥Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 2005: 459-466.
LIU Yang, LIU Qun, LIN Shouxun. Discriminative word alignment by linear modeling [J]. Computational Linguistics, 2010, 36(3): 303-339.
AYAN N F, DORR B J. A maximum entropy approach to combining word alignments [C]∥Proceedings of the Human Language Technology Conference of the North American Chapter of the ACL. Stroudsburg, PA, USA: Association for Computational Linguistics, 2006: 96-103.
OCH F J, NAY H. Discriminative training and maximum entropy models for statistical machine translation [C]∥Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA, USA: Association for Computational Linguistics, 2002: 295-302.
刘洋.树到串统计翻译模型研究[D].北京:中国科学院计算技术研究所,2007.
TOUTANOVA K, TOLAG I H, MANNING C D. Extensions to HMM-based statistical word alignment models [C]∥Proceedings of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics, 2002: 87-94.
OCH F J. Minimum error rate training in statistical machine translation [C]∥Proceedings of the 41st Annual Meeting of the ACL. Stroudsburg, PA, USA: Association for Computational Linguistics, 2003:160-167.