Statistical named entity recognition for Hungarian

Farkas, Richárd and Szarvas, György: Statistical named entity recognition for Hungarian. In: Magyar Számítógépes Nyelvészeti Konferencia, (2). p. 346. (2004)

Cikk, tanulmány, mű

Download (187kB) | Preview


In this paper, we present decision tree based statistical Named Entity recognizer system for Hungarian. The model was trained and tested on a segment of the Szeged Corpus, containing short business news articles, collected from MTI (Hungarian News Agency, www.mti.hul. We applied C4.5 for classificaton, and examined the accuracy of the system using training sets of different sizes. For this task we used only numerically encodable information (we excluded the word form itself), which contained some orthographical rules specific to Hungarian, but we trained for the recognition of foreign language proper nouns appearing frequently in business news as well. During the experiments the best results showed an accuracy of 89.6% F measure.

Item Type: Article
Journal or Publication Title: Magyar Számítógépes Nyelvészeti Konferencia
Date: 2004
Volume: 2
Page Range: p. 346
Event Title: Magyar Számítógépes Nyelvészeti Konferencia (2.) (2004) (Szeged)
Uncontrolled Keywords: Nyelvészet - számítógép alkalmazása - előadáskivonat
Date Deposited: 2019. Jul. 16. 11:19
Last Modified: 2019. Jul. 16. 11:19

Actions (login required)

View Item View Item