Etudes in Chinese-Hungarian corpus-based lexical acquisition

Ugray, Gábor: Etudes in Chinese-Hungarian corpus-based lexical acquisition. Magyar Számítógépes Nyelvészeti Konferencia, (12). pp. 247-259. (2018)

[img] Cikk, tanulmány, mű
msznykonf_014_247-259.pdf

Download (669kB)

Abstract

The paper reports on a series of experiments to extract matching lexical items from a 6.1 million segment corpus of movie subtitles in Mandarin Chinese and Hungarian, with the aim of expanding an existing bilingual dictionary. The challenges of data cleansing and tokenization are outlined, and the outcome of word alignment, vector space embeddings, neural machine translation and two standard statistical approaches is presented. A bilingual concordance tool for end users, based on word alignments, is introduced. A quantitative and qualitative evaluation of the results finds that the new methods drastically outperform simple collocation extraction, but also shows that human judgement is indispensable before including vocabulary in a published dictionary.

Item Type: Article
Event Title: Magyar Számítógépes Nyelvészeti Konferencia (14.) (2018) (Szeged)
Journal or Publication Title: Magyar Számítógépes Nyelvészeti Konferencia
Date: 2018
Volume: 12
Page Range: pp. 247-259
ISBN: 978-963-306-578-5
Uncontrolled Keywords: Nyelvészet - számítógép alkalmazása
Additional Information: Bibliogr.: p. 258-259. ; összefoglalás magyar nyelven
Date Deposited: 2019. Jul. 02. 18:53
Last Modified: 2019. Jul. 02. 18:53
URI: http://acta.bibl.u-szeged.hu/id/eprint/59049

Actions (login required)

View Item View Item