Ugray Gábor: Etudes in Chinese-Hungarian corpus-based lexical acquisition.
Preview |
Cikk, tanulmány, mű
msznykonf_014_247-259.pdf Download (669kB) | Preview |
Abstract
The paper reports on a series of experiments to extract matching lexical items from a 6.1 million segment corpus of movie subtitles in Mandarin Chinese and Hungarian, with the aim of expanding an existing bilingual dictionary. The challenges of data cleansing and tokenization are outlined, and the outcome of word alignment, vector space embeddings, neural machine translation and two standard statistical approaches is presented. A bilingual concordance tool for end users, based on word alignments, is introduced. A quantitative and qualitative evaluation of the results finds that the new methods drastically outperform simple collocation extraction, but also shows that human judgement is indispensable before including vocabulary in a published dictionary.
| Item Type: | Conference or Workshop Item |
|---|---|
| Journal or Publication Title: | Magyar Számítógépes Nyelvészeti Konferencia |
| Date: | 2018 |
| Volume: | 14 |
| ISBN: | 978-963-306-578-5 |
| Page Range: | pp. 247-259 |
| Event Title: | Magyar Számítógépes Nyelvészeti Konferencia (14.) (2018) (Szeged) |
| Related URLs: | http://acta.bibl.u-szeged.hu/58555/ |
| Uncontrolled Keywords: | Nyelvészet - számítógép alkalmazása |
| Additional Information: | Bibliogr.: p. 258-259. ; összefoglalás magyar nyelven |
| Date Deposited: | 2019. Jul. 02. 18:53 |
| Last Modified: | 2022. Nov. 08. 11:49 |
| URI: | http://acta.bibl.u-szeged.hu/id/eprint/59049 |
Actions (login required)
 |
View Item |
