Improving Part-of-Speech Tagging of Historical Text by First Translating to Modern Text

TY - CONF

T1 - Improving Part-of-Speech Tagging of Historical Text by First Translating to Modern Text

AU - Tjong Kim Sang, E.

PY - 2016/5/25

Y1 - 2016/5/25

N2 - We explore the task of automatically assigning syntactic tags (known as part-of-speech tags) like Noun and Verb to words in seventeenth-century Dutch text. Tools exist for performing this task for modern texts but they perform poorly on historical texts because of language changes. We test several methods for translating the words in the historical text to modern equivalents before applying the tag assignment tools. We show that this additional translation step improves the quality of the automatic syntactic analysis. Further improvements are possible when the lexicons and text collections used for developing the translation process, are extended in size.

AB - We explore the task of automatically assigning syntactic tags (known as part-of-speech tags) like Noun and Verb to words in seventeenth-century Dutch text. Tools exist for performing this task for modern texts but they perform poorly on historical texts because of language changes. We test several methods for translating the words in the historical text to modern equivalents before applying the tag assignment tools. We show that this additional translation step improves the quality of the automatic syntactic analysis. Further improvements are possible when the lexicons and text collections used for developing the translation process, are extended in size.

KW - part-of-speech tagging

KW - historical text

KW - machine translation

KW - lexicons

M3 - Paper

ER -