Grammar and Corpora 2016
How to cite this chapter

Rosen, Alexandr: Coping with Unruly Language: Non-Standard Usage in a Corpus, in: Fuß, Eric et al. (Eds.): Grammar and Corpora 2016, Heidelberg: Heidelberg University Publishing, 2018.

More citation styles

This work is licensed under a Creative Commons License 4.0
(CC BY-SA 4.0)
Creative Commons License BY-SA 4.0

Identifiers (Book)
ISBN 978-3-946054-84-9 (PDF)
ISBN 978-3-946054-82-5 (Softcover)
ISBN 978-3-946054-83-2 (Hardcover)

Published 16.05.2018.

Alexandr Rosen

Coping with Unruly Language: Non-Standard Usage in a Corpus

Abstract A language as used in real situations may differ substantially from its standard form. Before the entire range of NLP methods and tools can be applied to non-canonical variants of a language, appropriate categories for the analysis of deviant forms and constructions are needed, together with texts annotated by these categories. A discussion of non-standard language is fol­lowed by two case studies. The first study proposes a taxonomy of morphosyn­tactic categories as an attempt to analyze non-standard forms in non-native learners’ Czech. The second study focuses on the role of a rule-based grammar and lexicon as tools for the detection and diagnostics of non-standard words and constructions in the process of building and using a parsebank.

Keywords Non-standard language, Czech, learner corpus, parsebank, tree­bank, constrain-based grammar, valency, HPSG