Beyond SoNaR: towards the facilitation of large corpus building efforts

Abstract

In this paper we report on the experiences gained in the recent construction of the SoNaR corpus, a 500 MW reference corpus ofcontemporary, written Dutch. It shows what can realistically be done within the confines of a project setting where there are limitationsto the duration in time as well to the budget, employing current state-of-the-art tools, standards and best practices. By doing so we aim topass on insights that may be beneficial for anyone considering to undertake an effort towards building a large, varied yet balanced corpusfor use by the wider research community. Various issues are discussed that come into play while compiling a large corpus, includingapproaches to acquiring texts, the arrangement of IPR, the choice of text formats, and steps to be taken in the preprocessing of data fromwidely different origins. We describe FoLiA, a new XML format geared at rich linguistic annotations. We also explain the rationalebehind the investment in the high-quality semi-automatic enrichment of a relatively small (1 MW) subset with very rich syntactic andsemantic annotations. Finally, we present some ideas about future developments and the direction corpus development may take, suchas setting up an integrated work flow between web services and the potential role for ISOcat. We list tips for potential corpus builders,tricks they may want to try and further recommendations regarding technical developments future corpus builders may wish to hope for.

Publication
Proceedings of the Eighth International conference on Language Resources and Evaluation (LREC)
Date