{"id":2375,"date":"2020-06-01T15:17:12","date_gmt":"2020-06-01T13:17:12","guid":{"rendered":"https:\/\/www.cjvt.starkmat.si\/?page_id=2375"},"modified":"2020-11-05T22:33:22","modified_gmt":"2020-11-05T21:33:22","slug":"the-list-corpus-extraction-tool","status":"publish","type":"page","link":"https:\/\/www.cjvt.si\/en\/infrastructure-support\/the-list-corpus-extraction-tool\/","title":{"rendered":"The LIST corpus extraction tool"},"content":{"rendered":"

LIST<\/h2>\n

EFFICIENT SLOVENE CORPUS ANALYSIS TOOL<\/h3>\n<\/div><\/section><\/div>\n
<\/div>

<\/span>

<\/p>\n

In this project, a clear and understandable user interface for the corpusStatistics tool (renamed to LIST) was developed. It enables its users to easily access language statistics in Slovene and other corpora. The tool was adapted to several formats and tested on large Slovene and other corpora.<\/p>\n

Metadata was added to the output which enables repeatability. The interface elements now have short explanations that show up while hovering over them.<\/p>\n

An option to show different collocation calculations (eg. Dice, t-score, MI, MI3) for the extracted word sets was added. Additionally, a calculation of the processing time was added. Furthermore, we implemented warnings for options that affect processing time.<\/p>\n

It is also possible to switch between the Slovene and English version. What is more, non-latin alphabets can be processed.<\/p>\n

The program was upgraded to support the TEI P5 format that is used for new corpora in the CLARIN-SI repository as well as the Vert format used in SkentchEngine.<\/p>\n

The LIST tool is available under the open license Apache2 at:<\/p>\n

Krsnik, Luka; et al., 2019, Corpus extraction tool LIST 1.0, Slovenian language resource repository CLARIN.SI, http:\/\/hdl.handle.net\/11356\/1227<\/a>.<\/p>\n<\/div><\/section><\/div><\/p>\n

LINKS AND CONTACT<\/h3>\n<\/div><\/section>
\n
<\/span><\/span><\/div>
\n

Jaka \u010cibej
\nCentre for Language Resources and Technologies at the University of Ljubljana
\nFaculty of Computer and Information Science UL
\nVe\u010dna pot 113, SI-1000 Ljubljana<\/p>\n