{"id":2371,"date":"2020-06-02T12:26:48","date_gmt":"2020-06-02T10:26:48","guid":{"rendered":"https:\/\/www.cjvt.starkmat.si\/?page_id=2371"},"modified":"2020-11-05T22:32:24","modified_gmt":"2020-11-05T21:32:24","slug":"lists-textbooks","status":"publish","type":"page","link":"https:\/\/www.cjvt.si\/en\/infrastructure-support\/lists-textbooks\/","title":{"rendered":"Keywords and n-grams from a textbook corpus"},"content":{"rendered":"

Compiling keyword lists and n-grams from a textbook corpus for different school years and subjects<\/h2>\n<\/div><\/section><\/div>\n
<\/div>

<\/span>

<\/p>\n

In this project, we built a corpus of textbooks for primary and secondary school and extracted a list of words, n-grams and keywords. The corpus was converted from PDF and HTML into text that was corrected and annotated according to structure. It contains 5 million tokens from 127 textbooks for 16 subjects. The next step was extracting the lists according to several criteria. All lists were checked manually. The following lists were compiled:<\/p>\n

General words list that appear in at least 8 from 16 subjects. It contains lemma, word type, frequency (also according to school subject) and subject count data.<\/p>\n

General words list according to school year (class) containing data on lemma, word type, frequency (also according to school year) and subject number (from 16).<\/p>\n

2-5-gram list containing data on n-gram type, lemma, word type, morphological annotations, and subject count and frequency.<\/p>\n

The lists are available under the CC BY licence at:<\/p>\n

Kosem, Iztok; Pori, Eva and Arhar Holdt, \u0160pela, 2019, Keywords and n-grams from a textbook corpus, Slovenian language resource repository CLARIN.SI, http:\/\/hdl.handle.net\/11356\/1215<\/a>.<\/p>\n<\/div><\/section><\/div><\/p>\n

LINKS AND CONTACT<\/h3>\n<\/div><\/section>
\n
<\/span><\/span><\/div>
\n

Dr. Iztok Kosem
Centre for Language Resources and Technologies at the University of Ljubljana
Faculty of Computer and Information Science
Ve\u010dna pot 113, SI-1000 Ljubljana<\/p>\n