frequency dictionary created by "Language Reactor"

[joan_LanguageProcess]

Hi @Grander_Gard,

If you click on your settings gear () then click “set vocabulary level”, it’ll give you a list of words that may be helpful to you:

Other than that, there are no other lists of words that I can think of, and you would need to ask the LR team for a specific language of frequency info — if they are willing to share that since it goes into their algorithm.

I do know that they pull frequency lists from opensubtitles[.org]:

@joan_LanguageProcess

From what I can tell it’s from https://opus.nlpl.eu/OpenSubtitles-v2018.php which source their info from http://www.opensubtitles.org/

Source:

@David_Wilkinson

the frequency lists come from subtitles (http://opus.nlpl.eu/OpenSubtitles-v2018.php ). I processed 10,000 subtitles for each language, tokenised the subs into words, then lemmatised. 5,000… was not really enough to have a good list for top 10,000 frequent words… 10,000 subtitles is kind of ok, but more is better I think, I just got a bit impatient to get the feature online, I will run more subs through the script sometime soon.

I hope this is somewhat helpful!