On the Boundedness Law for the Number of Words in an Overabundant Dictionary. II

摘要

As in the previous article [1], we consider a corpus of texts (e.g. the contents of a book) and the frequency dictionary corresponding to this corpus (or to this book). The entries of this dictionary can be word forms or lexemes. The dictionary of word forms is, of course, several times larger than the dictionary of lexemes. For Russian, it is approximately 5 times larger, for English, 2.5 times. We are interested in the following question: When can the dictionary be regarded as saturated with rare words, which hamper reading and understanding the text?