LEARNING LANGUAGE MODELS FROM SCRATCH BASED ON CROWD-SOURCED USER TEXT INPUT

摘要

Technology is described for developing a language model for a language recognition system from scratch based on aggregating and analyzing text input from multiple users of the language. The technology allows a user to select a language, and if no existing language model is available for the selected language, provides a new language model for the selected language, monitors and collects information about the use of words in the selected language, combines information collected from multiple users of the selected language, and updates the user's language model based on the combined information from multiple users of the selected language.