Sentence completion task using web-scale data

摘要

We propose a method to automatically answer SAT-style sentence completion questions using web-scale data. Web-scale da-ta have been used in many language studies and have been found to be a very useful resource for improving accuracy in sentence completion task. Our method employs assorted N-gram probability information for each candidate word. We also proposed back-off strategy was used to remove zero probabilities. We found that the accuracy of our proposed method improved by 52–87% over the current state-of-the-art