METHOD, DEVICE AND COMPUTER PROGRAM FOR IDENTIFYING ITEMS HAVING HIGH FREQUENCY OF OCCURRENCE AMONG ITEMS INCLUDED IN TEXT DATA STREAM

摘要

PROBLEM TO BE SOLVED: To provide a method, device and computer program for efficiently identifying items having a high frequency of occurrence among items included in a large-volume text data stream.SOLUTION: Identification information for identifying an item and a count for the item are stored in a memory of a higher level, and only identification information is stored in a memory of a level lower than said higher level. When text data stream input is received: if identification information for an item included in a bucket resulted from division of the received text data stream input is stored in the higher-level memory, the count for the item is incremented; when stored in the lower-level memory, the identification information for the item is transferred with an initial count to the higher-level memory; and, when not stored in any level, the identification information for the item is newly stored with the initial count in the higher-level memory.