Organizing On-Disk Layout of Index Structures to Support Historical Keyword Search Queries Over Temporally Evolving Data

摘要

Methods, systems, and computer program products for organizing on-disk layout of index structures are provided herein. A method includes organizing an on-disk corpus of data index structures; partitioning each data index structure into an active and/or latest state data partition and an archived data partition; sub-partitioning each of the archived data partitions into sub-partitions based on exact lifespan of each data item; executing a search query that includes temporal predicates and keyword predicates across the corpus by: pruning a collection of identified items of data from the corpus that contain the keyword predicates using range metadata associated with the temporal predicates to generate a pruned list of data items; and performing a list intersection operation on the data index structures to generate a list of common data items from the pruned list; retrieving the common data items from the active and/or latest state data partitions and the archived data sub-partitions.