Techniques for generating and operating on in-memory datasets

摘要

In various embodiments, a consumer generates and operates with an in-memory dataset. In operation, a read state application copies a snapshot associated with a source dataset from a file store to a random access memory (RAM) to generate an in-memory dataset. Notably, the source dataset has a first size, and the in-memory dataset has a second size that is smaller than the first size. The read state application then performs a read-only operation on the in-memory dataset to access one or more data values that are stored in the in-memory dataset and associated with the source dataset. When the one or more data values are accessed, the second data size of the in-memory dataset is maintained. Advantageously, some consumers that are unable to store the entire source dataset in are able to store the entire snapshot in RAM.