Method and system for Data caching based on In-Memory data processing framework, and recoding medium therefor

摘要

The present invention discloses a data caching method and system based on an in-memory data processing framework, and a recording medium therefor. Specifically, in a method for caching an application controlled by an in-memory data processing framework system operating based on a Directed Acyclic Graph (DAG), the in-memory data processing framework system Profiling the application to be used with predetermined input data, the number of times each intermediate data is used based on the profiling, and the steps of deriving the size of each intermediate data compared to the input data, the number of times used is the same Partitioning one or more Directed Acyclic Graphs (DAGs) based on a set of one or more intermediate data with dependencies and caching according to the type and/or remaining memory capacity of the application within the partitioned DAG ( determining intermediate data to be cached.