首页>
外国专利>
Dynamic cache management for in-memory data analytic platforms
Dynamic cache management for in-memory data analytic platforms
展开▼
机译:内存中数据分析平台的动态缓存管理
展开▼
页面导航
摘要
著录项
相似文献
摘要
At a cache manager of a directed acyclic graph-based data analytic platform, from each of a plurality of monitor components on a plurality of worker nodes, statistics are obtained for a plurality of tasks, including which of the tasks have been processed and which are in a task queue. Each of the tasks has at least one associated distributed dataset. Each worker has a distributed dataset cache. A current stage directed acyclic graph is obtained from a directed acyclic graph scheduler component. For a given one of the tasks which has been processed, and for which it is determined that no other ones of the tasks depend on the at least one distributed dataset associated with the given one of the tasks, the distributed dataset is evicted from a corresponding one of the distributed dataset caches.
展开▼