Distributed real-time partitioned MapReduce for a data fabric

摘要

A system for a distributed real time partitioned map reduce includes a plurality of nodes, a service node, and a plurality of partitions. The service node is selected by a client application system to manage execution of a task. One or more partitions of the plurality of partitions are stored on a first node of the plurality of nodes. A partition stored on the first node is configured to receive a request for a partition result from the service node; determine the partition result by querying a set of predetermined partition results stored by the partition; and provide the partition result to the service node.