A Framework for Data Processing at the Edges of Networks

摘要

This paper proposes a distributed processing framework inspired by MapReduce processing. It is unique to other distributed processing approaches to large-scale data, i.e., so-called big data, because it can locally process data maintained in distributed nodes, including sensor or database nodes with non-powerful computing capabilities connected through low-bandwidth networks. It introduces mobile agent technology so that it distributes data processing tasks to distributed nodes as a map step and aggregates their results by returning them to specified servers as a reduce step. The paper describes the architecture of the framework, its basic performance, and its applications.