BIG-DATA PROCESSING ACCELERATOR AND BIG-DATA PROCESSING SYSTEM THEREOF

摘要

A big-data processing accelerator operated under Apache Hive-on-Tez framework, the Hive-on-Spark framework, or the SparkSQL framework includes an operator controller and an operator programming module. The operator controller executes a plurality of Map operators and at least one Reduce operator according to an execution sequence. The operator programming module defines the execution sequence to execute the plurality of Map operators and the at least one Reduce operator based on the operator controller's hardware configuration and a directed acyclic graph.