APPARATUS FOR IMPLEMENTING DYNAMIC, DATA-DEPENDENT PARALLELISM FOR TASK EXECUTION BASED ON AN EXECUTION MODEL

摘要

Provided is an apparatus for implementing dynamic, data-dependent parallelism for task execution based on a macro dataflow execution model. The execution model defines a plurality of high-level abstractions that determine the behavior of a plurality of hardware components of the apparatus. The execution model defines primitive operations that enable the runtime construction of a hyperOp dependence graph (HDG) for applications. The execution model defines primitive operations that enable configuring two distinct address spaces of a memory as a global memory for shared memory communication and a context memory for synchronization. A runtime system of the execution model defines functionalities that are implemented in an orchestrator to manage execution of unordered hyperOp instances in parallel and directly load operands of a hyperOp instance from an associated context frame into a register file of a compute element (CE).