VISUAL EFFECTS SYSTEM FOR 'BIG DATA' ANALYSIS WORKFLOW EDITORS, DISTRIBUTION PLATFORMS, EXECUTION ENGINES, AND MANAGEMENT SYSTEMS COMPRISING SAME

摘要

Provided are methods and systems for the visualization, distribution, and event-driven management of elements of a workflow that defines an analysis of very large data sets using multi-node compute clusters. A method for visualization of elements of such a workflow may include displaying the workflow via a user interface, collapsing groups of elements, adding further elements, removing elements, and modifying elements in the workflow. A digital workflow distribution platform comprises a user interface configured to allow a user to select a workflow, to acquire the workflow, to import the workflow into a user environment, and to develop the workflow imported into the user environment. An event-driven management engine for workflows may activate one or more computational modules in response to triggering events wherein the computational modules may be allocated non-sequentially in a distributed cloud computing environment to process a data set according to predetermined criteria.