FAULT RECOVERY METHOD IN SPARK STREAMING BASED APPARATUS AND DISTRIBUTED APPARATUS SUPPORTING REAL-TIME PROCESSING

摘要

A failure recovery method in a spark streaming-based device includes the steps of: storing input streaming data, cumulative deformation history, and status data in units of a reference time in a spark streaming-based device; The method comprising the steps of: accumulating a total failure recovery time while estimating a failure recovery time for the streaming data; if the total failure recovery time exceeds the threshold, Determining at least one of state data of at least one of state data generated and stored before the target state data and input streaming data stored before being input and stored before the target state data is generated, And deleting the streaming data.