SYSTEM AND METHOD TO ASSURE DATA QUALITY IN DISTRIBUTED DATA COLLECTION PIPELINE

摘要

The integrity of an end-to-end message sent from a source to a destination in a distributed data pipeline is improved by tracking the number of messages sent to and received by each of the intermediate components and sink components of the pipeline as the messages move through the distributed data pipeline.