Consistent updating of data storage units using tenant specific update policies

摘要

Updating a data storage unit using tenant specific update policies is disclosed. In an embodiment, a plurality of application events from an events publisher is received at a data pipeline manager. The plurality of application events are associated with data at a source data storage unit and are stored at a data pipeline data storage unit. An update process is initiated, based on an update policy associated with a particular tenant. During the update process, one or more application events associated with the particular tenant are selected from among the plurality of application events stored at the data pipeline data storage unit. Data associated with the one or more selected application events is selected from the source data storage unit. Data selected from the source data storage unit is stored at a target data storage unit. By applying the update policy, for the particular tenant, target data of the particular tenant at the target data storage unit in combination with event data of the one or more application events is continually consistent with source data of the particular tenant at the source data storage unit.