Automated wavelet-based data compression systems and methods

摘要

Systems and methods for processing online data are disclosed. One such method includes receiving a plurality of data points in a time-series at a short term storage. The method also includes calculating at least one approximation coefficient based on the plurality of data points using a wavelet transform, including calculating a highest level approximation coefficient, and calculating estimated value based on the highest level approximation coefficient. The method further includes calculating differences between the estimated value and the plurality of data points of the short term storage, and determining whether a maximum difference among the calculated differences is less than a predetermined threshold. The method further includes, based on the maximum difference being greater than or equal to the predetermined threshold, storing the oldest data point of the short term storage in a long term storage.