Distributed Intelligence to Transform 'Uncertain Big Data' into 'Valuable Data'

摘要

Big data shows great promise to provide deep insights and create tremendous new value for many different uses. However, in order to realize this promise, important obstacles must be overcome. Often, big data is noisy and inconsistent. Privacy and confidentiality must be assured. Data from different sources must be integrated, and deep analytics must be applied to drive business value. In this paper, an ITS common platform to transform uncertain big data into valuable data by integrating several intelligences such as a streaming process with embedded analytics, an automated ETL (Extract, Transform and Load) process to create application specific data marts with privacy preservation technologies, and interfaces to access the platform are discussed.