THE APPLICATION OF OPEN SOURCE CLOUD COMPUTING TECHNOLOGIES ON FLOATING CAR DATA MANAGEMENT SYSTEM - A CASE STUDY ON CENNAVI TECHNOLOGIES CO., LTD, BEIJING

摘要

Floating Car Data (FCD) is a data source of the Real-time traffic information system, in some scenarios FCD processing models require months of historical data to do comparisons and predictions. Consequently, it may take several hours or even several days to compute the data source by using the traditional single machine technologies because months of data may sum up to hundreds of gigabytes. Cloud computing technologies are designed to store and process large-scale data in an efficient way. Hadoop and HBase which have been successfully used in Yahoo’s products are excellent open source cloud computing projects. Based on distributed computing and parallel computing technologies, Hadoop and HBase distribute computation and storage tasks across a group of computers, and each computer only takes several minutes to finish its tasks. Data intensive FCD process models therefore can be processed efficiently by this way. This paper is a case study of using Hadoop and HBase to manage and process FCD data in CenNavi Co, Ltd.