基于气象应用的私有云存储方案

摘要

为解决气象观察数据的频繁写入和大数据存储的问题，设计私有云存储模型。该模型分为用户访问接口层、元数据存储层、实体数据存储层和关系数据库4层结构。采用HDFS集群分布式文件系统，实现气象大数据的存储和高效查询与搜索业务；使用关系数据库系统，实现数据采集端频繁数据写入的业务。实验结果表明，该平台实现了海量气象数据存储、查询统计和属性管理，克服了云存储单条插入效率低的缺点，较好满足了气象部门大数据存储和管理的需求。%To solve the problem of frequent meteorological observation data-write-in and data storage,a private cloud storage model was designed consisting of four layers:user access interface layer,meta-data storage layer,entity data storage layer and a relational database layer.Hadoop distributed file system was adopted to implement the meteorological data storage as well as ef-ficient query and search business.Relational database was used to realize frequent data writing of data collection extremity.Re-sults from experiments illustrate that this system not only achieves massive meteorological data storage,query and attribute ma-nagement,but overcomes the shortcomings of single insertion inefficiency.It meets the requirements of the data storage and management of meteorological departments.