DISTRIBUTED STORAGE METHOD AND ARCHITECTURE FOR GENE VARIATION DATA

摘要

A distributed storage method and architecture for gene variation data. The method comprises a distributed data storage process, a distributed bitmap index creation process, and a distributed query and retrieval process. The architecture comprises a distributed column storage module, a distributed bitmap index module, and a query and retrieval module. In the method, data distributed storage is performed by using a new column-type storage engine kudu, and distributed local bitmap indexes are established for sample columns, accordingly, the problem of low random data access performance of an existing HDFS solution is effectively resolved; the problem of poor batch analysis performance of an HBase solution is resolved; a storage architecture model is simplified; the limitation problem of dependence of a genotype query tool on multiple tools is resolved; and by means of a distributed local bitmap index solution, high concurrency is implemented and the expandability is improved.