Research on the method of cross-cluster migration of bank’s massive valuable data

摘要

This paper starts with the problems faced by the big data platform of a bank, and takes a large commercial bank as an example, analyzes the urgent security management problems that bank needs to solve, clarifies the tasks that different types of Hive tables need to be migrated across clusters, puts forward the methods of seamless migration of banking data across clusters and components, and then focuses on data migration across clusters. Finally, it summarizes the implementation process from the implementation effect and impact, and introduces a tool to improve the efficiency of data synchronization, which paves the way for the technical upgrading of commercial banks.