基于消息中间件的非结构化数据同步

摘要

For the synchronization of the unstructured data of heterogeneous storage between different nodes,a method for data synchronization based on message middleware is proposed and realized.The paper first discusses the framework of the unstructured data synchronization system,then describes the message transmission principle for data synchronization and the way to capture updated messages,and finally presents the corresponding technical solutions to the classified malfunctions during the operation. The tests demonstrate the feasibility and rationality of the technical solutions.Comprehensive analysis and practices show that the system can shield the heterogenity of data storage,and has good scalability and a certain degree of reliability.%解决不同数据节点间异构数据源存储的非结构化数据的同步问题,提出了基于消息中间件的数据同步方法并加以实现.文中讨论了非结构化数据同步系统的架构,提出了数据同步的消息传输和更新消息的捕获方法,并针对系统运行过程中可能出现的运行故障进行了分类研究,提出了相应的可靠性技术方案.通过测试证明该技术方案的可行性和合理性.综合分析及实践表明,该系统能够屏蔽数据存储的异构性、具有良好的扩展性和一定的可靠性.