基于 Hadoop 技术的批量录波数据高性能处理方法

摘要

This paper describes the characteristics and causes of batch wave recording data, analyses the existing treatments and shortcomings, proposes Hadoop-based virtualized and distributed technologies to improve and optimize the performance of Main Sta-tion System, which adopts communications service matrix to replace the originally single server mode to Carry batch data processing tasks, in order to ensure a integral load balance of the main station system, effectively reduce the CPU load rate.%介绍了批量录波数据的特点及产生原因，分析了现有应对措施及存在不足，并提出基于Hadoop虚拟化和分布式技术改善和优化主站性能的方法，采用通信服务矩阵替代原双重化模式下单一服务器来承载批量数据处理任务，保证了主站系统整体负载平衡，有效降低了CPU负荷率。