A strategy for continuously big capacity data transmit/receive process handling in real-time

摘要

The real time online analysis system that works under the network condition needs to synchronize and harmonize data transmit/receive process and the data handler, especially when facing huge capacity data with at a high transmit/receive/handle speed. Combined with practical experience, the paper puts forward a circular data buffer cache technology and a multi-threading message passing mechanism. The core of the solution is to: (1) usage of data cache and multi-threading technology to make the data transmit/receive process running at a high speed; (2) take the data cache as a connection bridge to link the data transition and reception two processes by message passing mechanisms with an interactive scheduling management, thus the two processes stand-alone that are closely interrelated may be able to run simultaneously in one system completed the required work, not only interrelated, but also interact with each other. In the end of the paper, an example of real-time flying objects monitoring system is presented to illustrate the feasibility and the practicability of the technique, and the result shows that the strategy for continuously big capacity data transmit/receive process handling in real-time can boost the efficiency and speed of data access, enhancing data security and the whole system adaptability.