A novel in situ compression method for CFD data based on generative adversarial network

摘要

As one of the main technologies of in situ visualization, data compression plays a key role in solving I/O bottleneck and has been intensively studied. However, existing methods take too much compression time to meet the requirement of in situ processing on computational fluid dynamics (CFD) flow field data. To address this problem, we introduce deep learning into CFD data compression and propose a novel in situ compression method based on generative adversarial network (GAN) in this paper. In specific, the proposed method samples small patches from CFD data and trains a GAN which includes two convolutional neural networks: the discriminative network and the generative network. The discriminative network is responsible for compressing data on compute nodes, while the generative network is used to reconstruct data on visualization nodes. Compared with the existing CFD data compression methods, our method has great advantages in compression time and manages to adjust compression ratio according to acceptable reconstruction effect, showing its applicability for loosely coupled in situ visualization. Extensive experimental results demonstrate the good generalization of the proposed method on many datasets.