A method of face repair based on encoder-decoder and dual discrimination network

摘要

Neural networks have made significant achievements in the field of image restoration. To efficiently repair facial images with large areas damaged, a decoder-encoder structured convolutional neural network is used as a generative model and skip-connection is added between some of its layers to enhance the structure prediction ability of the generated model and well suppressed the problem that the repair network is easy to over-fitting. The global discrimination network mostly uses the image's edge structure and feature information to ensure that the repaired image, which is the output from the repair network, conforms to visual connectivity, while the local discriminators, not only recognize local consistency but also optimize more details. The network structure proposed in this paper combines the encoder-decoder, skip-connection, and dual discriminator networks to improve the effect of face completion. The experimental results on the CelebA show that the proposed method is superior to other methods in repairing images with large areas of damage.