Combination of Convolutional and Generative Adversarial Networks for Defect Image Demoiréing of Thin-Film Transistor Liquid-Crystal Display Image

摘要

In thin-film transistor liquid crystal display (TFT-LCD) manufacturing, the automatic recognition and classification of defects can help manufacturers monitor abnormalities, identify potential process problems, and swiftly respond to these process problems. Thus, yield loss can be reduced. However, capturing the content displayed on screen using cameras is challenging because it is often contaminated with moire patterns. Moire patterns originate from the interference between the pixel grids of inspection camera sensors and panel screens and adversely affect the visual quality of images, causing difficulty in determining the defect type, especially mura defects. Therefore, eliminating moire patterns in defect images without impairing image quality is critical. However, moire patterns are often dynamic and vary with sensor resolution, distance, and direction. Moreover, the frequency distribution of moire patterns is broad, encompassing both low- and high-frequency components. Therefore, demoireing is more challenging than other image restoration tasks. We investigated this problem and proposed an approach to eliminate moire patterns from defect images based on a generative adversarial network architecture by using the U-net network as a generator and adding a discriminator. Moreover, we added an attention mechanism to focus on the local consistency of the restored moire regions. The peak-signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) obtained using the proposed model were compared with those obtained using the U-net and pixel-to-pixel models. The experimental results of this study demonstrated that the proposed method can efficiently remove moire patterns from defect images, and the proposed method quantitatively and qualitatively outperforms other methods.