Comparison of activation functions in a shallow convolutional neural network for natural image sharpness assessment

摘要

Our previous study proposed a shallow convolutional neural network (CNN) to quantify the sharpness of natural images. The network utilized a multilayer perceptron (MLP) as its regression function in the full-connection layer. In this paper, we make use of a polynomial mapping (the logistic map, LM) as the regression function in the natural image sharpness assessment (NISA). First, the coefficient of logistic map is experimentally determined based on the database of LIVE-Ⅱ. Then, the prediction performance is evaluated on Gaussian blurred images from CSIQ and TID2013. After that, three regression functions, LM, BCF (the basic cubical function) and MLP, are evaluated with Pearson linear correlation coefficient (PLCC) and Spearman rank-order correlation coefficient (SROCC). In addition, eleven state-of-the-art NISA models are compared. Based on the same shallow CNN architecture, experimental results indicate that MLP achieves the best performance, followed by BCF and LM. Furthermore, its performance is rival to or better than other NISA models. Conclusively, in comparison to LM and BCF, MLP is relatively better as a regression function for automatic network optimization and numerical regression. Meanwhile, it achieves the state-of-the-art performance in NISA task.