[1] |
Hassell M P, Lawton J H, Beddington J R. Sigmoid functional responses by invertebrate predators and parasitoids [J]. The Journal of Animal Ecology, 1977: 249-262. |
[2] |
Kalman B L, Kwasny S C. Why tanh: Choosing a sigmoidal function[C]//Proceedings 1992IJCNN International Joint Conference on Neural Networks. IEEE, 1992, 4: 578-581. |
[3] |
Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks [J]. Communications of the ACM, 2017, 60(6): 84-90. doi: 10.1145/3065386 |
[4] |
Dubey A K, Jain V. Comparative study of convolution neural network’s relu and leaky-relu activation functions[M]//Applications of Computing, Automation and Wireless Systems in Electrical Engineering, 2019: 873-880. |
[5] |
He K, Zhang X, Ren S, et al. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification[C]//Proceedings of the IEEE International Conference on Computer Vision. 2015: 1026-1034. |
[6] |
Clevert D A, Unterthiner T, Hochreiter S. Fast and accurate deep network learning by exponential linear units (elus) [J]. arXiv preprint arXiv, 2015: 1511.07289. |
[7] |
Shi Qi. Research and verification of image classification optimization algorithm based on convolutional neural network[D]. Beijing: Beijing Jiaotong University, 2017. (in Chinese) |
[8] |
Wang Hongxia, Zhou Jiaqi, Gu Chenghao, et al. Design of activation functions in convolutional neural networks for image classification [J]. Journal of Zhejiang University (Engineering Science), 2019, 53(7): 1363-1373. (in Chinese) |
[9] |
Zhang X, Zou Y, Shi W. Dilated convolution neural network with LeakyReLU for environmental sound classification[C]//2017 22nd International Conference on Digital Signal Processing (DSP). IEEE, 2017: 1-5. |
[10] |
Xu L, Choy C, Li Y W. Deep sparse rectifier neural networks for speech denoising[C]//2016 IEEE International Workshop on Acoustic Signal Enhancement (IWAENC). IEEE, 2016: 1-5. |
[11] |
Liu Jun. Analysis of algorithm design and algorithm time complexity [J]. Computer Knowledge and Technology, 2008, 2(14): 878-879. (in Chinese) |
[12] |
Liu X, Zhang Y, Bao F. Kernel-blending connection approximated by a neural network for image classification [J]. Computational Visual Media, 2020, 6(4): 467-476. doi: 10.1007/s41095-020-0181-9 |
[13] |
Carrier P L, Courville A, Mirza M, et al. Challenges in representation learning: A report on three machine learning contests[C]//International Conference on Neural Information Processing, 2013: 117-124. |
[14] |
Wang H, Zhou J, Gu C, et al. Design of activation function in CNN for image classification [J]. Journal of ZheJiang University (Engineering Science), 2019, 53(7): 1363-1373. |