空间光学技术研究室知识库

In the convolutional neural network model, the learning rate represents the magnitude of the neural network parameters that change at each iteration. When the learning rate is too high, the loss function will oscillate without converging. When the learning rate is too low, the loss function converges slowly. How to set the appropriate value of the learning rate becomes an important issue. Based on the learning rate annealing algorithm, this paper sets the segmentation attenuation and adds periodic pulse perturbation. The learning rate gradually declines and rises at the end of the cycle, and then continues to fall. This prevents the network from oscillating at a local minimum or saddle point in the late training period due to the low learning rate [1]. Finally, this paper verifies the method in the application of ethnic clothing classification using the transfer learning VGG-16 model. © COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.