DISTRIBUTED LEARNING METHOD AND DISTRIBUTED LEARNING DEVICE

摘要

To suppress a decrease in recognition accuracy, and to provide a method and apparatus for realizing easy distributed learning adjustment of a hyperparameter while achieving a high compression ratio.SOLUTION: The distributed learning device 10 executes a gradient calculation procedure 101 for calculating the slope of an error function for each of the plurality of parameters; a statistical calculation procedure 102 for calculating the statistics for each parameter grouping a plurality of parameters; a determination procedure 103 for determining the transmission parameter group to which the gradient is transmitted based on the statistics and the preset transmissions ratio, and a gradient of the error function for the parameters included in the transmission parameter group; a shared procedure 105 shared between a plurality of computers by population communication using the gradient average; and an update procedure 106 for updating the parameters included in the transmission parameter group using a gradient average that shows the average of the slope calculated on multiple computers.SELECTED DRAWING: Figure 3