On the nonexistence of local minima of the backpropagation error surfaces
Xiao-Hu Yu
Abstract
Xiao-Hu Yu
Abstract
It is shown from a theoretical point of view that, if a backpropagation neural network satisfies the Kolmogorov theorem (implying that the backpropagation neural network can form arbitrarily continuous mappings), the error surface does not have any local minima with an error level higher than that of the global ones. Formulas for calculating the exact value of the global minima are also provided, which are especially useful for monitoring the training process.>
OpenAlex reports 1 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
It is shown from a theoretical point of view that, if a backpropagation neural network satisfies the Kolmogorov theorem (implying that the backpropagation neural network can form arbitrarily continuous mappings), the error surface does not have any local minima with an error level higher than that of the global ones. Formulas for calculating the exact value of the global minima are also provided, which are especially useful for monitoring the training process.>
Key concepts: Backpropagation, Maxima and minima, Artificial neural network, Point (geometry), Process (computing), Computer science, Mathematics, Algorithm