1991Unpublished venueRequires access

On the nonexistence of local minima of the backpropagation error surfaces

Xiao-Hu Yu

Open publisher page 1 citations

Abstract

It is shown from a theoretical point of view that, if a backpropagation neural network satisfies the Kolmogorov theorem (implying that the backpropagation neural network can form arbitrarily continuous mappings), the error surface does not have any local minima with an error level higher than that of the global ones. Formulas for calculating the exact value of the global minima are also provided, which are especially useful for monitoring the training process.>

About this research paper

What this paper is about

It is shown from a theoretical point of view that, if a backpropagation neural network satisfies the Kolmogorov theorem (implying that the backpropagation neural network can form arbitrarily continuous mappings), the error surface does not have any local minima with an error level higher than that of the global ones. Formulas for calculating the exact value of the global minima are also provided, which are especially useful for monitoring the training process.>

Why it matters

OpenAlex reports 1 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

It is shown from a theoretical point of view that, if a backpropagation neural network satisfies the Kolmogorov theorem (implying that the backpropagation neural network can form arbitrarily continuous mappings), the error surface does not have any local minima with an error level higher than that of the global ones. Formulas for calculating the exact value of the global minima are also provided, which are especially useful for monitoring the training process.>

Key concepts: Backpropagation, Maxima and minima, Artificial neural network, Point (geometry), Process (computing), Computer science, Mathematics, Algorithm

Related papers

Back to paper searchBrowse research topicsOriginal source
On the nonexistence of local minima of the backpropagation error surfaces — Research Paper | ScholarLens