Local Minima and Attractors at Infinity in Gradient Descent Learning Algorithms

Abstract

In the paper 'Learning Nonlinearly Parametrized Decision Regions", an online scheme for learning a very general class of decision regions is given, together with conditions on both the parametrization and on the sequence of input examples under which good learning can be guaranteed to occur. In this paper, we discuss these conditions, in particular the requirement that there be no non-global local minima of the relevant error function, and the more speci c problem of no attractor at in nity. Somewhat simpler su cient conditions are given. A number of examples are discussed. Show more