Karatzoglou, Alexandros; Vishwanathan, S; Schraudolph, Nicol; Smola, Alexander
We present an online Support Vector Machine (SVM) that uses Stochastic Meta-Descent (SMD) to adapt its step size automatically. We formulate the online learning problem as a stochastic gradient descent in Reproducing Kernel Hubert Space (RKHS) and translate SMD to the nonparametric setting, where its gradient trace parameter is no longer a coefficient vector but an element of the RKHS. We derive efficient updates that allow us to perform the step size adaptation in linear time. We apply the...[Show more]
Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.