Skip navigation
Skip navigation

On the Dual Formulation of Boosting Algorithms

Shen, Chunhua; Li, Hanxi


We study boosting algorithms from a new perspective. We show that the Lagrange dual problems of l1-norm-regularized AdaBoost, LogitBoost, and soft-margin LPBoost with generalized hinge loss are all entropy maximization problems. By looking at the dual problems of these boosting algorithms, we show that the success of boosting algorithms can be understood in terms of maintaining a better margin distribution by maximizing margins and at the same time controlling the margin variance. We also...[Show more]

CollectionsANU Research Publications
Date published: 2010
Type: Journal article
Source: IEEE Transactions on Pattern Analysis and Machine Intelligence
DOI: 10.1109/TPAMI.2010.47


File Description SizeFormat Image
01_Shen_On_the_Dual_Formulation_of_2010.pdf3.52 MBAdobe PDF    Request a copy

Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  19 May 2020/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator