Asymptotics of discrete (MDL) for online prediction
Minimum description length (MDL) is an important principle for induction and prediction, with strong relations to optimal Bayesian learning. This paper deals with learning processes which are independent and identically distributed (i.i.d.) by means of two-part MDL, where the underlying model class is countable. We consider the online learning framework, i.e., observations come in one by one, and the predictor is allowed to update its state of mind after each time step. We identify two ways of...[Show more]
|ANU Research Publications
|IEEE Transactions on Information Theory
|Request a copy
Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.