Lattimore, Tor; Hutter, Marcus; Sunehag, Peter
Bayesian sequence prediction is a simple technique for predicting future symbols sampled from an unknown measure on infinite sequences over a countable alphabet. While strong bounds on the expected cumulative error are known, there are only limited results on the distribution of this error. We prove tight high-probability bounds on the cumulative error, which is measured in terms of the Kullback-Leibler (KL) divergence. We also consider the problem of constructing upper confidence bounds on the...[Show more]
Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.