No Free Lunch versus Occam’s Razor in supervised learning
| dc.contributor.author | Lattimore, Tor | |
| dc.contributor.author | Hutter, Marcus | |
| dc.date.accessioned | 2015-08-19T05:42:55Z | |
| dc.date.available | 2015-08-19T05:42:55Z | |
| dc.date.issued | 2011-11 | |
| dc.description.abstract | The No Free Lunch theorems are often used to argue that domain specific knowledge is required to design successful algorithms. We use algorithmic information theory to argue the case for a universal bias allowing an algorithm to succeed in all interesting problem domains. Additionally, we give a new algorithm for off-line classification, inspired by Solomonoff induction, with good performance on all structured (compressible) problems under reasonable assumptions. This includes a proof of the efficacy of the well-known heuristic of randomly selecting training data in the hope of reducing the misclassification rate. | en_AU |
| dc.identifier.isbn | 978-3-642-44957-4 | en_AU |
| dc.identifier.issn | 0302-9743 | en_AU |
| dc.identifier.uri | http://hdl.handle.net/1885/14800 | |
| dc.publisher | Springer Verlag | en_AU |
| dc.relation | http://purl.org/au-research/grants/arc/DP0988049 | en_AU |
| dc.relation.ispartof | Algorithmic Probability and Friends. Bayesian Prediction and Artificial Intelligence: Papers from the Ray Solomonoff 85th Memorial Conference, Melbourne, VIC, Australia, November 30 – December 2, 2011 | en_AU |
| dc.rights | © Springer-Verlag Berlin Heidelberg 2013. http://www.sherpa.ac.uk/romeo/issn/0302-9743/..."Author's post-print on any open access repository after 12 months after publication" from SHERPA/RoMEO site (as at 19/08/15) | en_AU |
| dc.subject | Supervised Learning | en_AU |
| dc.subject | Kolmogorov complexity | en_AU |
| dc.subject | Occam's Razor | en_AU |
| dc.subject | No Free Lunch | en_AU |
| dc.title | No Free Lunch versus Occam’s Razor in supervised learning | en_AU |
| dc.type | Conference paper | en_AU |
| local.bibliographicCitation.lastpage | 235 | en_AU |
| local.bibliographicCitation.startpage | 223 | en_AU |
| local.contributor.affiliation | Lattimore, T., Research School of Computer Science, The Australian National University | en_AU |
| local.contributor.affiliation | Hutter, M., Research School of Computer Science, The Australian National University | en_AU |
| local.contributor.authoruid | u4350841 | en_AU |
| local.identifier.citationvolume | 7070 | en_AU |
| local.identifier.doi | 10.1007/978-3-642-44958-1_17 | en_AU |
| local.type.status | Accepted Version | en_AU |