Weakly supervised learning via statistical sufficiency
Download (4.63 MB)
-
Altmetric Citations
Description
The Thesis introduces a novel algorithmic framework for weakly supervised learn- ing, namely, for any any problem in between supervised and unsupervised learning, from the labels standpoint. Weak supervision is the reality in many applications of machine learning where training is performed with partially missing, aggregated- level and/or noisy labels. The approach is grounded on the concept of statistical suf- ficiency and its transposition to loss functions....[Show more]
dc.contributor.author | Patrini, Giorgio | |
---|---|---|
dc.date.accessioned | 2017-05-29T01:57:23Z | |
dc.date.available | 2017-05-29T01:57:23Z | |
dc.identifier.other | b43751945 | |
dc.identifier.uri | http://hdl.handle.net/1885/117067 | |
dc.description.abstract | The Thesis introduces a novel algorithmic framework for weakly supervised learn- ing, namely, for any any problem in between supervised and unsupervised learning, from the labels standpoint. Weak supervision is the reality in many applications of machine learning where training is performed with partially missing, aggregated- level and/or noisy labels. The approach is grounded on the concept of statistical suf- ficiency and its transposition to loss functions. Our solution is problem-agnostic yet constructive as it boils down to a simple two-steps procedure. First, estimate a suffi- cient statistic for the labels from weak supervision. Second, plug the estimate into a (newly defined) linear-odd loss function and learn the model by any gradient-based solver, with a simple adaptation. We apply the same approach to several challeng- ing learning problems: (i) learning from label proportions, (ii) learning with noisy labels for both linear classifiers and deep neural networks, and (iii) learning from feature-wise distributed datasets where the entity matching function is unknown. | |
dc.language.iso | en | |
dc.subject | machine learning | |
dc.subject | weakly supervised learning | |
dc.subject | sufficient statistics | |
dc.subject | learning theory | |
dc.subject | noisy label | |
dc.subject | deep learning | |
dc.title | Weakly supervised learning via statistical sufficiency | |
dc.type | Thesis (PhD) | |
local.contributor.supervisor | Nock, Richard | |
local.contributor.supervisorcontact | richard.nock@data61.csiro.au | |
dcterms.valid | 2017 | |
local.description.notes | the author deposited 29/05/17 | |
local.type.degree | Doctor of Philosophy (PhD) | |
dc.date.issued | 2016 | |
local.contributor.affiliation | ANU College of Engineering & Computer Science, The Australian National University | |
local.identifier.doi | 10.25911/5d723bc2607e3 | |
local.mintdoi | mint | |
Collections | Open Access Theses |
Download
File | Description | Size | Format | Image |
---|---|---|---|---|
Patrini Thesis 2017.pdf | 4.63 MB | Adobe PDF |
Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.
Updated: 17 November 2022/ Responsible Officer: University Librarian/ Page Contact: Library Systems & Web Coordinator