Cultural advice

The Australian National University acknowledges, celebrates and pays our respects to the Ngunnawal and Ngambri people of the Canberra region and to all First Nations Australians on whose traditional lands we meet and work, and whose cultures are among the oldest continuing cultures in human history.

Aboriginal and Torres Strait Islander peoples are advised that ANU Library collections may include images, names, voices, and other representations of deceased persons.

Material in the collection may contain terms, language or views that reflect the period in which the item was created and may be considered inappropriate today.

Accelerated training of conditional random fields with stochastic gradient methods

dc.contributor.authorVishwanathan, S
dc.contributor.authorSchraudolph, Nicol
dc.contributor.authorSchmidt, Mark W.
dc.contributor.authorMurphy, Keven P.
dc.coverage.spatialPittsburgh USA
dc.date.accessioned2015-12-07T22:38:49Z
dc.date.createdJune 25-29 2006
dc.date.issued2006
dc.date.updated2015-12-07T10:41:57Z
dc.description.abstractWe apply Stochastic Meta-Descent (SMD), a stochastic gradient optimization method with gain vector adaptation, to the training of Conditional Random Fields (CRFs). On several large data sets, the resulting optimizer converges to the same quality of solution over an order of magnitude faster than limited-memory BFGS, the leading method reported to date. We report results for both exact and inexact inference techniques.
dc.identifier.isbn1595933832
dc.identifier.urihttp://hdl.handle.net/1885/23596
dc.publisherAssociation for Computing Machinery Inc (ACM)
dc.relation.ispartofseriesInternational Conference on Machine Learning (ICML 2006)
dc.sourceProceedings of 23rd International Conference of Machine Learning
dc.source.urihttp://shop.omnipress.com/icml/toc.pdf
dc.subjectKeywords: Convergence of numerical methods; Data reduction; Learning systems; Optimization; Conditional Random Fields (CRF); Data sets; Stochastic gradient optimization; Stochastic Meta Descent (SMD); Random processes
dc.titleAccelerated training of conditional random fields with stochastic gradient methods
dc.typeConference paper
local.bibliographicCitation.lastpage976
local.bibliographicCitation.startpage969
local.contributor.affiliationVishwanathan, S, College of Engineering and Computer Science, ANU
local.contributor.affiliationSchraudolph, Nicol, College of Engineering and Computer Science, ANU
local.contributor.affiliationSchmidt, Mark W., University of British Columbia
local.contributor.affiliationMurphy, Keven P., University of British Columbia
local.contributor.authoruidVishwanathan, S, a204054
local.contributor.authoruidSchraudolph, Nicol, a205905
local.description.embargo2037-12-31
local.description.notesImported from ARIES
local.description.refereedYes
local.identifier.absfor080109 - Pattern Recognition and Data Mining
local.identifier.ariespublicationu8803936xPUB27
local.identifier.scopusID2-s2.0-33749243756
local.type.statusPublished Version

Downloads

Original bundle

Now showing 1 - 3 of 3
Loading...
Thumbnail Image
Name:
01_Vishwanathan_Accelerated_training_of_2006.pdf
Size:
112.75 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
02_Vishwanathan_Accelerated_training_of_2006.pdf
Size:
249.57 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
03_Vishwanathan_Accelerated_training_of_2006.pdf
Size:
1.54 MB
Format:
Adobe Portable Document Format