Open Research will be updating the system on Monday, 25 May 2026, from 8:15 to 8:45 AM. We apologise for any inconvenience caused.

Sparse kernel-SARSA(lambda) with an eligibility trace

dc.contributor.authorRobards, Matthew
dc.contributor.authorSunehag, Peter
dc.contributor.authorSanner, Scott
dc.contributor.authorMarthi, Bhaskara
dc.coverage.spatialAthens Greece
dc.date.accessioned2015-12-13T22:58:18Z
dc.date.createdSeptember 5-9 2011
dc.date.issued2011
dc.date.updated2016-02-24T08:39:02Z
dc.description.abstractWe introduce the first online kernelized version of SARSA(λ) to permit sparsification for arbitrary λ for 0 ≤ λ ≤ 1; this is possible via a novel kernelization of the eligibility trace that is maintained separately from the kernelized value functio
dc.identifier.isbn9783642237799
dc.identifier.urihttp://hdl.handle.net/1885/83410
dc.publisherSpringer
dc.relation.ispartofseriesMachine Learning and Knowledge Discovery in Databases European Conference (ECML PKDD 2011)
dc.sourceProceedings of Machine Learning and Knowledge Discovery in Databases - European Conference (ECML PKDD 2011)
dc.subjectKeywords: Basis functions; Capacity control; Eligibility traces; Functional structure; Kernelization; Memory efficiency; Projection techniques; Sparse kernels; Sparsification; Value functions; Learning systems
dc.titleSparse kernel-SARSA(lambda) with an eligibility trace
dc.typeConference paper
local.bibliographicCitation.lastpage17
local.bibliographicCitation.startpage1
local.contributor.affiliationRobards, Matthew, College of Engineering and Computer Science, ANU
local.contributor.affiliationSunehag, Peter, College of Engineering and Computer Science, ANU
local.contributor.affiliationSanner, Scott, College of Engineering and Computer Science, ANU
local.contributor.affiliationMarthi, Bhaskara, Willow Garage Inc.
local.contributor.authoruidRobards, Matthew, u4583807
local.contributor.authoruidSunehag, Peter, u4753099
local.contributor.authoruidSanner, Scott, u1817461
local.description.embargo2037-12-31
local.description.notesImported from ARIES
local.description.refereedYes
local.identifier.absfor080109 - Pattern Recognition and Data Mining
local.identifier.absfor080303 - Computer System Security
local.identifier.ariespublicationf5625xPUB11671
local.identifier.doi10.1007/978-3-642-23808-6_1
local.identifier.scopusID2-s2.0-80052398950
local.type.statusPublished Version

Downloads

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
01_Robards_Sparse_kernel-SARSA(lambda)_2011.pdf
Size:
454.8 KB
Format:
Adobe Portable Document Format