Skip navigation
Skip navigation

Tracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices

Open Access

link to publisher version

Martin, Charles; Gardner, Henry; Swift, Ben

Description

We present and evaluate a novel interface for tracking ensemble performances on touch-screens. The system uses a Random Forest classifier to extract touch-screen gestures and transition matrix statistics. It analyses the resulting gesture-state sequences across an ensemble of performers. A series of specially designed iPad apps respond to this real-time analysis of free-form gestural performances with calculated modifications to their musical interfaces. We describe our system and evaluate it...[Show more]

dc.contributor.authorMartin, Charles
dc.contributor.authorGardner, Henry
dc.contributor.authorSwift, Ben
dc.date.accessioned2016-06-06T05:58:37Z
dc.date.available2016-06-06T05:58:37Z
dc.identifier.citationC. Martin, H. Gardner, and B. Swift, “Tracking ensemble performance on touch-screens with gesture classification and transition matrices,” in Proceedings of the International Conference on New Interfaces for Musical Expression, Baton Rouge, Louisiana, USA, 2015, pp. 359-364.
dc.identifier.issn2220-4806
dc.identifier.urihttp://hdl.handle.net/1885/102045
dc.description.abstractWe present and evaluate a novel interface for tracking ensemble performances on touch-screens. The system uses a Random Forest classifier to extract touch-screen gestures and transition matrix statistics. It analyses the resulting gesture-state sequences across an ensemble of performers. A series of specially designed iPad apps respond to this real-time analysis of free-form gestural performances with calculated modifications to their musical interfaces. We describe our system and evaluate it through cross-validation and profiling as well as concert experience.
dc.publisherNew Interfaces for Musical Expression
dc.relation.ispartofProceedings of the International Conference on New Interfaces for Musical Expression
dc.rightsCopyright remains with the authors.
dc.source.urihttp://www.nime.org/proceedings/2015/nime2015_242.pdf
dc.subjectmobile music
dc.subjectensemble performance
dc.subjectmachine learning
dc.subjecttransition matrices
dc.subjectgesture
dc.subjectcomputer music
dc.subjectnew interfaces for musical expression
dc.titleTracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices
dc.typeConference paper
dc.date.issued2015-05-31
local.publisher.urlhttp://nime.org
local.type.statusPublished Version
local.contributor.affiliationMartin, C., Research School of Computer Science, The Australian National University
local.contributor.affiliationGardner, H., Research School of Computer Science, The Australian National University
local.contributor.affiliationSwift, B., Research School of Computer Science, The Australian National University
local.bibliographicCitation.startpage359
local.bibliographicCitation.lastpage364
dcterms.accessRightsOpen Access
CollectionsANU Research Publications

Download

There are no files associated with this item.
Show simple item record


Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  19 May 2020/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator