Skip navigation
Skip navigation

Tracing from Sound to Movement with Mixture Density Recurrent Neural Networks

Wallace, Benedikte; Martin, Charles Patrick; Nymoen, Kristian


In this work, we present a method for generating sound-tracings using a mixture density recurrent neural network (MDRNN). A sound-tracing is a rendering of perceptual qualities of short sound objects through body motion. The model is trained on a dataset of single point sound-tracings with multimodal input data and learns to generate novel tracings. We use a second neural network classifier to show that the input sound can be identified from generated tracings. This is part of an ongoing...[Show more]

CollectionsANU Research Publications
Date published: 2019
Type: Conference paper
Book Title: 6th International Conference on Movement and Computing (MOCO ’19)
DOI: 10.1145/3347122.3371376


File Description SizeFormat Image
2019-Wallace-TracingSoundToMovement.pdfConference Article943.17 kBAdobe PDF    Request a copy

Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.

Updated:  17 November 2022/ Responsible Officer:  University Librarian/ Page Contact:  Library Systems & Web Coordinator