Can Machine-Learning Apply to Musical Ensembles?

Abstract

In this paper we ask whether machine learning can apply to musical ensembles as well as it does to the individual musical interfaces that are frequently demonstrated at NIME and CHI. While using machine learning to map individual gestures and sensor data to musical output is becoming a major theme of computer music research, these techniques are only rarely applied to ensembles as a whole. We have developed a server-based system that tracks the touch-data of an iPad ensemble and have used such techniques to identify touch-gestures and to characterise ensemble interactions in real-time. We ask whether further analysis of this data can reveal unknown dimensions of collaborative musical interaction and enhance the experience of performers.