Seminar UC Berkeley, CNMAT

by Baptiste Caramiaux3828 Comments

MOVEMENT AND SOUND INTERACTION: A RESEARCH OVERVIEW FROM MUSIC PERFORMANCE TO MOTOR COGNITION

We are giving a seminar on Friday, May 6, 2016, 6:30pm to 8:30pm. 

http://cnmat.berkeley.edu/event/2016/05/06/movement_and_sound_interaction_research_overview_music_performanc

Frédéric Bevilacqua, IRCAM (France)
Baptiste Caramiaux, McGill University (Canada) and IRCAM (France)

Mr. Bevilacqua and Mr. Caramiaux will present an overview of research on movement and sound interaction reporting on experiments in music performance, sonic interaction design, and motor cognition. Early works on augmented musical instruments developed in collaboration with composers will be discussed and demonstrated. This research has led the team to explore novel interaction designs with digital sounds through tangible interfaces and participatory methodologies. This research advocates for a computational design approach involving physical models, probabilistic models and data-driven machine learning algorithms. Current work involves exploring the use of these methods to analyze motor learning and control in music performance with applications in rehabilitation and pedagogy.

Frédéric Bevilacqua is the head of the Sound Music Movement Interaction team at IRCAM in Paris. His research concerns the modeling and the design of interactions between movement and sound, and the development of gesture-based interactive systems. He holds a master degree in physics and a Ph.D. in Biomedical Optics from EPFL in Lausanne. He also studied music at the Berklee College of Music in Boston (1992-93) and has participated in different music and media arts projects. From 1999 to 2003 he was a researcher at the Beckman Laser Institute at the University of California Irvine. In 2003 he joined IRCAM as a researcher on gesture analysis for music and performing arts.

Baptiste Caramiaux is a Marie Sklodowska-Curie Research Fellow at McGill University (Canada) and IRCAM (France). His work focuses on new ways to interact with machines through movements by leveraging on machine learning algorithms and motor cognition. He has conducted post-doctoral research at Goldsmiths University of London, and research consultancy for the London-based music startup Mogees. Baptiste holds a PhD in Computer Science from University Pierre et Marie Curie (Paris 6) and IRCAM.

Seminar at CIRMMT

by Baptiste Caramiaux5662 Comments

The CIRMMT is the Centre for Interdisciplinary Research in Music Media and Technology, housed at the Schulich School of Music at McGill University. This seminar was a review of past work in movement-computer interaction and how this research led to the MIM project.

Details can be found on the CIRMMT website : https://www.cirmmt.org/activities/seminars/SeminarCaramiaux.

Abstract of the talk

Technology-mediated music performance has long explored the potential of motion interfaces for enhancing musical expression. However designing expressive interactions based on these interfaces and the performer’s skills remains a difficult task because it involves complex and multifaceted motion variability.
In my talk, I will present the various facets of motion variability in music performance and propose a computational approach based on probabilistic modelling and human-centred machine learning. I will present proofs of concept developed and evaluated in the lab, as well as show real world artistic applications and implementation in consumer device product. Finally, I will introduce a more theoretical perspective explored in my current research project at McGill University, funded by the European Commission under the Marie Sklodowska-Curie actions, examining computations underlying sensorimotor learning in music performance, and its impact to enhanced motion interaction.

Musical Gesture Workshop

by Baptiste Caramiaux4033 Comments

We participated at a piano & gesture capture workshop at the GREAM, Groupe de Recherches Expérimentales sur l’Acte Musical, at Strasbourg University.

The workshop was organised by Pavlos Antoniadis, musician and researcher, and included presentations and hands-on session by Andrew McPherson, Frédéric Bevilacqua and myself. I presented computational tools for complex data analysis.

Here is a more detailed post about the event: https://pavlosantoniadis.wordpress.com/2016/03/23/24-03-2016-workshop-mener-une-etude-experimentale-de-linteraction-homme-machine-en-musique-concepts-outils-et-equipement/