Technologies of Touch

• Applicants: Professorin Dr. Berit Greinke; Professorin Dr. Ariane Jeßulat
• Subject Area: Musicology
• Term: since 2024
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 547565326

Touch technologies seem omnipresent in contemporary culture, with the proliferation of mobile telephones and their touchscreen interfaces. However, the nature of this interaction remains poor as it takes place on a Cartesian plane and only allows access to screen-based media. In this project, we will study the corporeal, interpersonal dimensions of touch that take place in musical performance. To do so, we will: 1) Look at the histories, cultures, and ethics of touch; 2) Develop body technologies using physiological sensing; and 3) Create garments using electronic textiles to facilitate interpersonal touch in live performance situations. We propose that technologies of touch, implemented in physiological sensors and conductive thread, become a rich new source of "small data" that remain personal and private. We will train algorithms to enable wearable systems to become expressive instruments, sensitive to our individual gestures and body language. By testing these instruments with musicians in real contexts of concert performance, we will investigate the expressive, communicative, and intersubjective potential of touch technologies. Touch in everyday social interaction is contingent on cultural contexts. Meanwhile musicians are accustomed to working with their bodies and their instruments. The instrumental quality of the systems we build will be a natural extension for such creative practitioners. By starting with music, we intend that the knowledge gained in the research will have broader societal and cultural impact by gleaning a deeper understanding of the sociality of touch. We will then be able to imagine potential new dynamics for social touch that are ethical, sensitive, and respectful. We will study different accounts of touch: disembodied, intelligent, aware, expressive, caring and diverse. We bring to bear state-of-the-art technologies of embodied human-computer interaction to facilitate a series of artistic experiments in music performance that ask how we make sense of and act through touch. We will pay particular attention to affordances when interacting with systems enabled by artificial intelligence and machine learning. We plan an interdisciplinary, mixed methods research program combining musicology, performance studies, critical technology and craft making practices. This innovative, creative, 'enactivist' plan is built upon three overarching methodologies: (1) Studying touch in and through music performance across a theory-practice nexus; (2) Working with performers as users; and (3) Cyclical iteration. The project establishes a new UK-German research consortium of leaders in their respective fields and creates the opportunity for them to converge for the first time on a common research goal. Whilst firmly grounded in musicology and theoretical analysis, we reflect recent developments in the ‘performative turn’ in musicology to consider the importance of touch.

• DFG Programme: Research Grants
• International Connection: United Kingdom
• Partner Organisation: Arts and Humanities Research Council
• Cooperation Partner: Professor Dr. Atau Tanaka