A Contemporary Approach to Expressiveness in the Design of Digital Musical Instruments


Book Description

Digital musical instruments pose a number of unique challenges for designers and performers. These issues stem primarily from the lack of innate physical connection between the performance interface and means of sound generation, for the latter is usually dematerialised. Thus, this relationship must instead be explicitly determined by the designer, and can be essentially any desired. However, many design issues and constraints remain poorly understood, from the nature of control to the provision of performer-instrument feedback. This practice-based research contends that while the digital and acoustic domains are so different as to be fundamentally incompatible, useful antecedents for digital musical instruments can be found in the histories of electronic music. Specifically, it argues that the live electronics of David Tudor are of particular prescience. His home-made circuits offer an electronic music paradigm quite antithetical to both the familiar keyboard interface and the electronic music studios that grew up in the years after World War II, and are seen to embody a number of aspirational qualities. These include performer-instrument interaction more akin to steering rather than fine control, the potential for musical outcomes that are unknown and unknowable in advance, and distinct instrumental character. This leads to the central contribution of this research; the development of a Tudor-inspired conceptual framework that can inform how digital musical instruments are designed, played, and evaluated. To enable more detailed and nuanced discussion, the framework is broken down into a series of sub-themes. These include both design issues such as nuance, plasticity and emergence, and human issues such as experience, expressiveness, skill, learning, and mastery. The notion of sketching in hardware and software is also developed in relation to the rapid iteration of multiple designs. Informed by this framework, seven new digital musical instruments are presented. These instruments are tested from two different perspectives, with the personal experiences of the author supplemented with data from a series of smallscale user studies. Particular emphasis is placed on how the instruments are played, the music they can produce, and their capacity to convey the musical intentions of the performer (i.e. their expressiveness). After the evaluation of the instruments, the Tudorian framework is revisited to form the basis of the conclusions. A number of modifications to the original framework are proposed, from the addition of a dialogical model of performerinstrument interaction, to the situation of digital musical instruments within a wider musical ecology. The thesis then closes with a suggestion of possibilities for future research.




Musical Instruments in the 21st Century


Book Description

By exploring the many different types and forms of contemporary musical instruments, this book contributes to a better understanding of the conditions of instrumentality in the 21st century. Providing insights from science, humanities and the arts, authors from a wide range of disciplines discuss the following questions: · What are the conditions under which an object is recognized as a musical instrument? · What are the actions and procedures typically associated with musical instruments? · What kind of (mental and physical) knowledge do we access in order to recognize or use something as a musical instrument? · How is this knowledge being shaped by cultural conventions and temporal conditions? · How do algorithmic processes 'change the game' of musical performance, and as a result, how do they affect notions of instrumentality? · How do we address the question of instrumental identity within an instrument's design process? · What properties can be used to differentiate successful and unsuccessful instruments? Do these properties also contribute to the instrumentality of an object in general? What does success mean within an artistic, commercial, technological, or scientific context?




Sonic Writing


Book Description

Sonic Writing explores how contemporary music technologies trace their ancestry to previous forms of instruments and media. Studying the domains of instrument design, musical notation, and sound recording under the rubrics of material, symbolic, and signal inscriptions of sound, the book describes how these historical techniques of sonic writing are implemented in new digital music technologies. With a scope ranging from ancient Greek music theory, medieval notation, early modern scientific instrumentation to contemporary multimedia and artificial intelligence, it provides a theoretical grounding for further study and development of technologies of musical expression. The book draws a bespoke affinity and similarity between current musical practices and those from before the advent of notation and recording, stressing the importance of instrument design in the study of new music and projecting how new computational technologies, including machine learning, will transform our musical practices. Sonic Writing offers a richly illustrated study of contemporary musical media, where interactivity, artificial intelligence, and networked devices disclose new possibilities for musical expression. Thor Magnusson provides a conceptual framework for the creation and analysis of this new musical work, arguing that contemporary sonic writing becomes a new form of material and symbolic design--one that is bound to be ephemeral, a system of fluid objects where technologies are continually redesigned in a fast cycle of innovation.




A NIME Reader


Book Description

What is a musical instrument? What are the musical instruments of the future? This anthology presents thirty papers selected from the fifteen year long history of the International Conference on New Interfaces for Musical Expression (NIME). NIME is a leading music technology conference, and an important venue for researchers and artists to present and discuss their explorations of musical instruments and technologies. Each of the papers is followed by commentaries written by the original authors and by leading experts. The volume covers important developments in the field, including the earliest reports of instruments like the reacTable, Overtone Violin, Pebblebox, and Plank. There are also numerous papers presenting new development platforms and technologies, as well as critical reflections, theoretical analyses and artistic experiences. The anthology is intended for newcomers who want to get an overview of recent advances in music technology. The historical traces, meta-discussions and reflections will also be of interest for longtime NIME participants. The book thus serves both as a survey of influential past work and as a starting point for new and exciting future developments.




New Digital Musical Instruments


Book Description

xxii + 286 pp.Includes a Foreword by Ross Kirk




Designing Digital Musical Instruments Using Probatio


Book Description

The author presents Probatio, a toolkit for building functional DMI (digital musical instruments) prototypes, artifacts in which gestural control and sound production are physically decoupled but digitally mapped. He uses the concept of instrumental inheritance, the application of gestural and/or structural components of existing instruments to generate ideas for new instruments. To support analysis and combination, he then leverages a traditional design method, the morphological chart, in which existing artifacts are split into parts, presented in a visual form and then recombined to produce new ideas. And finally he integrates the concept and the method in a concrete object, a physical prototyping toolkit for building functional DMI prototypes: Probatio. The author's evaluation of this modular system shows it reduces the time required to develop functional prototypes. The book is useful for researchers, practitioners, and graduate students in the areas of musical creativity and human-computer interaction, in particular those engaged in generating, communicating, and testing ideas in complex design spaces.




Musical Haptics


Book Description

This Open Access book offers an original interdisciplinary overview of the role of haptic feedback in musical interaction. Divided into two parts, part I examines the tactile aspects of music performance and perception, discussing how they affect user experience and performance in terms of usability, functionality and perceived quality of musical instruments. Part II presents engineering, computational, and design approaches and guidelines that have been applied to render and exploit haptic feedback in digital musical interfaces. Musical Haptics introduces an emerging field that brings together engineering, human-computer interaction, applied psychology, musical aesthetics, and music performance. The latter, defined as the complex system of sensory-motor interactions between musicians and their instruments, presents a well-defined framework in which to study basic psychophysical, perceptual, and biomechanical aspects of touch, all of which will inform the design of haptic musical interfaces. Tactile and proprioceptive cues enable embodied interaction and inform sophisticated control strategies that allow skilled musicians to achieve high performance and expressivity. The use of haptic feedback in digital musical interfaces is expected to enhance user experience and performance, improve accessibility for disabled persons, and provide an effective means for musical tuition and guidance.




New Directions in Music and Human-Computer Interaction


Book Description

Computing is transforming how we interact with music. New theories and new technologies have emerged that present fresh challenges and novel perspectives for researchers and practitioners in music and human-computer interaction (HCI). In this collection, the interdisciplinary field of music interaction is considered from multiple viewpoints: designers, interaction researchers, performers, composers, audiences, teachers and learners, dancers and gamers. The book comprises both original research in music interaction and reflections from leading researchers and practitioners in the field. It explores a breadth of HCI perspectives and methodologies: from universal approaches to situated research within particular cultural and aesthetic contexts. Likewise, it is musically diverse, from experimental to popular, classical to folk, including tango, laptop orchestras, composition and free improvisation.




An Enactive Approach to Digital Musical Instrument Design


Book Description

Digital musical instruments bring about new problems and prospects for musical performance. In An enactive approach to digital musical instrument design, Newton Armstrong argues that these problems and prospects are theoretical and philosophical as much as they are technical. Drawing on the enactive cognitive science of Francisco Varela and others, as well as the phenomenology of Martin Heidegger and Maurice Merleau-Ponty, Armstrong outlines a model of interaction based around circular chains of embodied interdependency between performer and instrument, and examines the ways in which technological resistance to human action plays a key role in the incremental acquisition of performative skill. This book is addressed to musicians and artists working with interactive systems, to theorists of new media, and to researchers and designers interested in human factors in computing.