Cello Ideas

Following a performance at STEIM it was decided that the cello would be explored further as a sound source and interface. The main issue with my current performance setup is the divide between controlling acoustic and electronic aspects of the setup. The time delay and physical awkwardness caused by having to lean around the cello to adjust parameters on my controller (usually placed on a table beside me) is very disruptive and detracts from the fluidity of the performance.

By augmenting the cello through the use of various sensors and software analysis I hope to achieve a closer connection between the acoustic and digital technologies used in my performance. Previous attempts at solving this issue had been relatively successful using an additional panel for the cello body which housed various potentiometers and switches connected to an Arduino. However, this was never developed any further and later abandoned as the Arduino was used for another project.

As a result of discussing the possibilities of modifying the cello several areas on the neck and body were found to be easily accessible without disrupting traditional playing techniques. These areas provide potential for possible sensor placement.

The ability to 'hold' a note/sound from the cello and free the hands would be extremely beneficial and could be achieved easily using switches on the bow to trigger recording and playback. Similarly, the use of pedals along with accelerometers and pressure sensors on the bow could also offer less disruptive sources of control data.

Accelerometers could also be placed on the cello body to detect motion and orientation changes which could trigger changes in mapping. Dynamic routing for the processing of the cello signal similar to 'The Finger' was also discussed as it would provide a large amount of options which can be chosen spontaneously. 

Related Links:

http://www.keithmcmillen.com/k-bow/hardware

http://www.nime.org/proceedings/2006/nime2006_409.pdf

http://benjaminnlevy.net/files/BLevy.AugmCello.ICSRiM.pdf

Physical Models

This patch is the result of thinking about mapping low dimensional inputs to high dimensional outputs in an attempt to control subtle details in textural sounds in an expressive and intuitive manner. Additional inspiration was provided by the ADDAC 'Marble Physics' module which generates CV output based on the behaviour of a simulated marble on a tray. 

The patch uses the 'jit.phys' objects to simulate a number of spheres in a virtual space. The XYZ coordinates of each sphere can then be mapped to various parameters of a granular synthesis engine. The 'rePatcher' shield for Arduino was used to gain physical control of these mappings and explore various relationships between the devices.

A joystick was used to manipulate the direction of force applied to the spheres. The joystick's trigger button was mapped to either exert continuous or impulsive force on the spheres depending on the state of the thumb button.

Further developments could include the use of 'jit.phys.ghost' in combination with a multitouch surface to manipulate the objects within the virtual space. The use of amplitude envelopes for the grains triggered on collision detection could possibly provide more control over the density of the overall sound. It could also be interesting to explore the use of simulated physical processes to trigger other musical processes in less linear ways.

Research Objectives

This blog will document the research and experiments developed whilst studying the 'Instruments and Interfaces' Master at STEIM and the Institute of Sonology. 

The main objective of this research is to facilitate a more tangible and intuitive interface for the realtime exploration, manipulation and organisation of sound in an improvisational context. 

More specifically, the research and resultant interface will focus on:

• Exploring the possibilities of using physical patching interfaces in combination with Max MSP

• Adaptive and dynamic mapping techniques to develop a more manageable and intuitive interface.

• Exploring gestural input devices in order to provide a more expressive control over the dynamics and subtleties of electronic sounds and processes.

• Building a vocabulary of predefined mappings, materials and structural elements which provide a a starting point or loose structure for improvisation.

Following a discussion at STEIM, a series of cards were also created in order to develop a structure for the research and thesis.