I am being a little bit lazy recently, I must admit it. But this news by Co.Design really woke me up.
Bruno Zamborlin is a very VERY smart guy – joint PhD in Arts and Computational Technologies between IRCAM/Centre Pompidou in Paris and Goldsmiths, University of London- who is “exploring new methods for gestural interaction and its applications in performing arts and the creation of new musical instruments“.
What does this mean? Well, watch this video and you will understand – and say WOW!
The video above show how it is possible to perform gesture recognition just with contact microphones.
Through gesture recognition techniques Zamborlin and his staff detect different kind of fingers-touch and associate them with different sounds. In the video two different audio synthesis techniques are used:
– physic modelling, which consists in generating the sound by simulating physical laws;
– concatenative synthesis (audio mosaicing), in which the sound of the contact microphone is associated with its closest frame present in a sound database.
The system can recognise both fingers-touches and objects that emits a sound, such as the coin shown in the video.