April 25, 2013

The other day, I had to send some samples of my work to two dJs, to see if a collaboration could be possible, mixing sound and interactive processing, one of my favorite interactions… And I found this great object I thought I lost definitly when my old drive crashed few months ago. It’s a quick installation artwork I made for Fontenay-Sous-Bois (east suburbs of Paris) “les portes ouvertes” event in may 2011. On this occasion, all the artist studios are opened to the public. It’s an excellent occasion to test some participative material. So I did this to allow children, parents, everyone to create their own digital musical painting, just with a laptop, its webcam and a video projector.

So quickly, here is the how it works:

First, you print and make a scissor’s cut on your “interactive colored paper mouse” which you can download here, or preview and download there. This is the object you will manipulate in front of your incorporated laptop webcam.

You have understood now what is the principe, the color you put up allows to unlock some actions on the app. blue is for the “+” in the left corner and then choose between fractal drawings on the left or floral musical neurones on the right.

blue is on top, moved my cursor to the

So, start choosing your element, then move wherever you want on the scene and turn your “mouse” putting the red color on top. Now, you start drawing or making floral musical explosions. Here, on this example, I’m starting via lines.

drawing quickly some lines...

On the floral musical neurons, you won’t have ever twice the same thing, because to make it interesting and different with few elements, I did plug a lot of random calculation on a simple fractal model… So, you can even have only the floral elements and nothing of sound… That’s what I call random, everything is possible ;].
To do next screen, I put blue of my “mouse” on top again, moved my cursor to the “+”, and chose the musical option.


A last word on the technique of this object. It’s based, for the “mouse” part, on Didier Brun’s RGB Wheel Tracker. The musical part is based on the work of Soul Wire and his AS3 particle node sequencer. With a little difference, Justin – in his app – plays with Tonfall, an extraordinay AS3 Audio Framework by André Michelle. I kept the graphic neuronal aspect because it fitted perfectly with the drawing lines part, but the sounds played on my installation are from my sound design personal work. So I manage to turn it into a “connectecting sampler”, and did not use the powerfull Tonfall possibilities. Next time…

If you want to try it, you can download this .zip, unzip it in a folder and just open index.html, the flash version will ask you to allow access to the webcam, do it and enjoy your experience.

Tags: , , , , ,