Freestyle, Raining Texts and an ITP MacArthur Genius

Camille Utterback is one of this year’s recipients of the MacArthur Grant. Text Rain was a project she created while at ITP and is currently one of the inspirations I have for my NIME project.
I want to incorporate audience participation to create a freestyle composition live. One idea I have is for audience members to text into a server that will trigger sound samples live onstage that I will manipulate and arrange. The composition would be created using some computer vision techniques a la Jitter and/or Processing that recalls (at least to me) some Text Rain imagery. Not the content of imagery, but rather the concept. The shadows (rather, my shadow) bouncing letters or shapes or colors even, but also in turn producing sound.
I just realized this is also similar in effect to Mike Clemow’s NIME project last year, the Shadow Puppet Sequencer. The twist here being the audience participation and myself as the shadow. As well as some other randomness.
It’s an ambitious idea and I’m excited, but we’ll see how this concept unfolds and possibly shifts and changes as I go along (and am constrained by time). Here we go….ITP Fall/Winter 2009!
