Originally Posted by keep it simple
That's a cool thing, & a lot of work gone into it that I don't pretend to understand. Struggling to find an application for it in general music making, but I can imagine super cool applications in dance & theatre.
It's not really designed for anything 'normally' musical, so you've hit that one on the head. It's much more for the kinds of sounds that you'd hear in electronic music or, as Polly says, things like movie soundtracks. I'm finding some uses for it for what I usually write.
This is the tip of the iceberg really. There's a guy on my course who is doing something similar (using a Kinect sensor, actually) to track the motion of dancers performing and in doing so render 3D video on a muslin cloth in front of them dancing. This is much more limited - but it's dissertation work, so not necessarily designed for the mainstream!