Having created interactive sound tools in Director, Flash and Max/MSP, Processing has opened up new pathways for experimentation with real time sound and image interaction and generation. His project idea involves using sound to generate or reproduce imagery, and/or video tracking and sound input to affect live video.
Early experiments have seen shapes and text being displayed according to sound input level. See splatter and city builder.