hi all,

this is a basic example of how I managed to synchronize audio and video effects via MIDI, using an external audio sequencer (playing notes and applying delay and reverb effects) and a Processing sketch (displaying squares and applying delay-like and reverb-like video effects).

http://www.vimeo.com/4327477

the same midi signals are sent to the audio sequencer and the processing sketch. the squares appear when the notes are played. you should see an ugly fade-out effect when you hear the reverb.

sorry for the poor video quality, my cpu couldn't render a larger image : the input image is routed to many PGraphics, just like audio signals are routed to many buses on a mix table.

here is the code if you want to have fun :
http://n.clavaud.free.fr/processing/videoMixTable/videoMixTableMidi.zip
(see the midiEvents tab to configure notes and control change inputs)