I'm currently working in the new core video library for Processing 2.0. It is a simplified derivative of GSVideo, so it is based on GStreamer in order to ensure cross-platform compatibility. Performance-wise, it should also be faster than the current built-in video library based on Quicktime, at least in most situations.
However, it requires to bundle the GStreamer native libraries for each platform (actually, only for Windows and OSX since it is safe to assume that GStreamer will be available on a Linux system). To minimize the impact on the final size of the Processing package, I'm trying to trim away GStreamer plugins that support esoteric codecs and functionality.
To make sure that I don't remove anything important, I'd like to know what codecs (h264, xvid, theora, etc) and containers (mov, avi, etc) are most used by people doing video with Processing.
Please make your comments here. If the subsequent discussion becomes too chaotic, I could also organize an online poll to get more accurate numbers and make a decision based on them.
Just my 2 cents. I'm using avi or mpeg containers mostly. I would like to use .ogg more. And the Mjpeg codec as it encodes every frame, which is sometimes preferred for video manipulation/analysis. But any FFMPEG codec is fine too. Don't know if that helps.