So, I'm wondering if anyone can help me develop an algorithm for what is proving to be a fairly difficult problem.  I am attempting to create a variable retimer for videos in processing.  At its simplest:

You have two arrays, array1 and array2, which correspond to frames in the same video. You want the video to go the array1[n] frame at the time that array2[n] would have occured.  I did something like this in Max, which was quite easy because Max is built for precise timing and Jitter treats videos as frames.  To access frames I have referred to the simple technique described in this thread: http://processing.org/discourse/yabb_beta/YaBB.cgi?board=Video;action=display;num=1196870672.  

The trouble is how to interpolate the frames in-between the keyframes so that there are no gaps or pauses in the video.  With no way to control the timing of my for loop, I can't simply freeze the video and have it cycle through the frames manually.  However, I also don't know how I'd perform a calculation to control the video by speed.  

Anyway, I hope someone other than me finds this problem interesting enough to throw out some suggestions.  Please let me know any questions you have, as this is fairly abstract to describe.