Exporting Audio and Video with Beads

pants.dan..

Exporting Audio and Video with Beads

in Contributed Library Questions • 1 year ago

Hey there

I have made a sketch with animation and music with the Beads library. I am trying to export it but the audio stream is strangely longer than the the video.

I am on OS X 10.5.8, using Processing 1.5.1

To make the video I call createFrame("export-####.jpg"); in draw(), then I use a free program Time Lapse Assembler which gives me a .mov.

For the audio I am using a RecordToSample beads object and writing the audio to a file using the method described by Evan Mertz in Sonifying Processing (great book btw).

But, if the movie is say 10 seconds, the audio will be like 17 seconds. I've tried different settings (sample rates etc) but yet to work out what I am doing wrong.

I've seen this post as well http://computermusicblog.com/blog/2012/01/07/how-to-render-synchronous-audio-and-video-in-processing-using-beads/ which is cool but I can't seem to use the MoveMaker library on os x, there seems to be a problem with quicktime and java support. I get this error:

java.lang.UnsatisfiedLinkError: quicktime.QTSession.Gestalt(I[I)S

and I have tried using different versions of Java, the solution also seems to be to use 32 bit java, but! I also get this message when I start any processing sketch:

Cannot run Java in 32 bit mode. Continuing in 64 bit mode.

Which so far has not actually caused any material problems.

So, if anyone has any ideas please let me know! Ideally I could just render the audio at the correct length then I can put the movie and audio together using Live or something.

Replies(1)

pants.dan..

Re: Exporting Audio and Video with Beads

1 year ago

It seeeems to be impacted by the time taken by saveFrame(), I can see why moviemaker might resolve it.

If i buffer the images in memory and then write them out after all the frames I want I get a lot closer, but still not quite there ...

If anyone knows a faster way to copy the pixel data im all ears. I might try lower my framerate too. Would still love a proper solution (wonder if should ask about the MovieMaker thing seperately, does anyone else have a problem with it on OS X?)

int h = 300;
int w = 200;
int fRate = 10;
int nFrames = 5 * fRate;
int [][] buf;
void setup()
{
frameRate(fRate);
size(h, w);
buf = new int[nFrames][width * height];
}
void draw()
{
if (frameCount == nFrames)
saveAndExit();
background(255 * (mouseX/(float)width), 20, 255 * (mouseY/(float)height));
text("frame: " + frameCount, 10, 10);
loadPixels();
for (int i = 0; i < width * height; i++)
buf[frameCount-1][i] = pixels[i];
}
void saveAndExit()
{
for (int idx = 0; idx < nFrames; idx++) {
PImage p = createImage(width, height, RGB);
p.loadPixels();
for (int i = 0; i < p.pixels.length; i++) {
p.pixels[i] = buf[idx][i];
}
p.updatePixels();
String filename = format_name("take1/frame-#####.jpg", idx+1);
p.save(filename);
}
exit();
}
//slightly modified from p.org source
String format_name(String what, int cnt) {
int first = what.indexOf('#');
int last = what.lastIndexOf('#');
if ((first != -1) && (last - first > 0)) {
String prefix = what.substring(0, first);
int count = last - first + 1;
String suffix = what.substring(last + 1);
return prefix + nf(cnt, count) + suffix;
}
return what; // no change
}

Top Reply