I'm at work so I can't play with it but it seems pipelining might be the key to opening a video file and extracting the audio.

I've also thought about sending telnet commands to VLC to do this for me.

In the end, all I want to do is open the audio stream from a video as an input. For instance

in = minim.loadFile(<videofile>); or the like.

Anyways, here is the example code with the new address:

2. /**
3.   * This sketch demonstrates how to play an internet radio stream with Minim. 
4.   * You load the stream like any other file and then just use <code>play()</code> 
5.   * to start playing it. You can still use the other methods of a <code>Playable</code> 
6.   * object and it shouldn't break anything, but it also won't accomplish much. For example, 
7.   * rewinding streaming audio simply reloads the stream, there's no TIVO-like buffer 
8.   * that is kept. Not all internet radio streams will work in an applet. Another 
9.   * limitation of applets is that they must be signed to be able to access remote hosts. 
10.   * If your applet is running from www.foo.com and you want to access the mp3 stream 
11.   * at www.bar.com, you must sign the applet. If you are just trying to load a file 
12.   * from www.foo.com/file, you shouldn't need to sign it.
13.   * <p>
14.   * The stream you are listening to is Limbik Frequencies.
15.   */
16. 
    
17. import ddf.minim.*;
18. 
    
19. Minim minim;
20. AudioPlayer radio;
21. 
    
22. void setup()
23. {
24.   size(512, 200, P3D);
25.   minim = new Minim(this);
26.   // load a URL
27.   radio = minim.loadFile("http://127.0.0.1:1234/", 2048);
28.   // play the file
29.   radio.play();
30. }
31. 
    
32. void draw()
33. {
34.   background(0);
35.   stroke(255);
36.   // draw the waveforms
37.   // the values returned by left.get() and right.get() will be between -1 and 1,
38.   // so we need to scale them up to see the waveform
39.   // note that if the file is MONO, left.get() and right.get() will return the same value
40.   for(int i = 0; i < radio.bufferSize()-1; i++)
41.   {
42.     float x1 = map(i, 0, radio.bufferSize(), 0, width);
43.     float x2 = map(i+1, 0, radio.bufferSize(), 0, width);
44.     line(x1, 50 + radio.left.get(i)*50, x2, 50 + radio.left.get(i+1)*50);
45.     line(x1, 150 + radio.right.get(i)*50, x2, 150 + radio.right.get(i+1)*50);
46.   }
47. }
48. 
    
49. void stop()
50. {
51.   radio.close();
52.   minim.stop();
53.   
54.   super.stop();
55. }

And here is the setup in VLC:

I loaded in an H.264, 1280x720 with PCM audio. I tried a ProRes file, but VLC, I don't believe, has a ProRes codec. The sketch errors out with a NullPointerException at the URL line most of the time. And when it does play, there are jumps and squeaks in the audio. I feel like this is something that can be fixed.

Going in this direction, I believe it may be possible to send command-line commands to VLC from a Processing sketch. I would love to hear from anyone with that experience.