So if I make something like this:

movie.pause(); movie.jump(30); movie.read();

The video will NOT show the frame at second 30, but whatever frame was on the screen before the jump. If I jump around in the video the same frame keeps being displayed until I hit play.

Is there a workaround for this?

I have a little problem with playing back videos in processing. The aim is to trigger the videos via an serial port input which works fine. The problem is that the videos are played back very laggy. I assume its because they are somehow all played back in the background. The videos are very short 2-5 seconds, but are in HD (1920x1080) and .H264 coded. They are supposed to be played back as long as the input signal is there, and fade to black when its gone. Can you please help me figure out how to avoid this problem and achieve fluid playback of the videos? That would be superb! I Have been hammering over this code for a while and I cant figure it out. Annnd, do you have any idea how to implement fading in and fading out of the videos? Tried it with tint, but can not manage it to do it fast enough. You would be a life saver! Merci, merci bien — any help is appreciated!

Love ❤️ jules

import processing.video.*;
import processing.serial.*;

Movie[]  movie = new Movie[10]; 
float[] myArray = new float[10];
short videoSpeed= 0 ; 
PImage bg;
PImage logo;
short videoID = 9; 

String[] video ={ "modellblinker1.mp4", 
          "modellblinker2.mp4",
          "modellhood.mp4",
          "modellside2.mp4",
          "modellside1.mp4",
          "modellwindshieldsback.mp4",
          "modellTrunk.mp4",
          "modellwindshieldsback.mp4",
          "modellroof.mp4"};



void setup() {
  fullScreen();
  iniMovies();
  imageMode(CENTER);
  frameRate(25);
  bg = loadImage("1.jpg");
  logo = loadImage("m.png");
  println(Serial.list()[0]);
  myPort = new Serial(this, Serial.list()[0], 19200);
  myPort.bufferUntil('\n');


}
void draw() {
  background(0);
  iniMovies();
  mngMovie();

 if( videoID ==9 ){


    image(logo,-57,-57);//, displayWidth/2, displayHeight/2);

  }else{
    image(movie[videoID], displayWidth / 2, displayHeight / 2);
    if (videoID != 9)
       movie[videoID].loop();
  }
}
void movieEvent(Movie m) {
  m.read();
}
void iniMovies(){
   for (int i = 0 ; i< 9;i++){
       movie[i] =  new Movie(this,video[i]);
   }
}  
void mngMovie(){
 // print(myArray);

 if(  myArray[0] >2000.0 ) {  /// blinker link 
   if ( videoID != 0  && videoID!=9 )      
     movie[videoID].stop();
    movie[0].play();
    videoID = 0; 
 }
 else if(  myArray[1]>-4000.0 ) {  // blinker recht 
   if ( videoID != 1 && videoID!=9 )      
     movie[videoID].stop();
    movie[1].play();
    videoID = 1; 
 }

 else if(  myArray[2] <-25000.0  || myArray[2] >17000.0  ) {  //  motor 
   if ( videoID != 2  && videoID!=9)      
     movie[videoID].stop();
    movie[2].play();
    videoID = 2; 
 }

 else if(  myArray[3] >5000.0 ) {  // Tür recht 
   if ( videoID != 3 && videoID!=9)      
     movie[videoID].stop();
    movie[3].play();
    videoID = 3; 
 }

 else if(  myArray[4] >20000.0 ) {  // Tür links 
   if ( videoID != 4 && videoID!=9 )      
     movie[videoID].stop();
    movie[4].play();
    videoID = 4; 
 }

 else if(  myArray[5]>20000.0 || myArray[5]<-25000.0) {   // Windschutz 
   if ( videoID != 5 && videoID!=9 )      
     movie[videoID].stop();
    movie[5].play();
    videoID = 5; 
 }

 else if(  myArray[6] >3000.0 ) { // coffer
   if ( videoID != 6  && videoID!=9)      
     movie[videoID].stop();
    movie[6].play();
    videoID = 6; 
 }
 else if(  myArray[7] >22000.0|| myArray[7]<-22000.0 ) {  // Fenester hinten
   if ( videoID != 7 && videoID!=9)      
     movie[videoID].stop();
    movie[7].play();
    videoID = 7; 
 }
 else if(  myArray[8]<-22000.0 ) {  // Dach 
   if ( videoID != 8 && videoID!=9  )      
     movie[videoID].stop();
    movie[8].play();
    videoID = 8; 
 }

 else {
   if( videoID != 9) 
       movie[videoID].stop();
  videoID=9;
 }
}
void serialEvent(Serial myPort) {
 // get the ASCII string:
 String inString = myPort.readStringUntil('\n');
 if (inString != null) {
 // trim off any whitespace:
 inString = trim(inString);
 // split the string on the commas and convert the
 // resulting substrings into an integer array:
 try{
  myArray =  float(split(inString, ";"));
  mngMovie();
   for (int i = 0 ; i< 9 ; i++){
     print(myArray[i]); 
     print(";");
   }
  println(videoID);
 }
 catch(Exception e){
       // println("Error parsing:");
     //      for (int i = 0 ; i< 9 ; i++){
  //   print(myArray[i]); 
  //  print(";");
  // }
   println();
  //println(videoID);
   //     e.printStackTrace();
    }
 }
}

Val takes the value 0 when the mouse is on the left side of the window and 0 when it is on the right. I will change that when I will send some data from Arduino through serial port.

My problem is that when the value of val becomes again 0, I want the program to pick a random video from the String moviesa (like “5a.mp4”) and play this instead of “0a.mp4” (and then if the value of val becames 1, play “5b.mp4”).

I tried to put the command : index=int(random(num)); between lines 43 and 44 but the program got stuck.

Thank you.

Script

import processing.video.*;
int index=0; 
int num=3; 

Movie[] moviesa=new Movie[num]; 
Movie[] moviesb=new Movie[num];

int val;  

void setup() {
size(1280,720,P2D); 

for (int i=0; i<num; i++)
{
moviesa[i]=new Movie(this,i+"a"+".mp4");
}
for(int k=0; k<num; k++)
{
moviesb[k]=new Movie(this,k+"b"+".mp4");
}

}

void movieEvent(Movie movie) {
for (int i=0; i<num; i++)
{
moviesa[i].read();
}
for (int k=0; k<num; k++)
{
moviesb[k].read();
}
}

void draw() {
if (mouseX>width/2)
{val=0;}
else 
{val=1;}

if(val==0) {
moviesb[index].stop();  
moviesa[index].play();
image(moviesa[index], 0, 0);
}
else {
moviesa[index].stop();
moviesb[index].play();
image(moviesb[index], 0, 0);
}
}

Progress so far:

Added the video library and tried:

import processing.video.*;

Movie test;

void setup() {
  size(1000,1000);
  background(0);
  test = new Movie(this, "launch1.mp4");
  test.loop();
  test.volume(0);
}

void movieEvent(Movie m) {
  m.read();
}

void draw() {
  image(test, 0, 0, width, height);
}

All I get is a blank screen. Also tried adding the GL video tool. Then tried the examples that come with it but every time, I get the following error message:

libEGL warning: DRI2: failed to authenticate
java.lang.RuntimeException: java.lang.ClassNotFoundException: Failed to find NEWT Display Class <.bcm.vc.iv.DisplayDriver>
    at jogamp.newt.DisplayImpl.create(DisplayImpl.java:314)
    at com.jogamp.newt.NewtFactory.createDisplay(NewtFactory.java:167)
    at com.jogamp.newt.NewtFactory.createDisplay(NewtFactory.java:149)
    at processing.opengl.PSurfaceJOGL.initDisplay(PSurfaceJOGL.java:150)
    at processing.opengl.PSurfaceJOGL.initFrame(PSurfaceJOGL.java:136)
    at processing.core.PApplet.initSurface(PApplet.java:10402)
    at processing.core.PApplet.runSketch(PApplet.java:10289)
    at processing.core.PApplet.main(PApplet.java:10024)
Caused by: java.lang.ClassNotFoundException: Failed to find NEWT Display Class <.bcm.vc.iv.DisplayDriver>
    at jogamp.newt.DisplayImpl.getDisplayClass(DisplayImpl.java:277)
    at jogamp.newt.DisplayImpl.create(DisplayImpl.java:285)
    ... 7 more

Im a bit lost now and would really appreciate it if someone could help! Many thanks!

I have some code to play a video with different soundtracks (or sometimes no sound) and I can't seem to get them in sync. The sound plays noticeably behind the video, maybe by about a third to a half of a second. Any ideas?

import processing.video.*;
import processing.sound.*;

Movie video;
SoundFile audio;

void setup() {
  size(640, 360);
  background(0);
  video = new Movie(this, "test.mp4");
  audio = new SoundFile(this, "test.mp3");

  video.play();
  audio.play();

}

void movieEvent(Movie m) {
  m.read();
}

void draw() {
  image(video, 0, 0, width, height);
}

• Divide the screen into four quadrants (as if it were displaying feed from security cameras, but I'd be using videos, for the most part)

• Have videos load randomly to those quadrants (from a total of 8 videos) and have the videos change after a certain number of seconds (they don't all have to change at once, but whatever's easiest)

• Have a webcam send its feed into one of the quadrants as if it were another video (I can always fix the webcam to one of the fourths of the screen and load random videos onto the other 3 available quadrants, if it simplifies things.)

My Processing skills are quite basic; so far I've managed to split the screen in 4 and load 4 videos, but I honestly don't know how to work with a video array, which sounds like the more reasonable way for the program to do what I would like it to.

Here is the basic code:

import processing.video.*;

Movie mov, mov1, mov2, mov3;

void setup() {
  size(1280, 640);
  frameRate(30);
  mov = new Movie(this,"0.mov");
  mov1 = new Movie(this,"1.mov");
  mov2 = new Movie(this,"2.mov");
  mov3 = new Movie(this,"3.mov");

  mov.play();
  mov1.play();
  mov2.play();
  mov3.play();

  mov.volume(0);
  mov1.volume(0);
  mov2.volume(0);
  mov3.volume(0);
}

void movieEvent(Movie mov) {
  mov.read();
}

void draw() {
  image(mov, 0, 0, 640, 320);
  image(mov1, 640, 0, 640, 320);
  image(mov2, 0, 320, 640, 320);
  image(mov3, 640, 320, 640, 320);
}

I started out with the above and then tried working with an array of videos, but only got so far:

import processing.video.*;

Capture cam;

int maxmyMovies = 8;
int myMoviesIndex = 0;
Movie[] myMovies = new Movie[maxmyMovies];

void setup() {

size(640,480);

cam = new Capture(this, 640, 480, 12);
cam.start();
smooth();

   for (int i = 0; i < myMovies.length; i ++ ) {
    myMovies[i] = new Movie(this, i + ".mov");

   }
}

void draw() {
 image(myMovies[myMoviesIndex], 0, 0);

  if (key == 'r') myMoviesIndex = int(random(0,8));

}

void movieEvent(Movie myMovies) {
  myMovies.read();
}

(The above is just copy/paste from other codes, I don't really want it to randomize when pressing the letter "r" but rather after a set time.) So, you can see I'm at a loss here... I would really appreciate any help.

Thanks!!

I'm working on a raspberry and when I run it, I everytime have this error in the console: (but the sketch run even though)

EGLDisplayUtil.EGLDisplays: Shutdown (open: 1)
EGLDisplayUtil: Open EGL Display Connections: 1
EGLDisplayUtil: Open[0]: 0x1: EGLDisplayRef[0x1: refCnt 2]

Do you know what does it mean and how I can solve it? The sketch read the values of the arduino (plugged on the raspberry) where a proximity sensor is plugged and when we put an object above the sensor the first video change and another one is launched. I also have another problem: When the sketch is running, the videos are slow down. And I remove everything that relate to the arduino and the sensor in processing, the videos are fine.

So is somebody can help me for this, it drives me crazy, and I didn't found a thing on our friend Google... Thanks so much :)

Here my code:

    ////////////////////////////////////////////
    ////////////////////////////////// LIBRARIES
    ////////////////////////////////////////////

    import processing.serial.*;
    import processing.video.*;





    /////////////////////////////////////////////////
    ////////////////////////////////// INITIALIZATION
    /////////////////////////////////////////////////

    Movie mymovie;
    Movie mymovie2;





    ////////////////////////////////////////////
    ////////////////////////////////// VARIABLES
    ////////////////////////////////////////////

    int lf = 10;    // Linefeed in ASCII
    String myString = null;
    Serial myPort;  // The serial port
    int sensorValue = 0; //value of the sensore
    int x = 100; //the sensor will be triggered when this value is reached. Modify it to change when the videos will switch




    /////////////////////////////////////////////
    ////////////////////////////////// VOID SETUP
    /////////////////////////////////////////////

    void setup() {
      //frameRate(50);
      fullScreen();
      //size(1280, 1024, P3D);
      // List all the available serial ports
      printArray(Serial.list());
      // Open the port you are using at the rate you want:
      myPort = new Serial(this, Serial.list()[1], 9600);
      myPort.clear();
      // Throw out the first reading, in case we started reading 
      // in the middle of a string from the sender.
      myString = myPort.readStringUntil(lf);
      myString = null;
      //load the video
      mymovie = new Movie(this, "VIDEO_1_v06bis.mov"); //Modify the line in quotation marks to change the videos. (put it inside the "data" folder
      mymovie2 = new Movie(this, "VIDEO_2_v02.mov");
      //set the videos for a continuous loop
      mymovie.loop();
      mymovie2.loop();
    }




    ////////////////////////////////////////////
    ////////////////////////////////// VOID DRAW
    ////////////////////////////////////////////

    void draw() {
      //image(mymovie, 0, 0); //display the video in a continuous loop
      // to trigger the sensor
      // check if there is something new on the serial port
      while (myPort.available() > 0) {
        // store the data in myString 
        myString = myPort.readStringUntil(lf);
        // check if we really have something
        if (myString != null) {
          myString = myString.trim(); // let's remove whitespace characters
          // if we have at least one character...
          if (myString.length() > 0) {
            println(myString); // print out the data we just received
            // if we received a number (e.g. 123) store it in sensorValue, we sill use this to change the background color. 
            try {
              sensorValue = Integer.parseInt(myString);
            } 
            catch(Exception e) {
            }
          }
        }
      }


      ///////////SENSOR TRIGGERED
      ///////////////////////////

      if (x < sensorValue) {
        mymovie.jump(0);
        //background(mymovie2);
        image(mymovie2, mouseX, mouseY);
        //mymovie2.pause();
      } else {
        //mymovie2.play();
        //mymovie.jump(0);
      }


      ///////////SENSOR NOT TRIGGERED
      ///////////////////////////////

      if (x > sensorValue) {
        mymovie2.jump(0);
        //background(mymovie);
        image(mymovie, mouseX, mouseY);
        //mymovie.pause();
      } else {
        //mymovie.play();
      }
    }



    //////////////////////////////////////////////
    ////////////////////////////////// VOID CUSTOM
    //////////////////////////////////////////////

    void movieEvent(Movie mymovie) {
      mymovie.read(); //read the video
      mymovie2.read();
    }

import processing.video.*;

Movie video; import gab.opencv.*; import java.awt.Rectangle;

OpenCV opencv; Rectangle[] faces;

void setup() { size(640,360);

video = new Movie(this, "people.mp4"); video.play(); video.loop();
opencv = new OpenCV(this, video.width, video.height); opencv.loadCascade(OpenCV.CASCADE_FRONTALFACE); }

void draw() { background(0); fill(255);
image(video,0,0);
opencv.loadImage(video); faces = opencv.detect();
}

void movieEvent(Movie m) { m.read();
}

It crashes at the line: opencv.loadImage(video);

With the message: IndexOutOfBoundsException: Index 3: Size 0

Any ideas? This works fine on mac osx with the same version of processing.

All I'm trying to do is turn the jellyfish image to the plastic bag image when it is clicked. I have a couple of jellyfish spread out through the sketch but wanted them to only changed when they are clicked indivdually. Here is the code that I have been working with, I'm very confused on what to put into the void mousePressed()

PImage ocean; PImage jellyfish; PImage bag;

void setup(){ size(1280, 520); //background image PImage ocean; ocean = loadImage("ocean.jpg"); background(ocean);

jellyfish = loadImage("jellyfish.png"); bag = loadImage("plastic_bag.png");

}

void draw(){ image(jellyfish, 500, 120); image(jellyfish, 600, 320); image(jellyfish, 100, 20); image(jellyfish, 1000, 50); }

void mousePressed(){

}

}

I'm just messing with this very simple code from one of the examples right now:

  import processing.video.*;
    Movie myMovie;

    void setup() {
      size(1920, 1080);
      background(0);
      myMovie = new Movie(this, "temporaldraft.mp4");
      myMovie.loop();
    }

    void draw() {
      image(myMovie, 0, 0, 1920, 1080);
    }

    // Called every time a new frame is available to read
    void movieEvent(Movie m) {
      m.read();
    }

Thanks!!

I would like to capture movement in a recorded (not captured) video. I tried to transform a code from Learning Processing site as to match it to the recorded video - but it doesnt work, I have some strange erros. The code is as follows:

import processing.video.*;
Movie kot;
PImage prevFrame;
float threshold = 50;

void setup() {
  size(2000, 2000);
  kot = new Movie(this, "breathing.mp4");
  kot.loop();

  prevFrame = createImage(kot.width, kot.height, RGB);
}

void movieEvent(Movie kot) {

  prevFrame.copy(kot, 0, 0, kot.width, kot.height, 0, 0, kot.width, kot.height); // Before we read the new frame, we always save the previous frame for comparison!
  prevFrame.updatePixels();  // Read image from the camera
  kot.read();
}

void draw() {

  loadPixels();
  kot.loadPixels();
  prevFrame.loadPixels();


  for (int x = 0; x < kot.width; x ++ ) {
    for (int y = 0; y < kot.height; y ++ ) {

      int loc = x + y*kot.width;            // Step 1, what is the 1D pixel location
      color current = kot.pixels[loc];      // Step 2, what is the current color
      color previous = prevFrame.pixels[loc]; // Step 3, what is the previous color

      // Step 4, compare colors (previous vs. current)
      float r1 = red(current); 
      float g1 = green(current); 
      float b1 = blue(current);
      float r2 = red(previous); 
      float g2 = green(previous); 
      float b2 = blue(previous);
      float diff = dist(r1, g1, b1, r2, g2, b2);

      // Step 5, How different are the colors?
      // If the color at that pixel has changed, then there is motion at that pixel.
      if (diff > threshold) { 
        // If motion, display black
        pixels[loc] = color(0);
      } else {
        // If not, display white
        pixels[loc] = color(255);
      }
    }
  }
  updatePixels();
}

When I print "myMovie.width" I get 0...

Here is my code:

package processingvideotest;

import processing.core.PApplet;
import processing.video.*;


public class ProcessingVideoTest extends PApplet{

    Movie myMovie;


    public void setup() {
    myMovie = new Movie(this,  "C:/Users/ollie/Documents/NetBeansProjects/ProcessingVideoTest/src/data/Evangelion.mp4");
    myMovie.play();
    myMovie.speed(1);
    myMovie.loop();

    }

    public void settings() {
      size(400, 400);

    }

    public void draw() {
    image(myMovie, 0, 0);
    }

    void movieEvent(Movie m) {
    m.read();
    }

    public static void main(String[] args) {
        PApplet.main(new String[] { "processingvideotest.ProcessingVideoTest" });
    }

}

Thanks for your help :)

////////////////////////////////////////////
////////////////////////////////// LIBRARIES
////////////////////////////////////////////

import processing.serial.*;
import gab.opencv.*;
import processing.video.*;




/////////////////////////////////////////////////
////////////////////////////////// INITIALIZATION
/////////////////////////////////////////////////

Movie mymovie;
Capture video;
OpenCV opencv;
Contour contour;




////////////////////////////////////////////
////////////////////////////////// VARIABLES
////////////////////////////////////////////

int lf = 10;    // Linefeed in ASCII
String myString = null;
Serial myPort;  // The serial port
int sensorValue = 0;
int x = 300;




/////////////////////////////////////////////
////////////////////////////////// VOID SETUP
/////////////////////////////////////////////


void setup() {
  size(1280, 1024);
  // List all the available serial ports
  printArray(Serial.list());
  // Open the port you are using at the rate you want:
  myPort = new Serial(this, Serial.list()[1], 9600);
  myPort.clear();
  // Throw out the first reading, in case we started reading 
  // in the middle of a string from the sender.
  myString = myPort.readStringUntil(lf);
  myString = null;
  opencv = new OpenCV(this, 720, 480);
  video = new Capture(this, 720, 480);
  mymovie = new Movie(this, "visage.mov");
  opencv.startBackgroundSubtraction(5, 3, 0.5);
  mymovie.loop();
}




////////////////////////////////////////////
////////////////////////////////// VOID DRAW
////////////////////////////////////////////


void draw() { 
  image(mymovie, 0, 0);
  image(video, 20, 20);
  //tint(150, 20);
  noFill();
  stroke(255, 0, 0);
  strokeWeight(1);



  // check if there is something new on the serial port
  while (myPort.available() > 0) {
    // store the data in myString 
    myString = myPort.readStringUntil(lf);
    // check if we really have something
    if (myString != null) {
      myString = myString.trim(); // let's remove whitespace characters
      // if we have at least one character...
      if (myString.length() > 0) {
        println(myString); // print out the data we just received
        // if we received a number (e.g. 123) store it in sensorValue, we sill use this to change the background color. 
        try {
          sensorValue = Integer.parseInt(myString);
        } 
        catch(Exception e) {
        }
      }
    }
  }
  if (x < sensorValue) {
    video.start();
    opencv.loadImage(video);

  }

  if (x > sensorValue) {
    image(mymovie, 0, 0);
  }

  opencv.updateBackground();
  opencv.dilate();
  opencv.erode();

  for (Contour contour : opencv.findContours()) {
    contour.draw();
  }

}




//////////////////////////////////////////////
////////////////////////////////// VOID CUSTOM
//////////////////////////////////////////////


void captureEvent(Capture video) {
  video.read(); // affiche l'image de la webcam
}

void movieEvent(Movie myMovie) {
  myMovie.read();
}

Here is what I;m trying to do. I would like to set a looping video as my background() image in my processing sketch. Then I want to import an OBJ and be able to rotate it in 3D space with my mouse. What I have so far is the video and the OBJ in the sketch but both acting as one piece. Here is my code so far. Any ideas?

import peasy.*; import processing.video.*;

PShape s;

String PATH = "/Users/brendanwilson/Desktop/Vidoe_Processing/video/data/comp.mov"; Movie mov;

PeasyCam cam;

void setup() { size(800, 800, P3D); smooth(); s = loadShape("rise.obj"); frameRate(30); mov = new Movie(this, PATH); mov.loop();

//CAMERA Click & Drag for rotation - Command & Drag for panning cam = new PeasyCam(this, 0, 0, 0, 50); cam.setMinimumDistance(0); cam.setMaximumDistance(1800);

}

void movieEvent(Movie m) { m.read();

}

void draw() {

directionalLight(126, 126, 126, 0, 0, -1); ambientLight(102, 102, 102); background(0); pushMatrix(); shape(s, 10, 10, 80, 80); popMatrix(); image(mov, 0, 0, width, height); }

import processing.video.*;

Movie mov;
int newFrame = 0;

void setup() {
  size(640, 360);
  background(0);
  // Load and set the video to play. Setting the video 
  // in play mode is needed so at least one frame is read
  // and we can get duration, size and other information from
  // the video stream. 
  mov = new Movie(this, "transit.mov");  

  // Pausing the video at the first frame. 
  mov.play();
  mov.jump(0);
  mov.pause();
}

void movieEvent(Movie m) {
  m.read();
}

void draw() {
  background(0);
  image(mov, 0, 0, width, height);
  fill(255);
  text(getFrame() + " / " + (getLength() - 1), 10, 30);
  int f=ceil (map(mouseX,0,width,1,getLength()));
  setFrame(f);
}

//void keyPressed() {
//  if (key == CODED) {
//    if (keyCode == LEFT) {
//      if (0 < newFrame) newFrame--; 
//    } else if (keyCode == RIGHT) {
//      if (newFrame < getLength() - 1) newFrame++;
//    }
//  } 
//  setFrame(newFrame);  
//}

int getFrame() {    
  return ceil(mov.time() * 30) - 1;
}

void setFrame(int n) {
  mov.play();

  // The duration of a single frame:
  float frameDuration = 1.0 / mov.frameRate;

  // We move to the middle of the frame by adding 0.5:
  float where = (n + 0.5) * frameDuration; 

  // Taking into account border effects:
  float diff = mov.duration() - where;
  if (diff < 0) {
    where += diff - 0.25 * frameDuration;
  }

  mov.jump(where);
  mov.pause();  
}  

int getLength() {
  return int(mov.duration() * mov.frameRate);
}

I am working on a 2010 Mac with Processing 2. I am running a simple program with 3 ellipse masks over a video. Whenever I run the video the sound goes silent at about 20-30 seconds. I have tried a variety of codecs including mpeg and H264 and even other videos. All seem to out to silence pretty quickly. I am dying here trying to get it up for a video installation. I really want the sound to play. I would even be up for loading the sound as separate from the video in Processing 2 if that made it work. I would be thrilled with any advice on this-- this is the code I am using:

import java.util.*; import processing.video.*;

//creating Movie object Movie vid; //creating mask image PImage img; // movement speed of ellipses in pixels int moveSpd = 5;

// class representing ellipse class ellipseMask { // x,y position of center float x; float y; // x and y radius float xr; float yr;

//constructor ellipseMask(float x,float y,float xr,float yr) { this.x = x; this.y = y; this.xr = xr; this.yr = yr; }

}

// initializing ellipse mask objects - CHANGE HEIGHT & WIDTH SCALE HERE ellipseMask e1 = new ellipseMask(156,280,68,87); ellipseMask e2 = new ellipseMask(512,280,68,87); ellipseMask e3 = new ellipseMask(868,280,68,84);

// initialize transparent and black colors color trans = color(255,255,255,0); color black = color(0,0,0,255);

void setup() { size(1024,768); // loading video vid = new Movie(this,"test2-QuickTimeH.264.mov"); //making video run in loop vid.loop();

// create blank image of screen size img = createImage(width,height,ARGB); }

void draw() { background(255);

// displaying current video frame image(vid,0,0,width,height);

// loading pixel array, so we can set it img.loadPixels();

// iterating over all pixels indices in mask image for(int i=0;i<widthheight;i++) { // computing x,y coordinates of index float y = (float)( i/(int)width ); float x = (float)(i - ywidth);

// checking if points are inside ellipses using formula (x-h)^2/rx^2 + (y-k)^2/ry^2 <= 1 for disk/point intersection
if(  ((x-e1.x)*(x-e1.x))/(e1.xr*e1.xr) +  ((y-e1.y)*(y-e1.y))/(e1.yr*e1.yr) <= 1 || ((x-e2.x)*(x-e2.x))/(e2.xr*e2.xr) +  ((y-e2.y)*(y-e2.y))/(e2.yr*e2.yr) <= 1 ||  ((x-e3.x)*(x-e3.x))/(e3.xr*e3.xr) +  ((y-e3.y)*(y-e3.y))/(e3.yr*e3.yr) <= 1  )
{ 
// changing pixel array value of mask image to transparent if its inside ellipse 
img.pixels[i] = trans; 
}
else
{
// changing pixel array value of mask image to black if its outside ellipse   
img.pixels[i] = black;
}

}

// update mask image using the pixel array img.updatePixels();

// displaying mask image image(img,0,0,width,height);

}

// video event void movieEvent(Movie m) { m.read(); }

// called upon key press TO CHANGE POSITION OF ELLIPSES void keyPressed() { // moving ellipse 1 if(keyCode==UP){e1.y -= moveSpd;} else if(keyCode==DOWN){e1.y += moveSpd;} else if(keyCode==LEFT){e1.x -= moveSpd;} else if(keyCode==RIGHT){e1.x += moveSpd;}

// moving ellipse 2 if(key=='w'){e2.y -= moveSpd;} else if(key=='s'){e2.y += moveSpd;} else if(key=='a'){e2.x -= moveSpd;} else if(key=='d'){e2.x += moveSpd;}

// moving ellipse 3 if(key=='i'){e3.y -= moveSpd;} else if(key=='k'){e3.y += moveSpd;} else if(key=='j'){e3.x -= moveSpd;} else if(key=='l'){e3.x += moveSpd;}

}

but it seams that i didn't knew how to install properly the video library...

please, what i have done wrong?

here is my code:

import processing.video.*;
Movie movie;

float[] cortes={
  5, 10.1, 20.7, 24.5, 32.5, 37.6, 42.8, 53.2, 55.7, 64.3, 72.3, 78,9
};

int trechoAtual;
int quantTrechos = 11;

void setup() {
  size(1020, 882);
  background(0);

  movie = new Movie (this, "komodenu.mov");
  movie.loop();
}

void movieEvent(Movie m) {
  m.read();
}

void draw() {
  if (movie.time()>cortes[trechoAtual+1]) {
    trechoAtual = int(random(quantTrechos-0.1));
    movie.jump(cortes[trechoAtual]);
  }
  image(movie, 0, 0, width, height);
}  

thanks

I'm trying to blend multiple movies into one. For blending multiple images I already got my code to work quite nicely I think (example below). Now I want to do the same for every frame in multiple movies. I experimented with this somewhat and I can get the movie frames to blend on click. Now I want to blend every frame. So my code is this:

import processing.video.*;

Movie movie1;
Movie movie2;

void setup (){
  size(1280,720);

  movie1 = new Movie(this, "MVI_8256.MOV");
  movie2 = new Movie(this, "MVI_8257.MOV"); 

  movie1.play();
  movie2.play();
}

void movieEvent (Movie m){
  m.pause();
  if (movie1.available() && movie2.available()){
    movie1.read();
    movie2.read();
    blend(); 
    movie1.play();
    movie2.play();
  }
}

void blend(){
  //code to blend
}

void draw (){
  image(movie1, 0, 0, 640, 360);
  image(movie2, 0, 640, 640, 360);
}

To me it looks as though the logic should work but i get a JNA: could not detach thread error. It seems that I can't pause a movie inside the movieEvent().

Hopefully one of you can help me out with some good advice!

import processing.core.*; 
import processing.data.*; 
import processing.event.*; 
import processing.opengl.*; 

import processing.video.*; 
import processing.sound.*; 

import java.util.HashMap; 
import java.util.ArrayList; 
import java.io.File; 
import java.io.BufferedReader; 
import java.io.PrintWriter; 
import java.io.InputStream; 
import java.io.OutputStream; 
import java.io.IOException;

public class prova_di_oggi extends PApplet {

PImage file;

SoundFile sound1;
SoundFile sound2;

Movie NemoBimboMovie;
Movie NemoShapeMovie;
Movie AdelaideBimbaMovie;
Movie FirstInteractionMovie;

Movie CurrentMovie;

public void setup(){

    background (0);
    file = loadImage("/Users/MASC/Desktop/prova_di_oggi/data/rettangolo.jpg");
    sound1 = new SoundFile(this, "/Users/MASC/Desktop/prova_di_oggi/data/heartbeat.mp3");

    sound2 = new SoundFile(this, "/Users/MASC/Desktop/prova_di_oggi/data/nemo_invito.WAV");
    NemoBimboMovie = new Movie(this, "/Users/MASC/Desktop/prova_di_oggi/data/nemo_bimbo.mp4");
    NemoShapeMovie = new Movie(this, "/Users/MASC/Desktop/prova_di_oggi/data/nemo_shape.mp4");
    AdelaideBimbaMovie = new Movie(this, "/Users/MASC/Desktop/prova_di_oggi/data/adelaide_bimba.mp4");
    FirstInteractionMovie = new Movie(this, "/Users/MASC/Desktop/prova_di_oggi/data/firstinteraction.mp4");

    //In CurrentMovie tengo traccia di quale video é in play al momento.
    //Il promo dei due video che penso tu voglia far partire sia NemoShapeMovie
    CurrentMovie=NemoShapeMovie;
  }

public void draw(){
  image(NemoBimboMovie, 839,0, 600,854);
  image(NemoShapeMovie, 839,0, 600,854);
  image(AdelaideBimbaMovie, 0,0, 600,854);
  image(FirstInteractionMovie, 839,0, 600,854);
}

public void movieEvent(Movie m) { 
  m.read(); 
}

public void keyPressed() {
  if (key == '1') {
    sound1.play();
    image (file,839,0,600, 854);
  }
  if (key == '2') {
    sound2.play();
  }
  else if (key == '3') {
    sound1.stop();
    sound2.stop();
  }
  //Assumo che 'a' significhi che l'utente apra l'altra scatola e debba partire l'altro video 
  else if (key == 'a') {
    double CurrentTime=CurrentMovie.time();//Ottengo a che punto sta il video corrente
    CurrentMovie=NemoBimboMovie;
    CurrentMovie.jump((float)CurrentTime);
    }
  //Assumo che 's' significhi quando l'utente si avvicina...Parte il video con la figura
  else if (key == 's') {
      double CurrentTime=CurrentMovie.time();//Ottengo a che punto sta il video corrente
      CurrentMovie=NemoShapeMovie;
      CurrentMovie.jump((float)CurrentTime);
    }
  else if (key == 'p') {
      NemoBimboMovie.play();
    }
  else if (key == 'd') {
      AdelaideBimbaMovie.play();
    }
  else if (key == 'f') {
      FirstInteractionMovie.play();
    }    
}

public void settings() {  size(1439,854); }

static public void main(String[] passedArgs) {
    String[] appletArgs = new String[] { "--present", "--window-color=#666666", "--stop-color=#cccccc", "prova_di_oggi" };
    if (passedArgs != null) {
      PApplet.main(concat(appletArgs, passedArgs));
    } else {
      PApplet.main(appletArgs);
    }
  }
}

    import processing.video.*;

    Movie theMov;
    Movie theMov2;



    void setup() { 
      size(1440, 900);
      theMov = new Movie(this, "sin_city.mp4");
      theMov2 = new Movie(this, "blue_velvet.mp4");

      theMov.stop();  
      theMov2.stop();
    }

    void draw() { 
      background (0);
      image(theMov, 0, 0);
      image(theMov2, 0, 0); 
    } 

    void movieEvent(Movie m) { 
      m.read(); 
    } 

    void keyPressed(){
      if (key == 'p'){

            theMov2.pause();
            background(0);
            theMov.play();

              } else if (key == 'o'){

                       theMov.pause();
                       background(0);
                       theMov2.play();

                     }


}

import processing.video.*;

Movie Mov1; Movie Mov2;

void setup(){ size(1280,720); Mov1 = new Movie(this, "nemo_bimbo.mp4"); Mov2 = new Movie(this, "adelaide_bimba.mp4"); }

void draw(){ image(Mov1, 840,0, 440,720); image(Mov2, 0,0, 440,720); }

void movieEvent(Movie m) { m.read(); }

void keyPressed() {

//I don't know how to use switch (key) //case 'a' //PLEASE, help me!

if (key == 'a') {
  Mov1.play();
 }
if (key == 's') {
  Mov2.play();
}

//I don't know how to not visualize anymore the video

if (key == ' ') {

Mov1.stop (); Mov2.stop(); } }

import processing.video.*;
Movie myMovie;

Cell[] cells= new Cell[1000];

float x, y;
PFont Baskerville;
int screen=1;
int drawRandomLines = 0;
int ellipseSize = 0;
int totalCells = 0;

void setup () {
  size(1024, 768);
  smooth(3);
  noStroke();
  Baskerville = createFont("Baskerville", 30);
  textFont(Baskerville);
  textAlign(CENTER);
  noStroke();
  x = width/2;
  y = 0;
  myMovie = new Movie(this, "dominant_species.mov");
  //myMovie.play();
}

void draw () {

  if (screen==1) {
    background(4, 16, 36);
    fill(255, 219, 157);
    noStroke();
    //draw first screen
    ellipse(512, 384, 16, 16);
    text("Here is a cell.", width/2, height/2-40);

    // } if (y >= 384) {

    //y = height/2;

    text("Here is a cell.", width/2, height/2-40);
  } else if (screen==2) {
    background(4, 16, 36);

    fill(255, 219, 157, 20);
    rect(mouseX, 0, -mouseX, 768);
    fill(255, 219, 157);
    text("One of millions in the body.", width/2, height/2-40);

    cells[totalCells] = new Cell();

    totalCells ++ ;

    if (totalCells >= cells.length) {
      totalCells = 0;
    }

    for (int i = 0; i < totalCells; i++) {
      cells[i].move();
      cells[i].display();
    }

    if (mouseX >= 900) {
      screen++;
    }

    if (mouseY < 10 ) {
      screen++; //add one onto screen
    }
  } else if (screen==3) {
    background(255, 219, 157);
    //background(4,16,36);
    //draw third screen
    //testing to see if the mouse is inside a circle
    fill(4, 16, 36);
    text("Throughout our daily lives...", width/2, height/2-40);
  } else if (screen==4) {
    background(255, 219, 157);
    noStroke();

    text("our cells duplicate in order to heal and develop.", width/2, height/2+200);


    fill(4, 16, 36);
    ellipse(width/2-40, height/2-40, ellipseSize, ellipseSize);
    ellipse(width/2+40, height/2+40, ellipseSize, ellipseSize);
  } else if (screen==5) {
    background(4, 16, 36);
    noStroke();

    fill(255, 219, 157);
    text("That's how we've gone from a single celled organism...", width/2, height/2-20);
    image(myMovie, 0, 0);

    fill(4, 16, 36);
    ellipse(width/2-40, height/2-40, ellipseSize, ellipseSize);
    ellipse(width/2+40, height/2+40, ellipseSize, ellipseSize);
    //draw fifth screen
    //image(myMovie, 0, 0);
  }
}

//called only once when the user presses the mouse
void mousePressed () {
  if (screen==1) {
    //testing for a button notice it is the same bounds as the
    //rect we are drawing in the test for screen==1 inside draw
    //you could just write 170 instead of 130+40 but I left this
    //here so you can see how the test values relate to the rect coordinates
    float d = dist(mouseX, mouseY, 512, 384);

    if (d<20) {
      screen++;
      //myMovie.play();
    }
  } else if (screen==5) {

    myMovie.play();
  } else if (screen==3) {
    screen++;
  }
}


//called whenever the mouse is movoed
void mouseMoved () {
  if (screen == 4) {
    ellipseSize=ellipseSize+5; 
    if (ellipseSize > width) {
      println("threshold");
      //take us back to the beginning
      //reset all of our variables
      //screen=1;
      drawRandomLines = 0;
      ellipseSize = 0;
      screen++;
    }
  } else if (screen == 6) {
    //take a look inside the screen==5 inside draw
    //ellipseSize++; 
    //if (ellipseSize > width) {
    //println("threshold");
    //take us back to the beginning
    //reset all of our variables
    //screen=1;
    //drawRandomLines = 0;
    //ellipseSize = 0;
  }
}


void movieEvent(Movie m) {
  m.read();
}


//NEW TAB__ CELL CLASS

class Cell {

  float x, y;   // Variables for location of raindrop
  float speed; // Speed of raindrop
  color c;
  float r;     // Radius of raindrop

  Cell() {
    r = 8;                 // All raindrops are the same size
    x = random(mouseX);     // Start with a random x location
    y = -r*4;              // Start a little above the window
    speed = random(1, 5);   // Pick a random speed
    c = color(255,219,157); // Color
  }

  // Move the raindrop down
  void move() {
    // Increment by speed
    y += speed;
  }

  // Check if it hits the bottom
  boolean reachedBottom() {
    // If we go a little beyond the bottom
    if (y > height + r*4) { 
      return true;
    } else {
      return false;
    }
  }

  // Display the raindrop
  void display() {
    // Display the drop
    fill(c);
    noStroke();
    ellipse(x, y, r*2, r*2);
  }

}
`

i know how to play/loop an existing video. but what if i have a folder in which videos will be copied (from an external source – in my case a raspberry pi that uploads captured video clips) dynamically?

can i add videos to my canvas on runtime? there is a function to list folder contents – but i don't know HOW TO dynamically add video sources to a running project.

is there any help? or a definitive "NO" …? thanks anyways!

– stephan

This is what i got so far, still missing the keyPressed as a substitute of the sensors. The problem is the videos are all runing ate the same the time, and i've no idea how to do the keyPressing to call the other videos. Its the first time i'm using this library, and i really need help on this.

import processing.video.*;

String[] movieList = {"movie/x.mov", "movie/y.mov", "movie/w.mov", "movie/z.mov"};
Movie[] filmes = new Movie[movieList.length];

void setup() {
  size(1280, 720);
  //fullScreen();
  background (0);
  frameRate(60);

  for (int i = 0; i < movieList.length; i++)
  {
    filmes[i] = new Movie(this, movieList[i]);
    filmes[i].loop();
  }
}

void draw() 
{
  for (int i = 0; i < movieList.length; i++)
  {
    image(filmes[i], 0, 0);
  }
}

void movieEvent(Movie m) 
{
  m.read();
}

Here is part of the code:

void draw() {
  background(0);

  if (!isPlaying) {
    currSub = subs.get(subIndex);
    myMovie.jump(currSub.start);
    isPlaying = true;
  }

  image(myMovie, 0, 0, width, height);

  //Draw subtitle
  text(currSub.speech, width/2, height - 25);

  //Check subtitle ending
  if (myMovie.time() >= currSub.end) {
    subIndex ++;
    isPlaying = false;
  }
}

// Called every start a new frame is available to read
void movieEvent(Movie m) {
  m.read();  
}

thanks,

import processing.video.*;
Movie myMovie1, myMovie2, myMovie3;
boolean playMovie1=true;
boolean playMovie2=false;
boolean playMovie3=false;



void setup()
{
  size (displayWidth, displayHeight);
  background (0);


 myMovie1 = new Movie(this, "1.mp4");

 myMovie2 = new Movie(this, "2.mp4");

 myMovie3 = new Movie(this, "3.mp4");

}

void draw(){
background(0);
if(playMovie1==true){

myMovie1.play();
image(myMovie1,0, 0);
if(myMovie1.time()>=myMovie1.duration()){
myMovie1.stop();
playMovie1=false;

playMovie2=true;
}
}




if(playMovie3==true){

myMovie3.play();
image(myMovie3,0,0);
if(myMovie3.time()>=myMovie3.duration()){
myMovie3.stop();
playMovie3=false;
}
}
}


void movieEvent(Movie m){
m.read();
}

void keyPressed()

{

// PRESS LEFT OR RIGHT AFTER FIRST VIDEO
  if ((keyCode == RIGHT) || (keyCode == LEFT))

{
 if(playMovie2==true){

myMovie2.read();
myMovie2.play();
image(myMovie2,0,0);
if(myMovie2.time()>=myMovie2.duration()){
myMovie2.stop();
playMovie2=false;
playMovie3=true;
}}


 }}

Thanks for the help (code below)

    import processing.video.*;
    import ddf.minim.*;
    Movie movie1; 
    Minim minim;
    AudioSample sample;  

    Tile t1;                

    void setup() {
    fullScreen(2);

    }


     void draw() {

    background(155);
    t1.presentTile(400,500);


 }

 class Tile {


    int boxSize;
    boolean overBox = false;
    boolean canTrigger = true;
    float boxMax = 100;
    float boxMin = 25;

    void movieEvent(Movie movie1) {
    movie1.read();
    }    

Tile() {


    imageMode(CENTER);
    boxSize = 25;

    minim = new Minim(this);
    movie1 = new Movie(this,"TORCH_2_1.mov");
    movie1.loop();
    movie1.pause();
    sample = minim.loadSample("Paper Rustle_1.mp3");

    t1 = new Tile(); 



}



void presentTile(float bx,float by) {

    if (mouseX > bx-(boxSize/2) && mouseX < bx+(boxSize/2) &&  
    mouseY > by-(boxSize/2) && mouseY < by+(boxSize/2)) {
    overBox = true; 

    } else {

    overBox = false;
    }

    if ((overBox) && (boxSize < boxMax)) {

    image(movie1, bx, by,boxSize++,boxSize++);
    movie1.loop();

    }
    if ((!overBox)&&(boxSize > boxMin)){

    image(movie1, bx, by,boxSize-=3,boxSize-=3);
    movie1.pause();

    }
    image(movie1,bx,by,boxSize,boxSize);

    if (canTrigger && overBox) {
    sample.trigger();
    canTrigger = false;

    }

    if (!overBox) {
    sample.stop();
    canTrigger = true;              
    }

}

}

In the below code everything is working correctly but the sound that is heard is horribly distorted. I think this is because it is playing a new sample every frame, but I'm not sure how to prevent that. I can get the sample to play back fine in mousePressed() (outside of draw) but i don't want to use that- i want the sound to play only when the mouse passes over the movie box. If the solution is to move the "sample.trigger();" out of draw where would it go?

Im on OSX 10.10.5 and using Processing 3.02

Code is below - but be warned - turn your speakers down if u play that exact code!

Thanks.

import processing.video.*;
import ddf.minim.*;


Movie movie1; 
Minim minim;
AudioSample sample;

float bx;
float by;
int boxSize;
boolean overBox = false;
float boxMax = 100;
float boxMin = 25;

void setup() {
fullScreen(2);
minim = new Minim(this);
bx = width/2;
by = height/2;
imageMode(CENTER);
boxSize = 25;

movie1 = new Movie(this, "TORCH_2_1.mov");
movie1.loop();
movie1.pause();
sample = minim.loadSample("Paper Rustle_1.mp3");
}

void movieEvent(Movie movie1) {
movie1.read();
}

 void draw() {

background(155);

if (mouseX > bx-(boxSize/2) && mouseX < bx+(boxSize/2) &&  
mouseY > by-(boxSize/2) && mouseY < by+(boxSize/2)) {
overBox = true; 

} else {

overBox = false;
}

if ((overBox) && (boxSize < boxMax)) {

image(movie1, bx, by,boxSize++,boxSize++);
movie1.loop();


}
if ((!overBox)&&(boxSize > boxMin)){

image(movie1, bx, by,boxSize-=3,boxSize-=3);
movie1.pause();


}
image(movie1,bx,by,boxSize,boxSize);

if (overBox) {
sample.trigger();

}

if (!overBox) {
sample.stop();

}

}

The problem here is that this program will not launch inside my selectInput() unless I put another selectInput() before it. Here's my code:

  import processing.video.*;
  import gab.opencv.*;
  import java.awt.*;
  import java.util.*;
  import java.io.*;

  OpenCV openCv;

  PrintWriter output;
  StringList kf;
  StringList [] movieScenes;
  int c=0;
  BufferedReader HowManyScenes;
  int lines;
  String line = "1";
  String [] scenes;

  Movie theMov; 
  File selectionF, selectionT;
  String selectText;
  int fc;
  ArrayList <PImage> frames= new ArrayList();
  int avgFrameColor;

  Boolean trufals=false;
  Boolean process=true;

  void setup() {

    size(1280, 720);
    //frameRate(200);
    selectInput("Select a film to process:", "selectFilm");

  }

  void selectFilm(File selection) {
    println("ola");
    if (selection == null) {
      println("Window was closed or you hit cancel.");
    } else {
      theMov = new Movie (this, selection.getAbsolutePath());
      // println(selection.getAbsolutePath());

      String [] params = split (selection.getAbsolutePath(), "\\");
      String [] segmentation = {"C:/Users/Nuno/Desktop/Segmentation/windows64/video_segmentation", params[params.length-1]};

      launch(segmentation);
      println(segmentation);
      //process=true;

    }
  }  

  void draw() { 

    if (theMov == null || selectText == null) {
      trufals=false;
    } else {
      trufals=true;
    }

//rest of my code which doesnt start untill I select both a video file and a txt file

}

The problem I have is in the setup I believe, because if I put another random selectInput() before it all works fine and video_segmentation.exe will run. Example:

void setup(){
  size(1280,720);
  selectInput("hi","hi");
  selectInput("Select a film to process:", "selectFilm", selectionF)

}

I discovered this because I was running another selectInput() that initializes the function selectScenes()which reads the file generated by video_segmentation.exe.

I would appreciate some help if anyone has any idea what this is about.