I need to stop a video when the PIR is "On" (Detects motion) and to play that video if the PIR is "Off".

Checking the Processing and Arduino websites, examples and references I couldn't figured out what I'm doing wrong. Please let me know if something is missing or left. Thanks in advance for any help!

This is the Arduino Code (copied from Arduino and Processing communication tutorials found on the web):

/*
   PIR sensor tester
*/

int ledPin = 13;                // choose the pin for the LED
int inputPin = 2;               // choose the input pin (for PIR sensor)
int pirState = LOW;             // we start, assuming no motion detected
int val = 0;                    // variable for reading the pin status

void setup() {
  pinMode(ledPin, OUTPUT);      // declare LED as output
  pinMode(inputPin, INPUT);     // declare sensor as input

  Serial.begin(9600);
}

void loop() {
  val = digitalRead(inputPin);  // read input value
  if (val == HIGH) {            // check if the input is HIGH
    digitalWrite(ledPin, HIGH);  // turn LED ON
    if (pirState == LOW) {
      // we have just turned on
      Serial.println("Motion detected!");
      // We only want to print on the output change, not state
      pirState = HIGH;
    }
  } else {
    digitalWrite(ledPin, LOW); // turn LED OFF
    if (pirState == HIGH) {
      // we have just turned of
      Serial.println("Motion ended!");
      // We only want to print on the output change, not state
      pirState = LOW;
    }
  }
}

And here is the Processing code:

import processing.serial.*;
import processing.video.*; 

Serial myPort;
String val;    

Movie video;

void setup() {
  size(640,480);
  video = new Movie(this,"sujeto1.mp4");
  video.loop();
  String portName = Serial.list()[0];
  myPort = new  Serial(this, portName, 9600);
  myPort.bufferUntil('\n');
}

void serialEvent (Serial myPort) {
  if (myPort.available() > 0) {
    val=myPort.readStringUntil('\n');
  }
  if (val=="Motion detected!") {
    video.stop();
  } else {
    video.loop();
  }
  println(val);

}
void draw() {
  background(0);
  image(video,0,0);

} 

void movieEvent(Movie video) {
  video.read();
}

import processing.video.*;
static final int movieCount = 3;
final Movie[] myMovie = new Movie[movieCount];
int index;
int maxMovieIndex = movieCount-1;

void setup() {
  size(1920, 1080);
  myMovie[0] = new Movie(this, "scene_0.mp4");
  myMovie[1] = new Movie(this, "scene_1.mp4");
  myMovie[2] = new Movie(this, "scene_2.mp4");
  myMovie[0].loop();
}

void draw() {
  set(0, 0, myMovie[index]);
  image(myMovie[index], 0, 0);

  println("index: " + index);
}

void keyPressed()
{
 if (key == 'q')
 {
   myMovie[index].pause();
   if (index != maxMovieIndex)
   {
    index++; 
   }
   else
   {
    index = 0; 
   }
   myMovie[index].loop();
 }
}

void movieEvent(Movie m) {
  m.read();
}

It runs, but if I exit after doing a switch, I get an error in the console upon exit:

(java.exe:6620): GStreamer-CRITICAL **: Trying to dispose element Movie Player, but it is in PAUSED instead of the NULL state. You need to explicitly set elements to the NULL state before dropping the final reference, to allow them to clean up. This problem may also be caused by a refcounting bug in the application or some element.

(java.exe:6620): GStreamer-CRITICAL **: Trying to dispose element inputselector0, but it is in PAUSED instead of the NULL state. You need to explicitly set elements to the NULL state before dropping the final reference, to allow them to clean up. This problem may also be caused by a refcounting bug in the application or some element.

What does this mean, and how do I fix it? I guess it has to do with how the Movie object is used, but I haven't seen examples in the documentation on why/how to safely exit.

I´ve accoplish to create a mask that works pretty well on the raspberry using shaders thought the problem that im having is that the RGB and Depth textures are not aligned. I´ve heard that this is something that happends with the kinect 1414 and not with the kinect 1417, thought i´ve only got the 1414 model , so i have to make it work in here.

This is a reference pic of how the mask is working:

The thing in the background is the video, look how wrong the mask is.

Im testing it on windows, so im using kinect4win library, and i know kinect4win has the kinect.getMask() function that works perfectly but i need to run on the raspberry so that function is useless and so i have to make my own. Here is my code using kinect4win than then im going to translated openKinect :

PROCESSING :

import processing.video.*;
import kinect4WinSDK.Kinect;

import processing.video.*;

Movie movie;

Kinect kinect;


PGraphics canvas;
PShader shader;

// brightness threshold
float minBrightness = 0.8;


//Values tested on  kinect4windows
float scale = 0.9099997;
float xoffset = 0.08226191;
float yoffset = 0.08226191;

//values tested on openKinect for raspberry pi
/*float scale = 1.0799996;
float xoffset = -0.007174231;
float yoffset = -0.07838542;*/

void setup()
{
  fullScreen(P2D);
  //size(640, 480, P2D);
  frameRate(60);

  kinect = new Kinect(this);
  // load shader and set threshold
  shader = loadShader("mask.glsl");

  // Load and play the video in a loop
 /* movie = new Movie(this, "transit.mov");
  movie.loop();*/

  shader.set("xoffset", xoffset);
  shader.set("yoffset", yoffset);
  shader.set("scale", scale);
}

void draw()
{
  // reset screen
  background(0, 0);
  // visualise result
  shader.set("umbral", minBrightness);

  //0.05 PUEDE IR EH
  float xoffset = map(mouseX, 0, width, -0.1, 0.1);
  float yoffset = map(mouseY, 0, height, -0.1, 0.1);



  println("X Offset : ", xoffset);
  println("Y Offset : ", yoffset);


  fill(255, 0, 0);
  ellipse(mouseX, mouseY, 20, 20);

  /*fill(0);
  image(movie, 0, 0, width, height);
  fill(255);
  */

  shader.set("texture", kinect.GetDepth());
  shader.set("texture2", kinect.GetImage());

  shader(shader);
  image(kinect.GetDepth(), 0, 0, width, height);
  resetShader();

  fill(0, 255, 0);

  float sep = 20;
  text("FPS: " + frameRate, 10, height-sep);
  text("xoffset :" + xoffset, 10, height-sep*2);
  text("yoffset :" + xoffset, 10, height-sep*3);
  text("scale :" + scale, 10, height-sep*4);
}

void movieEvent(Movie m) {
  m.read();
}

void keyPressed() {

  if (key == '+') {

    minBrightness +=0.1;
  }
  if (key == '-') {

    minBrightness -=0.1;
  }

  if(key == 'a'){

   scale +=0.02; 
  }
  if(key == 's'){
   scale -= 0.02; 
  }
}

This is my GLSL CODE :

     /*#ifdef GL_ES
precision mediump float;
precision mediump int;
#endif
*/
uniform sampler2D texture; //LA DEPTH

uniform sampler2D texture2; // LA RGB

varying vec4 vertColor;
varying vec4 vertTexCoord;

uniform float umbral;
uniform float xoffset;
uniform float yoffset;
uniform float scale;

void main() {
    vec3 luminanceVector = vec3(0.2125, 0.7154, 0.0721);
    vec4 c = texture2D(texture, vertTexCoord.st) * vertColor;


    //CORRECT DEPTH RGB ALIGMENT : 

    vec4 c2 =  texture2D(texture2, (vertTexCoord.st+vec2(xoffset,yoffset))*scale) * vertColor;

    float luminance = dot(luminanceVector, c.xyz);
    luminance = max(0.0, luminance - umbral);


    c.r = c2.r;
    c.g = c2.g;
    c.b = c2.b;
    c.a = sign(luminance);

    gl_FragColor = vec4(c.rgb,c.a);
}

Im posting this on shaders category cause all that i need to do is translate the depth mask to be align to the RGB, but im not very good using shaders. so my question is . How to translate depth mask to align to rgb texture?

UPDATE : i´ve managed to set a Xoffset and Yoffset for aligning the textures, yet it doesn´t seem to be only a problem of aligment but also a problem of scale, like the depth image is a bit larger. Maybe some OpenCV algorithm for improving it?

UPDATE2: i´ve managed to set a SCALE, better, but still inacurate, i don´t know how to solve this now.

UPDATE3: SOLVE IT ! the scale was not really add it, now the code is fully functional

I am trying to get the video to not begin playing until stage 1, but it starts right away. Any suggestions? Thank you!

PImage old;
import processing.video.*;
Movie movie;
int stage = 0;


void setup(){
size(500,500);
old = loadImage("old.png");
old.resize(500,500);
  movie = new Movie(this, "full.mov");
  movie.loop();
}

void draw(){
if (stage == 0){
  fill (255,0,0);
  rect (0,0,500,500);
  if ((mousePressed)&& (mouseX > 0) && (mouseX < 250)&& (mouseY > 0) && (mouseY < 250)){ //button on upper left side
    stage = 1;
  }
}

if (stage == 1){ 
 image(movie,0,0,500,500);
 image(old,0,0,500,500); 

}

}

void movieEvent(Movie m){
  m.read();
}

import java.util.ArrayList; import KinectPV2.KJoint; import KinectPV2.*;

KinectPV2 kinect;

import processing.video.*;

Movie coral; PGraphics feedback;

void setup() { fullScreen(P2D, 2); feedback = createGraphics(1920,1080,P2D); background(0); //blendMode(ADD);

//Video stuff coral = new Movie(this, "CoralReef.mp4"); coral.loop();

//Kinect stuff kinect = new KinectPV2(this); kinect.enableBodyTrackImg(true); kinect.enableSkeletonDepthMap(true); kinect.init(); }

void movieEvent(Movie m) { m.read(); }

PImage kinectSil;

void draw() {

kinectSil = kinect.getBodyTrackImage();

kinectSil.filter(INVERT); kinectSil.loadPixels(); for (int i = 0; i < kinectSil.pixels.length; i++) { if (kinectSil.pixels[i] == color(0)) { kinectSil.pixels[i] = color(0, 0); } else { kinectSil.pixels[i] = color(255,255); } } kinectSil.updatePixels();

feedback.beginDraw(); feedback.image(kinectSil,0,0,1920,1080); feedback.blend(coral, 0, 0, coral.width, coral.height, 0, 0, coral.width, coral.height, MULTIPLY); feedback.filter(THRESHOLD); feedback.endDraw(); tint(255,10); image(coral,0,0,width,height); blend(feedback,0,0,feedback.width,feedback.height, 0, 0, width, height, LIGHTEST); fill(45); rect(0,0,150,54); textSize(30); fill(255); text(frameRate, 20,40); }

PImage img1;

//movie var, name after actual movie! Movie wtch1; Movie wtch2; Movie wtch3; Movie wtch4; Movie wtch5;

//The var to control what movie plays next(hopefull)---------------------------------Movie var float mvar = 1;

void setup () { size (1152, 864);

//starting image img1 = loadImage("Send.png");

//video stuff-----------------------------------------------------------------setup video wtch1 = new Movie(this, "wtch1.mov"); wtch2 = new Movie(this, "wtch2.mov"); wtch3 = new Movie(this, "wtch3.mov"); wtch4 = new Movie(this, "wtch4.mov"); wtch5 = new Movie(this, "wtch5.mov"); //

// }

void draw () { background(0); //-----------------------------------------------------------------------Starting image tint(255, 255); image(img1, 0, 0, width, height);

image(wtch1, 0, 0, width, height);//////-------------------------------------wtch1 AND if AND mvar if(mousePressed){ wtch1.play();

if(mousePressed && mvar == 2){ image(wtch2, 0, 0, width, height); wtch2.play(); mvar = 3; }

}

void movieEvent (Movie m) { //---------------------------------------------------Movie m| m.read m.read(); }

Link to the Git and the example Code (which is working): Link

Here is my Sketch:

import processing.video.*;
import gab.opencv.*;
import java.awt.Rectangle;

OpenCV opencv;
Movie myMovie;
Rectangle[] faces;

void setup() {
  size(480, 270);

  myMovie = new Movie(this, "people3.mp4");
  myMovie.loop();
  opencv = new OpenCV(this, myMovie.width, myMovie.height);
  opencv.loadCascade(OpenCV.CASCADE_FRONTALFACE);
}

void movieEvent(Movie myMovie) {
  myMovie.read();
}

void draw() {

  background(0);
  if (myMovie.available()) {    

    opencv.loadImage(myMovie);
    faces = opencv.detect();
    image(myMovie, 0, 0);

    if (faces != null) {
      for (int i = 0; i < faces.length; i++) {
        strokeWeight(2);
        stroke(255, 0, 0);
        noFill();
        rect(faces[i].x, faces[i].y, faces[i].width, faces[i].height);
      }
    }
  }
}

What I'm getting is an IndexOutOfBoundsException: Index: 3, Size: 0 at openCV.loadImage(myMovie) and I don't know why.

Appreciating any help! :-)

I have come to a problem of having error from using Window 7 with arduino Leonado sending data through Serial port. I tested a code that getting only the data from both Mac and Window and it works fine. Then I make a video to put on a canvas for Spout to project it out to other program. Note that with syphon everything works fine too. I have ran into a post somewhere that posted long ago that a guy had the same problem of mine and he fixed it by changing to openGL but I also learned that openGL now is the same as P3D from a more recent post here in this forum. ** I didn't run anything at the same time of processing.** First time running usually fine, but for the second or third then the error will say that my port is busy! And I will have no choice but restart the computer again. !!!! Is this a bug? Is there a solution?

Here is the code that runs fine on both operation

import processing.serial.*;
Serial myPort ;
int value, wheel;
String myString = null;
int weight = 800;
int lf = 10;

void setup() {
  printArray(Serial.list());
  myPort = new Serial(this, Serial.list()[1], 9600);
  myPort.clear();
  myPort.bufferUntil(lf);
  myString = myPort.readStringUntil(lf);
}
void draw() {
println("in draw once");
 println("fsr: "+ value);
    println("wheel position: "+ wheel);
    println("-----------");
}

void serialEvent(Serial p) {
  //println("access Serial port");
  myString = p.readStringUntil('\n');
  if (myString !=null) {
    //println("get data from Serial port");
    String[] fsr =split(myString, 'r');
    //printArray(fsr);
    value = int(fsr[0]);
    String trim = trim(fsr[1]);
    wheel = int(trim);

  }
}

And this is a code that has a problem in Window 7 (x64)

import spout.*;// IMPORT THE SPOUT LIBRARY
import processing.serial.*;//Serial to Arduino
import processing.video.*;//play vdo

int nSenders = 5;
PGraphics[] canvas;
Spout[] senders;

int lf=10;
Serial myPort;
int value, wheel;
String myString = null;
Movie myMovie;
int arduinoValue = 800;

int projectorWidth = 1024;
int projectorHeight = 768;
//int scalar = 3;

//-----swtiches------//
Boolean arduinoSwitch = true;
Boolean sensorSwitch = false;
Boolean spoutSwitch = true;
//-----------//

void settings() {
  size(projectorWidth, projectorHeight,P3D);
  // size is doesn't change the size of canvas in term of sending graphic signal out.
}
void setup() {
  canvas = new PGraphics[nSenders];
  for (int i=0; i<nSenders; i++) {
    canvas[i] = createGraphics(projectorWidth, projectorHeight, P3D);
  }
  printArray(Serial.list());

  // Create Spout senders to send frames out.
  if (spoutSwitch) {
    senders = new Spout[nSenders];
    for (int i = 0; i < nSenders; i++) { 
      senders[i] = new Spout(this);
      String sendername = "Test "+i;
      senders[i].createSender(sendername, projectorWidth, projectorHeight);
    }
  }  
  if (arduinoSwitch) {
    myPort = new Serial(this, Serial.list()[1], 9600);
    myPort.clear();
    myPort.bufferUntil(lf);
    myString = myPort.readStringUntil(lf);
  }
  myMovie = new Movie (this, "C:/Users/dma/Desktop/tuang/test1.mp4");
}

void draw() {
  canvas[0].beginDraw();
  canvas[0].background(255, 0, 100);
  canvas[0].image(myMovie, 0, 0);
  if (spoutSwitch) {
    for (int i = 0; i < nSenders; i++) {
      senders[i].sendTexture(canvas[i]);    //send all separated spout canvases
    }
  }
  if (arduinoSwitch) {
    println("fsr: "+value);
    println("position wheel: "+wheel);
    if (value < arduinoValue) {
      sensorSwitch=true;
      myMovie.stop();
      canvas[0].background(0);
      println("nothing in the house");
    }
    if (sensorSwitch) {
      if (value>=arduinoValue) {
        println("Force sensor is detacted");
        //newRandom=true;
        //randomMovie();
        myMovie.play();
        sensorSwitch=false;
      }
    }
  }
  canvas[0].endDraw();
  image(canvas[0], 1024/2*(0%2), 768/2*(0/2));
}
void movieEvent(Movie m) {
  m.read();
}

void serialEvent(Serial p) {
  if (arduinoSwitch) {
    myString = p.readStringUntil('\n');
    if (myString != null) {
      String[] fsr = split(myString, 'r');
      //printArray(fsr);
      value = int(fsr[0]);
      String trim = trim(fsr[1]);
      wheel = int(trim);
    }
  } else {
    println("Arduino is off.");
  }
}
//keyboard for testing vdo
void keyPressed() {
  switch (key) {
  case 'a' : 
    myMovie.play();
    break;
  case 'r' :
    myMovie.stop();
    break;
  }
}

What should I do to stop the port being too busy ! I didn't even run anything but processing.

I have this code that allows me to save frames, but I don't want to save frames from the displayed video. What I'm not seeing?

Thanks in advance!

import processing.video.*;

Capture cam;
Movie video;

boolean showVideo=false;
boolean saveframe=false; 

void setup() { 
  size(640, 480); 
  cam = new Capture(this, 640, 480, 30);
  video = new Movie(this, "ex.mp4");
  cam.start();
} 


void draw() {
  background(0);
  if (showVideo==false) { 
    image(cam, 0, 0);
  } else {
    image(video, 0, 0);   
  }
  if (saveframe==true) {saveFrame("output.##.jpg");
  }
}

void keyPressed() {
  showVideo=true;
  video.loop();
  saveframe=true;
}

void keyReleased() {
  showVideo=false;
  video.stop();
  saveframe=false;
}

void captureEvent(Capture webCam) {
  webCam.read();
}

void movieEvent(Movie m) {
  m.read();
}

class Movie {


  int currentMovieIndex;
  int STATE_PLAYING_SELECTED_MOVIE;
  int currentState = STATE_PLAYING_SELECTED_MOVIE, STATE_WAITING_FOR_CLICK;
  float movieEndDuration = 0.039719;
  String [] stateLabels = {"waiting for click", "playing selected movie"};

  String [] videoList= {"obscurité", "sombre"};
  Movie[] movies;

  Movie(movies, String[]videoList) {

    Movie[] movies = new Movie[videoList.length]; 
    for (int i=0; i < videoList.length; i++) {
      movies[i] = new Movie(this, videoList[i]+".mp4");
      movies[currentMovieIndex].play();
    }
  }


  void drawMovie() {
    background(0);
    image(movies[currentMovieIndex], 0, 0);
  }
  void playSelectedMovie() {
    currentState = STATE_PLAYING_SELECTED_MOVIE;
    movies[currentMovieIndex].play();
  }

  void movieEvent (Movie m) {

    if (currentState == STATE_PLAYING_SELECTED_MOVIE) {
      if ((m.time()+ movieEndDuration) < m.duration) {
        m.read();
        movies[currentMovieIndex].play();
      } else if ((m.time() +movieEndDuration)>= m.duration()) { 
        m.stop();
        currentState = STATE_WAITING_FOR_CLICK;
        println("movie at index " + currentMovieIndex + " finished playback, current state: " + stateLabels[currentState]);
      }
    }
  }
}

import processing.video.*;

String[]vid = {"action1.mp4", "action2.mp4", "action3.mp4", "action4.mp4", "action5.mp4", "action6.mp4"};

Movie movie;

void setup() {
  size(480, 270);
  background (255);
  frameRate(30);
  movie = new Movie(this, vid[int(random(1, 6))]);
  movie.loop();
}

void movieEvent(Movie m) {
  m.read();
}

void draw() {
  image(movie, 0, 0 );
}

I'm getting some inconsistent behaviour with PImage.width, PImage.height, and PImage.resize() when working with Movie files. Width and height will almost always return 0, though will occasionally return the correct dimensions. PImage.resize() will sometimes throw an error: "Width(0) and Height(0) cannot be <= 0" - even when the dimensions are hardcoded in. I'm posting this here because I'm not sure whether this is a bug or I'm just doing something silly with the code:

macOS 10.12.5; Quicktime 10.4; P3.3.5

import processing.video.*;

Movie m;
PImage mS;
int vScale = 4;
int mW;
int mH;

void setup() {
  size(480, 270);
  m = new Movie(this, "test.mov"); // original dim: 1920 1080
  m.loop();
  mW = m.width; 
  mH = m.height;

  // Almost always returns 0 for both values, but occasionally returns the correct dimensions.  
  println("width: " + mW +" " + "Height: " + mH); 
}

void draw() {
  mS = m.get();

  //This almost never works
  //mS.resize(mW/vScale, mH/vScale); 

  //This works most of the time, but not always!
  //mS.resize(1920/vScale, 1080/vScale); 

  //Again works most of the time, but not always...
  mS.resize(480, 270);


  image(mS, 0, 0);
}

void movieEvent(Movie m) {
 m.read(); 
}

I have been working with video and audio during a project, and when they both seemed to work properly I decided to put them together. After searching for the problem in my code, I found that loading in the audio files blocked the ability to play a video. I isolated the part of the code that does not work:

import processing.video.*;
import processing.sound.*;

SoundFile ring;

Movie mov1;


void setup() {

  size(200,200);
  background(0);

  mov1 = new Movie(this, "VIDEO1.mp4");
  ring = new SoundFile (this, "vintage.mp3");  //soundfile phone ringing
  mov1.loop();                                         
}

void movieEvent(Movie m) {
  m.read();  
}

void draw() {
  image(mov1, 0, 0, width, height);
}

When I remove the part "ring = new SoundFile (this, "vintage.mp3")" it the video plays, but otherwise it won't.

I have no clue how to solve this problem, do you?

Thank you in advance! :)

I'm creating a movie player program with an Arduino board. I've successfully made the program play one movie file when I wave my hand in front of the Arduino PIR monitor, I just want it to randomly select from an array of other video files. Any help would be appreciated.

Here's my code so far...

import processing.video.*;
import processing.serial.*;

Serial myPort;        // The serial port
int xPos = 1;         // horizontal position of the graph, original 1
float inByte = 0;

String[] movieNames = { "1.mpg", "2.mpg", "3.mpg", "4.mpg"};
Movie[] movee = new Movie[movieNames.length];

void setup() {
  fullScreen();
  background(0);

  myPort = new Serial (this, "COM6", 9600);
  myPort.bufferUntil('\n');

  for (int i=0; i<movieNames.length; i++) {
    movee[i] = new Movie(this, movieNames[i]);
  }
}

void draw() {

  for (int i = 0; i < movieNames.length; i++) {
    image(movee[0], 0, 0);
  }
}

void movieEvent(Movie m) {
  m.read();
}

void serialEvent(Serial myPort) {
  String inString = myPort.readStringUntil('\n');

  if (inString != null) {
    inString = trim(inString);
    inByte = float(inString);

    println(inByte);

    if (inByte == 1) {
      movee[0].stop();
      println("Playing video...");
      movee[0].play();
    }

  }

}

import processing.serial.*;
import processing.video.*;

Movie movie1;
Movie movie2;
Movie movie3;
//etc.

Serial myPort;
int linefeed = 10;   // Linefeed in ASCII
int numSensors = 3;  // we will be expecting for reading data from four sensors (CHANGE)
int sensors[];       // array to read the values
int pSensors[];      // array to store the previuos reading, useful for comparing
// actual reading with the last one

String currentMovie;

void setup() {
  size(1440, 1080);

  println(Serial.list());

  // files inside processing folder for this programme
  movie1 = new Movie(this, "Sun.mp4");
  movie2 = new Movie(this, "Mercury.mp4");
  movie3 = new Movie(this, "Venus.mp4");
  //etc.

  myPort = new Serial(this, Serial.list()[3], 115200);
  // read bytes into a buffer until you get a linefeed (ASCII 10):
  myPort.bufferUntil(linefeed);
}

void draw() {

  // check the sensors and sets the movie to play

  if (currentMovie == "")        //if nothing is playing
  {
    if (sensors[0] == 1)
    {
      //print("Play Movie 1");
      currentMovie = "movie1";
      movie1.play();
    } else if (sensors[1] == 1)
    {
      print("Play Movie 2");
      currentMovie = "movie2";
      movie2.play();
    } else if (sensors[2] == 1)
    {
      print("Play Movie 3");
      currentMovie = "movie3";
      movie3.play();
    }
  } else
  {
    // do nothing (if a movie is playing do nothing)
  }

  // show the movie frames

  if (currentMovie == "movie1")
  {
    if (movie1.available())
    {
      image(movie1, 0, 0);
    } else
    {
      currentMovie = "";    // if a frame is available, show the next frame. This means once the video ends it will play nothing.
    }
  } else if (currentMovie == "movie2")
  {
    if (movie2.available())
    {
      image(movie2, 0, 0);
    } else
    {
      currentMovie = "";
    }
  } else if (currentMovie == "movie3")
  {
    if (movie3.available())
    {
      image(movie3, 0, 0);
    } else
    {
      currentMovie = "";
    }
  }
}

void serialEvent(Serial myPort) {

  // read the serial buffer:
  String myString = myPort.readStringUntil(linefeed);

  // if you got any bytes other than the linefeed:
  if (myString != null) {

    myString = trim(myString);

    // split the string at the commas
    // and convert the sections into integers:

    pSensors = sensors;
    sensors = int(split(myString, ','));

    // print out the values you got:

    for (int sensorNum = 0; sensorNum < sensors.length; sensorNum++) {
      print("Sensor " + sensorNum + ": " + sensors[sensorNum] + "\t");
    }

    // add a linefeed after all the sensor values are printed:
    println();
  }
}

void movieEvent(Movie m) {
  m.read();
}

how can i play alpha transparent video without P3D OR P2D render ?

any help will be good

Thanks.

mycode:

import processing.video.*;
Movie mov;
PImage img;

Capture cam;

void setup() {
  size(640, 480);
  frameRate(30);

  mov = new Movie(this, "../../../files/movie/Final.mov");
  mov.play();

  cam = new Capture(this, 640, 480);
  cam.start();
}

void draw() {

  background(0);
  image(cam, 0, 0);
  image(mov, 0, 0);

}

void movieEvent(Movie m) {
  m.read();
}
void captureEvent(Capture cam) {
  cam.read();
}

import processing.serial.*;

import cc.arduino.*;
import org.firmata.*;


import processing.video.*;

Arduino arduino;

Movie oneDegree, twoDegrees, threeDegrees;


int sensorPin = 0;    // select the input pin for the potentiometer
int val;



void setup() {
  size(960, 540);
  arduino = new Arduino(this, Arduino.list()[3], 57600); //sets up arduino
   val = arduino.analogRead(sensorPin); 
   println(Arduino.list());
   oneDegree = new Movie(this, "comp1.mp4");
   twoDegrees = new Movie(this, "comp2.mp4");
   threeDegrees = new Movie(this, "comp3.mp4");


}

void draw() {
 val = arduino.analogRead(sensorPin); 
 println(val);
 image(oneDegree, 0, 0);
 image(twoDegrees, 0, 0);
 image(threeDegrees, 0, 0);

  if(val > 10 && val < 348) { 
    oneDegree = new Movie(this, "comp1.mp4");
    oneDegree.play();
  }

  else if(val > 348 && val < 686) {
  twoDegrees = new Movie(this, "comp2.mp4");
    twoDegrees.play();
  }

  else if(val > 686 && val < 1024) {
   threeDegrees = new Movie(this, "comp3.mp4");
  threeDegrees.play();
  }

  if (oneDegree.time() == oneDegree.duration()) { //movie must be finished
twoDegrees.play();
  }
if (twoDegrees.time() == twoDegrees.duration()) { //movie must be finished
threeDegrees.play();
}
}

void movieEvent(Movie m) {
  m.read();
  /* if (m == oneDegree) {
    oneDegree.read();
  } 
  else if (m == twoDegrees) {
    twoDegrees.read();
  }
  else if (m == threeDegrees) {
    threeDegrees.read();
  }*/
}



/* void movieEvent(Movie ) {
  if (val <= 348) {
    oneDegree.read();
  } 
  else if (val > 348 && val <= 686) {
    twoDegrees.read();
  }

  else if (val > 686 && val <= 1024) {
    threeDegrees.read();
  }
} */

Below is my code, any help is appreciated!

import processing.video.*;

float joystick_yaw, joystick_speed;
Movie movie;
PShader shader;
float yaw, pitch, fov;
boolean isPaused = false;

void setup() {
  size(1280, 720, P2D);
  // pitch and yaw set to start video in desired view
  yaw   = 225;
  pitch = 5;
  fov   = 80;
  shader = loadShader("data/video360.glsl");
  shader.set("resolution", float(width/2), float(height/2));
  shader.set("yaw", yaw);
  shader.set("pitch", pitch);
  shader.set("fov", fov);
  movie = new Movie(this, "stitch_high.mp4");
  movie.play();
  movie.volume(0);
  while (movie.height == 0) {
    println("waiting " + second()); 
    delay(10);
  }

  imageMode(CORNERS);
}

void draw() {
  // display video  
  shader(shader);
  image(movie, 0, 0, width, height);

  // display yaw
  joystick_yaw = map(mouseX, 0, 1200, yaw-(fov/3), yaw+(fov/3)); 
  shader.set("yaw", joystick_yaw);

  //choose speed of video
  joystick_speed = map(mouseY, 0, height, 2, -2); 

  if (joystick_speed > 0.2 && isPaused ) {
    movie.speed(joystick_speed);
    movie.play();
    movie.speed(joystick_speed);
    isPaused = false;
  } else if (joystick_speed < -0.2 && isPaused) {
    movie.speed(joystick_speed);
    movie.play();
    movie.speed(joystick_speed);
    isPaused = false;
  } else if (joystick_speed >= -0.2 && joystick_speed <= 0.2) {
    if (!isPaused) {
      movie.pause();
      isPaused = true;
    }
  }
}

// Called every time a new frame is available to read
void movieEvent(Movie m) {
  m.read();
}

If anyone has any advice or can test this out it would be greatly appreciated. Thanks everyone!

import processing.video.*; 

Movie myMovie;

boolean mouseInCorrectLocationToPlayVideo;

boolean hasMovieEnded;

float movieEndDuration = 0.1;

int whichSceneIAmCurrentlyOn = 0; 

void setup(){
size(640, 480);
frameRate(30);

loadScene1();

}    

void draw(){
println(millis());

    //Checking if movie has ended.
    //If movie has not yet ended, check mouseX & Y location. 
    // If mouse is in these boundaries, mouseInCorrectLocationToPlayVideo is true.  
   if (hasMovieEnded == false){
      if ((mouseX < 213) && (mouseY <= 240)){
        if((mouseX > 0) && (mouseY >= 0)){

            mouseInCorrectLocationToPlayVideo = true;  
         }
       }
     }

    //If mouse X & Y are not in these boundaries, print out.   
     if(mouseInCorrectLocationToPlayVideo == false){
     println("not in boundaries");
   }

   //If mouse X & Y are in these boundaries, play video.
   if (mouseInCorrectLocationToPlayVideo == true) { 
    myMovie.play();
    image(myMovie, 0, 0);
    //println("1:" + frameCount);

    //When movie ends, dispose of movie file from memory. 
    if  ((myMovie.time() + movieEndDuration) >= myMovie.duration()){

      myMovie.dispose();
      unregisterMethod("dispose", myMovie);
      g.removeCache(myMovie);
      println("current movie finished file dumped");

      //Movie has ended. 
      hasMovieEnded = true; 
      //MouseX and Y are not within stated boundaries anymore. 
      mouseInCorrectLocationToPlayVideo = false; 

      //  if (millis() > 10*1000){ //not working
        if (whichSceneIAmCurrentlyOn == 1){
           reset();  
           loadScene2();
         }
      //   }
        else if (whichSceneIAmCurrentlyOn == 2){
          reset();   
          loadScene3();
        }  

    }          
  }  
} //closes draw

void reset(){
 // mouseInCorrectLocationToPlayVideo = false; //not needed
  hasMovieEnded = false;
}

void loadScene1(){

   myMovie = new Movie(this, "tileScene1.mp4");
   whichSceneIAmCurrentlyOn = whichSceneIAmCurrentlyOn + 1;
}

void loadScene2(){

    myMovie = new Movie(this, "tileScene2.mp4");
    whichSceneIAmCurrentlyOn = whichSceneIAmCurrentlyOn + 1;
}

void loadScene3(){

    myMovie = new Movie(this, "tileScene3.mp4");
    whichSceneIAmCurrentlyOn = whichSceneIAmCurrentlyOn + 1;
}


void movieEvent(Movie m) {
   if (m == myMovie) {
    myMovie.read();
  }
}

I am wanting to replace the following code. I have a capacitive touch sensor attached to processing that opens up a random image every time the sensor is held, when the sensor is let go this image disappear.

I want to essentially replace the image files with 26 short video clips at 25 frame rate. Im not sure how to change this code to make that happen.

Any help would be great!

import processing.serial.*;

int threshold = 30; 
PImage [] picArray = new PImage [26]; 
Serial myPort;

boolean holdImage=false;
int imgIndex;

void setup() {
  size (500, 500);

  for (int i=0; i<picArray.length; i++)
    picArray[i]=loadImage(i + ".png");

  myPort = new Serial(this, Serial.list()[1], 9600);
  myPort.bufferUntil('\n');
}


void draw() {

  background (255, 255, 255); 
  if (holdImage==true) { 
    image(picArray[imgIndex], 0,0);
  }
}


void serialEvent(Serial myPort) {

  String inString = myPort.readStringUntil('\n');

  if (inString != null) {

    inString = trim (inString);
    float[] touches = float (split(inString, ","));

    if (touches.length >=1) {
      int touch1Value = touches[0] >= threshold ? 1: 0;

      if (touch1Value == 1) {
        if (holdImage == false) {
          imgIndex=int(random(picArray.length));
          holdImage=true;
        }
      } else
        holdImage=false;  //RELEASE holder so to detect next usr press event
    }
  }
}

How can I play a clip from a starting point which is not the beginning of a loaded clip? How can I set the duration of the grains?

I'm using the default video library.

import processing.video.*;

Movie video;

void setup() {
  size(600, 400);
  video = new Movie(this, "station.mov");
  video.loop();
}

void movieEvent(Movie video){
  video.read();
}

void draw() {
  image(video, 0, 0);
}

I'm posting this code in the hope that it might help others and maybe to find a solution that works in Processing 3.x

here's the code with lots of comments and link to a reliable test video:

/*
 An example of frame accurate interactive video playback
 Tested working for frame accurate interactive viewing of videos at 25fps and 30fps - any length.
 This only works in processing 1.5.1
 I cannot get it working in newer versions of Processing
 This is probably due to the switch to the gstreamer library

 Easiest way to check it's working is to use a movie file with the
 correct frame number printed on each frame so you can spot skipping frames
 as you use the keys: -/+ to navigate.

 The suitable video for this sketch (with it's numbered frames) can be d/ld here:
 http://33dd.com/processing/100_Numbered_frames_30fps.mov
 */

import processing.video.*; 
Movie myMovie; 
float movieFps=30.00;//fps of the movie - please set to match your movie file
float advanceLength = 1/(movieFps-0.01);//get length of one frame in seconds - and subtract 0.01 (why -0.01 I don't know??)
//this movie is 30fps - but sketch is only accurate if we declare fps as 29.99fps - why??

void setup()
{ 
  size(640, 320, P2D);//P2D needed for processing 1.5.--
  //size(640, 320);//use this method in processing 2.++ - no more P2D
  background(0); 

  //load a movie with visible framenumbers - makes it easier to check accuracy
  myMovie = new Movie(this, "100_Numbered_frames_30fps.mov"); //see link at top for video source
  myMovie.loop();//play the movie
  myMovie.speed(0);//best way to stop the movie - pause() halts the thread - so we must use speed(0)
} 

void movieEvent(Movie myMovie)
{ 
  myMovie.read();
} 

void draw()
{ 
  image(myMovie, 0, 0, width, height);
} 

void keyPressed()
{ //use - / +  keys to go back and forward one frame
  if (key == '-')
  {
    if (myMovie.time() < advanceLength)//if movie time < 1 frame jump to start of movie (another hack needed to make it work)
    {
      myMovie.jump((myMovie.time() - advanceLength) % 0);
    } else  
    {//for some reason this only works accurately if we jump backwards then forward one frame
      myMovie.jump((myMovie.time() - advanceLength) % myMovie.duration()); 
      myMovie.jump((myMovie.time() + advanceLength) % myMovie.duration());
    }
  }  
  if (key == '=')
  {
    //jump forward by one frame 
    myMovie.jump((myMovie.time() + advanceLength) % myMovie.duration());
  }
}

How can I process and save every frame? How can I halt the next frame from the videostream until the frame is processed and saved?

Below is a print of the videoFrame from the videostream and the frame that is saved. As you can see only about every fourth frame is processed and saved

VideoFrame: 0 FRAMERATE: 18.936382
savedFrame: 1
VideoFrame: 1 FRAMERATE: 22.489614
VideoFrame: 2 FRAMERATE: 22.489614
VideoFrame: 3 FRAMERATE: 22.489614
VideoFrame: 4 FRAMERATE: 22.489614
VideoFrame: 5 FRAMERATE: 22.489614
VideoFrame: 6 FRAMERATE: 22.489614
savedFrame: 7
VideoFrame: 7 FRAMERATE: 20.717686
VideoFrame: 8 FRAMERATE: 20.717686
VideoFrame: 9 FRAMERATE: 20.717686
VideoFrame: 10 FRAMERATE: 20.717686
savedFrame: 11
VideoFrame: 11 FRAMERATE: 19.62102
VideoFrame: 12 FRAMERATE: 19.62102
savedFrame: 13
VideoFrame: 13 FRAMERATE: 18.655874
VideoFrame: 14 FRAMERATE: 18.655874
VideoFrame: 15 FRAMERATE: 18.655874
savedFrame: 16
VideoFrame: 16 FRAMERATE: 17.817186
VideoFrame: 17 FRAMERATE: 17.817186
VideoFrame: 18 FRAMERATE: 17.817186
VideoFrame: 19 FRAMERATE: 17.817186
savedFrame: 20
VideoFrame: 20 FRAMERATE: 17.098238
VideoFrame: 21 FRAMERATE: 17.098238
savedFrame: 22
VideoFrame: 22 FRAMERATE: 16.579494
VideoFrame: 23 FRAMERATE: 16.579494

Heres my sketch:

import processing.video.*;

Movie m;

int res = 5;
PVector loc;
int frameCounter = 0;
boolean export = false;
int frame = 0;

void settings() {
  size(960, 540);
}

void setup() {
  m = new Movie(this, "video.mp4");
  loc = new PVector(0, 0);
  m.play();
  m.loop();

  background(255);
  ellipseMode(LEFT);
}

void movieEvent(Movie m) {
  if (m.available()) {
    println("VideoFrame: " + frame + "  FRAMERATE: " + frameRate);
    frame++;
    m.read();
  }
}

void draw() {
  println("savedFrame: " + frame);
  run();
}

void run() {
  for (int i = 0; i <  m.width/res; i++) {
    for (int j = 0; j < m.height/res; j++) {
      loc.x = i*res;
      loc.y = j*res;

      color col = m.pixels[(int)loc.x  + (int)loc.y * m.width];
      noStroke();
      fill(col);
      ellipse(loc.x, loc.y, res, res);
    }
  }

  if (export && frameCounter < 3600) {
    saveFrame("frames/####.png");
    frameCounter++;
  } 

  if (frameCounter > 3598) {
    println("EXPORT KLAR");
  }
}

void keyReleased() {
  println("export"+ export + "  frameRate: " + frameRate + " frameCounter: " + frameCounter);
  if (key == 'e') {
    frameCounter = 0;
    println("export"+ export + "  frameRate: " + frameRate);
    export = !export;
  }
}

import processing.video.*;

int numPixels;
int[] previousFrame;
Movie video;

void setup() {
  size(1920, 1080);

  // This the default video input, see the GettingStartedCapture 
  // example if it creates an error
  video = new Movie(this, "abc.mp4");

  // Start capturing the images from the camera
     video.loop(); 
   //video.read(); 
  numPixels = video.width * video.height;
  // Create an array to store the previously captured frame
  previousFrame = new int[numPixels];
  loadPixels();

}

void draw() {
  if (video.available()) {

    // When using video to manipulate the screen, use video.available() and
    // video.read() inside the draw() method so that it's safe to draw to the screen
    video.read(); // Read the new frame from the camera
    video.loadPixels(); // Make its pixels[] array available
    image(video, 0, 0);
    int movementSum = 0; // Amount of movement in the frame
    for (int i = 0; i < numPixels; i++) { // For each pixel in the video frame...
      color currColor = video.pixels[i];
      color prevColor = previousFrame[i];
      // Extract the red, green, and blue components from current pixel
      int currR = (currColor >> 16) & 0xFF; // Like red(), but faster
      int currG = (currColor >> 8) & 0xFF;
      int currB = currColor & 0xFF;
      // Extract red, green, and blue components from previous pixel
      int prevR = (prevColor >> 16) & 0xFF;
      int prevG = (prevColor >> 8) & 0xFF;
      int prevB = prevColor & 0xFF;
      // Compute the difference of the red, green, and blue values
      int diffR = abs(currR - prevR);
      int diffG = abs(currG - prevG);
      int diffB = abs(currB - prevB);
      // Add these differences to the running tally
      movementSum += diffR + diffG + diffB;
      // Render the difference image to the screen
      pixels[i] = color(diffR, diffG, diffB);
      // The following line is much faster, but more confusing to read
      //pixels[i] = 0xff000000 | (diffR << 16) | (diffG << 8) | diffB;
      // Save the current color into the 'previous' buffer
      previousFrame[i] = currColor;
    }
    // To prevent flicker from frames that are all black (no movement),
    // only update the screen if the image has changed.
    if (movementSum > 0) {
      updatePixels();
      println(movementSum); // Print the total amount of movement to the console
    }
  }
}

I am very new to Processing so would appreciate your help.

I have 4 objects painted with BARE conductive electric paint. I have 4 short video clips for each object. Each object has its own video clip. I need a video clip to play when an object is being continuously touched, and for it to pause when the hand is taken off the object.

I have connected a Makey Makey + Alligator clips to the conductive painted objects and also the space bar on the makey makey board. I used the paint on the table surface, so when touching this and the painted object the cursor space is moving in a text doc (just to test).

One of my videos is called M1.mov

The code I have at the moment is but I don't know if it is any good?

import processing.video.*; Movie M1;

void setup() { size(640, 360); background(255); M1 = new Movie(this, "M1.mov"); }

void draw() { background(0); }

void keyPressed() {

if (key == 'r') { image(M1, 0, 0); println("r"); } }

void movieEvent(Movie m) { m.read(); }

Many thanks to all who can help, Vara

So I've been using Processing for the last couple of weeks, and have been trying to incorporate it in to my final project for University. I've so far created a working clock based on the designs of the old BBC clocks that used to play when the channels shut down for the night, and what I'm looking to do is essentially trigger a video to play at a certain time of the day (on the hour is ideal), play through, finish, return to the clock, and repeat. Now, I have a rough idea of how I could do it, but I want to see if there are any easier ways to go about this than what I was thinking.

Thanks!