Motion Tracking in Video File

Core Library Questions

debashish

Motion Tracking in Video File

in Core Library Questions • 1 year ago

Hi,

I want track motion in a video, so I kinda modified the code given here to following:

// Learning Processing
// Daniel Shiffman
// http://www.learningprocessing.com
// Example 16-13: Simple motion detection
import processing.video.*;
// Variable for capture device
//Capture video;
Movie video;
// Previous Frame
PImage prevFrame;
// How different must a pixel be to be a "motion" pixel
float threshold = 50;
void setup() {
size(320,240);
//video = new Capture(this, width, height, 30);
video = new Movie(this, "D:\\M2U00569.mov");
video.play();
// Create an empty image the same size as the video
prevFrame = createImage(video.width,video.height,RGB);
}
void draw() {
//video.read();
// Capture video
if (video.available()) {
// Save previous frame for motion detection!!
prevFrame.copy(video,0,0,video.width,video.height,0,0,video.width,video.height); // Before we read the new frame, we always save the previous frame for comparison!
prevFrame.updatePixels();
video.read();
}
loadPixels();
video.loadPixels();
prevFrame.loadPixels();
// Begin loop to walk through every pixel
for (int x = 0; x < video.width; x ++ ) {
for (int y = 0; y < video.height; y ++ ) {
int loc = x + y*video.width; // Step 1, what is the 1D pixel location
color current = video.pixels[loc]; // Step 2, what is the current color
color previous = prevFrame.pixels[loc]; // Step 3, what is the previous color
// Step 4, compare colors (previous vs. current)
float r1 = red(current); float g1 = green(current); float b1 = blue(current);
float r2 = red(previous); float g2 = green(previous); float b2 = blue(previous);
float diff = dist(r1,g1,b1,r2,g2,b2);
// Step 5, How different are the colors?
// If the color at that pixel has changed, then there is motion at that pixel.
if (diff > threshold) {
// If motion, display black
pixels[loc] = color(0);
} else {
// If not, display white
pixels[loc] = color(255);
}
}
}
updatePixels();
}

Modified line 11, 12 and 20.

I am getting an error at line 47

Exception in thread "Animation Thread" java.lang.ArrayIndexOutOfBoundsException: 720

at sketch_mar24a.draw(sketch_mar24a.java:67)

at processing.core.PApplet.handleDraw(Unknown Source)

at processing.core.PApplet.run(Unknown Source)

at java.lang.Thread.run(Thread.java:662)

Please do lemme know where I am doing wrong!

Thanks!

Replies(13)

maleo

Re: Motion Tracking in Video File

1 year ago

I think the issue is video.width and video.height will give you values like 0 or 1 the first couple of seconds...

so i'd suggest having a fixed video size in places like line 23 and insert a condition at the beginning of draw that checks that video.width & video.height give the desired values.

also i think your canvas should be the size of the video.

this is the quickest fix i could come up with:

import processing.video.*;
// Variable for capture device
//Capture video;
Movie video;
// Previous Frame
PImage prevFrame;
// How different must a pixel be to be a "motion" pixel
float threshold = 50;
int W = 640;
int H = 480;
void setup() {
size(W,H);
//video = new Capture(this, width, height, 30);
video = new Movie(this, "D:\\M2U00569.mov");
video.play();
// Create an empty image the same size as the video
prevFrame = createImage(W,H,RGB);
}
void draw() {
if (video.width < W || video.height < H) return;
//video.read();
// Capture video
if (video.available()) {
// Save previous frame for motion detection!!
prevFrame.copy(video,0,0,video.width,video.height,0,0,video.width,video.height); // Before we read the new frame, we always save the previous frame for comparison!
prevFrame.updatePixels();
video.read();
}
loadPixels();
video.loadPixels();
prevFrame.loadPixels();
// Begin loop to walk through every pixel
for (int x = 0; x < video.width; x ++ ) {
for (int y = 0; y < video.height; y ++ ) {
int loc = x + y*video.width; // Step 1, what is the 1D pixel location
color current = video.pixels[loc]; // Step 2, what is the current color
color previous = prevFrame.pixels[loc]; // Step 3, what is the previous color
// Step 4, compare colors (previous vs. current)
float r1 = red(current); float g1 = green(current); float b1 = blue(current);
float r2 = red(previous); float g2 = green(previous); float b2 = blue(previous);
float diff = dist(r1,g1,b1,r2,g2,b2);
// Step 5, How different are the colors?
// If the color at that pixel has changed, then there is motion at that pixel.
if (diff > threshold) {
// If motion, display black
pixels[loc] = color(0);
} else {
// If not, display white
pixels[loc] = color(255);
}
}
}
updatePixels();
}

debashish

Re: Motion Tracking in Video File

1 year ago

Maleo, thanks for the quick reply.

But the fix seems not to be working for me

I really need this fix. Can you suggest me some other options or code changes.

You are clear as what I am doing or should I let you know my purpose...???

maleo

Re: Motion Tracking in Video File

1 year ago

I had it working on processing 1.5.1 / mac os x. you have to set the appropriate video size in W and H too.

other than that i can only suggest building up your sketch step by step. start with just having the video play back normally. then add more sophisticated processing like difference techniques.

debashish

Re: Motion Tracking in Video File

1 year ago

According to this,

"Unfortunately the video handling in Processing is buggy"

How can I play video and analyse each frame at the same time without choppy video plays. The motto is to track the moving objects(multiple) in a video.

Please suggest...

Thanks again for the prompt reply Maleo

debashish

Re: Motion Tracking in Video File

1 year ago

Anyone..???

I wan;t help with the following code:

import processing.opengl.*;
import processing.video.*;
Movie video;
// Previous Frame
PImage prevFrame;
PImage currFrame;
// How different must a pixel be to be a "motion" pixel
float threshold = 50;
// Setting the default width and height for video
int vidWidth = 320;
int vidHeight = 240;
void setup()
{
size(vidWidth, vidHeight);
video = new Movie(this, "..\\mov_vid\\paris.mov", 60);
video.play();
// Create an empty image the same size as the video
currFrame = createImage(vidWidth, vidHeight, RGB);
}
void draw()
{
println("W: " + video.width + " H: " + video.height);
loadPixels();
currFrame = video;
if(video.width < vidWidth || video.height < vidHeight)
image(video, 0, 0);
updatePixels();
}
// Called every time a new frame is available to read
void movieEvent(Movie m)
{
m.read();
}

Why the video is choppy and plays for a while and then stops...???

Thanks in advance!

bustup

Re: Motion Tracking in Video File

1 year ago

I recommend you to take a look at the GSVideo library. What codec are you using for your movie?

debashish

Re: Motion Tracking in Video File

1 year ago

Actually I initially wanted to go with .mpg videos but its din't worked well with the Movie class; so settled with converting them to .mov.

This is what I am doing.

Can I create an array of picture frames from a movie using GSVideo Library...???

Thanks in advance!

debashish

Re: Motion Tracking in Video File

1 year ago

Hi I tried this example: http://gsvideo.sourceforge.net/examples/GLGraphics/Movie/Movie.pde

But its not working for me its giving me an error:

The method putPixelsIntoTexture(PImage) in the type GLTexture is not applicable for the arguments()

Thanks!

bustup

Re: Motion Tracking in Video File

1 year ago

You probably have an old version of GLGraphics. Download version 1.0 and it will work.

debashish

Re: Motion Tracking in Video File

1 year ago

Yeah bustup its working with the latest version thanks a ton for the update and answer...lemme see if am able to do whatever am planning to...

debashish

Re: Motion Tracking in Video File

1 year ago

Stuck with a new problem, phew!

Please help; this time with GSVideo and GLTexture

if(tex.putPixelsIntoTexture())

{

tex.resize(movWidth, movHeight);

PImage currFrame = new PImage(movWidth, movHeight);

tex.getImage(currFrame); <--------------------------------------- this line is causing the JVM to crash

//blobs = flob.calc(flob.binarize(currFrame)); <----------------------------- want to achieve this

//image(tex, 0, 0); <--------------------------------------- with this line the program of running fine

image(currFrame, 0, 0);

}

Where tex is a GLTexture object.

Detailed code:

// Using integration with GLGraphics for fast video playback.
// All the decoding stages, until the color conversion from YUV
// to RGB are handled by gstreamer, and the video frames are
// directly transfered over to the OpenGL texture encapsulated
// by the GLTexture object.
// You need the GLGraphics library (0.99+) to use this functionality:
// http://glgraphics.sourceforge.net/
import processing.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;
import s373.flob.*;
GSMovie movie;
GLTexture tex;
// width and height of the movie frame
int movWidth = 640;
int movHeight = 480;
// movie source path
String movPath = "C:\\Users\\Debu\\Desktop\\Processing Temp Sketches\\mov_vid\\M2U00569.mov";
// Flob parameters
Flob flob; // flob tracker instance
ArrayList blobs; // an ArrayList to hold the gathered blobs
// Flob config parameters
int tresh = 20; // adjust treshold value here or keys t/T
int fade = 25;
int om = 1;
int videores=128;//64//256
String info="";
PFont font;
float fps = 60;
int videotex = 3; //case 0: videotex = videoimg;//case 1: videotex = videotexbin;
//case 2: videotex = videotexmotion//case 3: videotex = videoteximgmotion;
void setup() {
size(movWidth, movHeight, GLConstants.GLGRAPHICS);
background(0);
movie = new GSMovie(this, movPath);
// Use texture tex as the destination for the movie pixels.
tex = new GLTexture(this);
movie.setPixelDest(tex);
movie.loop();
// flob uses construtor to specify srcDimX, srcDimY, dstDimX, dstDimY
// srcDim should be video input dimensions
// dstDim should be desired output dimensions
flob = new Flob(movie, width, height);
flob = new Flob(movie, this);
flob = new Flob(movWidth, movHeight, width, height);
flob.setTresh(tresh); //set the new threshold to the binarize engine
flob.setSrcImage(videotex);
flob.setImage(videotex); // pimage i = flob.get(Src)Image();
flob.setBackground(movie); // zero background to contents of video
flob.setBlur(0); //new : fastblur filter inside binarize
flob.setMirror(true,false);
flob.setOm(0); //flob.setOm(flob.STATIC_DIFFERENCE);
flob.setOm(1); //flob.setOm(flob.CONTINUOUS_DIFFERENCE);
flob.setFade(fade); //only in continuous difference
// or now just concatenate messages
flob.setThresh(tresh).setSrcImage(videotex).setBackground(movie)
.setBlur(0).setOm(1).setFade(fade).setMirror(true,false);
font = createFont("monaco",9);
textFont(font);
blobs = new ArrayList();
}
void movieEvent(GSMovie movie) {
movie.read();
}
void draw() {
// If there is a new frame available from the movie, the
// putPixelsIntoTexture() function will copy it to the
// video card and will return true.
/*if(movie.available())
{
//println("true");
movie.read();
blobs = flob.calc(flob.binarize(movie));
}*/
if(tex.putPixelsIntoTexture())
{
tex.resize(movWidth, movHeight);
PImage currFrame = new PImage(movWidth, movHeight);
println(currFrame);
tex.getImage(currFrame);
//blobs = flob.calc(flob.binarize(currFrame));
//image(tex, 0, 0);
image(currFrame, 0, 0);
//println(tex);
}
//image(flob.getSrcImage(), 0, 0, width, height);
//println(flob.getSrcImage());
}

Based on the hello_flob.pde example; Flob Library.

Thanks in advance!

I happened to check the following page of the forum

Thanks in advance and cheers for the support as a newbie am getting; want to learn it very fast so that I can help others... :)

debashish

Re: Motion Tracking in Video File

1 year ago

Please somebody help...am stuck and desperately need help!

Thanks in advance!

tanja.mik..

Re: Motion Tracking in Video File

1 year ago

Is possible to do it with combination of code of this videocapx software http://www.videocapx.com they offer source code.

Top Reply