playing sound when in view of cam

Core Library Questions

rottjung

playing sound when in view of cam

in Core Library Questions • 1 year ago

hey

I'm quite new to processing (come from unity).

I'm trying to set up a project where the cam detects if some one is in it's view and if so plays a sample unitl they step out of view.

I was thinking to do it with a top down camera that films a white square on the floor, any other color coming into the view is viewed as black and then simply do something like: if (black > white) player.play();

i got a hard time changing the motion detect script to the compare i need, so not motion based but color based, also with letting the cam see black&white instead of colors.

if someone could give me some example codes for these two part, i can figure out the rest myself ;-)

thanks

Replies(3)

rottjung

Re: playing sound when in view of cam

1 year ago

ok i kinda got it to work, but the sample sound real chopped up...? any ideas whats causing this?

here's the code:

import ddf.minim.*;
Minim minim;
AudioPlayer player;
import codeanticode.gsvideo.*;
GSCapture video;
// BG Frame
PImage BGFrame;
// How different must a pixel be to be a "motion" pixel
float threshold =200;
float diff=0.0;
void setup() {
size(320, 240); // Change size to 320 x 240 if too slow at 640 x 480
video = new GSCapture(this, width, height, 24);
video.start();
// Create an empty image the same size as the video
BGFrame = createImage(video.width,video.height,RGB);
loadPixels();
minim = new Minim(this);
player = minim.loadFile("sample.mp3", 2048);
}
void draw() {
if (video.available()) {
video.read();
}
loadPixels();
video.loadPixels();
BGFrame.loadPixels();
// Begin loop to walk through every pixel
for (int x = 0; x < video.width; x ++ ) {
for (int y = 0; y < video.height; y ++ ) {
int loc = x + y*video.width; // Step 1, what is the 1D pixel location
color current = video.pixels[loc]; // Step 2, what is the current color
color previous = BGFrame.pixels[loc]; // Step 3, what is the previous color
// Step 4, compare colors (previous vs. current)
float r1 = red(current); float g1 = green(current); float b1 = blue(current);
float r2 = red(previous); float g2 = green(previous); float b2 = blue(previous);
diff = dist(r1,g1,b1,r2,g2,b2);
// Step 5, How different are the colors?
// If the color at that pixel has changed, then there is motion at that pixel.
if (diff > threshold) {
// If motion, display black
pixels[loc] = color(0);
player.play();
} else {
// If not, display white
pixels[loc] = color(255);
player.pause();
}
}
}
updatePixels();
}
void keyPressed() {
video.loadPixels();
BGFrame.copy(video,0,0,video.width,video.height,0,0,video.width,video.height);
}
void stop()
{
// always close Minim audio classes when you are done with them
player.close();
minim.stop();
super.stop();
}

rottjung

Re: playing sound when in view of cam

1 year ago

no advice...?

rottjung

Re: playing sound when in view of cam

1 year ago

ok so should anybody ever needs this, this is working quite well

i inverted the black and white because it was needed in a darkroom where a light is switched on by motion detection

import ddf.minim.*;
Minim minim;
AudioPlayer player;
import codeanticode.gsvideo.*;
GSCapture video;
// BG Frame
PImage BGFrame;
// How different must a pixel be to be a "motion" pixel
float threshold =15;
float diff=0.0;
boolean BGS=false;
void setup() {
size(320, 240); // Change size to 320 x 240 if too slow at 640 x 480
video = new GSCapture(this, width, height, 24);
video.start();
// Create an empty image the same size as the video
BGFrame = createImage(video.width,video.height,RGB);
loadPixels();
minim = new Minim(this);
player = minim.loadFile("sample.mp3", 2048);
}
void draw() {
if (video.available()) {
video.read();
}
loadPixels();
video.loadPixels();
BGFrame.loadPixels();
// Begin loop to walk through every pixel
for (int x = 0; x < video.width; x ++ ) {
for (int y = 0; y < video.height; y ++ ) {
int loc = x + y*video.width; // Step 1, what is the 1D pixel location
color current = video.pixels[loc]; // Step 2, what is the current color
color previous = BGFrame.pixels[loc]; // Step 3, what is the previous color
// Step 4, compare colors (previous vs. current)
float r1 = red(current); float g1 = green(current); float b1 = blue(current);
float r2 = red(previous); float g2 = green(previous); float b2 = blue(previous);
diff = dist(r1,g1,b1,r2,g2,b2);
if (diff > threshold) {
// If BGS, display black
pixels[loc] = color(255);
BGS=true;
}else{
// If not, display white
pixels[loc] = color(0);
BGS=false;
}
}
}
if(BGS){
player.play();
}else{
player.pause();
}
updatePixels();
print(BGS);
print(diff);
}
void keyPressed() {
video.loadPixels();
BGFrame.copy(video,0,0,video.width,video.height,0,0,video.width,video.height);
}
void stop()
{
// always close Minim audio classes when you are done with them
player.close();
minim.stop();
super.stop();
}

Top Reply