Multimedia Interaction with Processing

demarcogiu

Hi all!

I have a project in my mind for my children. I would put a camera and a projector on the ceiling.

The projectro should display an animated fish. The camera should capture the kids (maybe wearing a red hat).

Processing should:

• read the video frame and extract the position of the red hats;
• move the fish towards the positions of the red

Do you think is it possible in Processing? Regards

KevinWorkman

Sure, this sounds possible. I know it's possible to use a Kinect or OpenCV with Processing.

clankill3r

I made some changes to the keystone library:

https://github.com/clankill3r/keystoned

Look at the Backward_mapping example. I think this can help.

demarcogiu

Thank you guys. @Kevin do you some pointers in regard? Thk

KevinWorkman

It's hard to help with general "how do I do this" type questions other than by pointing you to google. What research have you done so far?

kfrajer

Tagging @raj: You could be interested in this challenge.

Kf

jeremydouglass

read the video frame and extract the position of the red hats;

Blob detection. Use OpenCV or BoofCV to get the coordinates of the centroid of each blob (red hat)

move the fish towards the positions of the red

PVector.lerp -- interpolate between a blob position and a fish position. You could first calculate the distance to each blob and head toward the closest one.

demarcogiu

Ok. I'll try some coding and make some github repo. Let's talk again in a couple of days...Thanks.

jeremydouglass

@demarcogiu -- good luck!