OpenCV eye tracking.

apotdd

in Contributed Library Questions • 1 year ago

Hi all. I'm completely new to Processing, but I need to make the following: I want Processing (or better said, OpenCV) to import video from the webcam input, then recognize the eyes of a face (and after that, I want an image to be placed over the eyes, but that's for later).

So, I tried downloading OpenCV, which came with some examples, of which I thought the "Face Recognition" example was the closest to what I want. This is what I have now (pretty much just the code from the example). The face recognition works fine.

Now, I also found this topic, saying there already is a pre-made cascade to recognize eyes, which could be found here. So I downloaded the "frontalEyes35x16XML.zip" file, unzipped it and place it on the Resources folder of my OpenCV (as told in the topic). However, I'm stuck from that point. I can't figure out how to switch from the face recognition cascade to the eye recognition cascade. I'm also not sure if I still need something to properly install it (edit the OpenCV.java file?).

Anyone who could help me with this (probably simple to solve) problem?

Replies(2)

dr.mo

Re: OpenCV eye tracking.

1 year ago

i've never used openCV in processing - but in the C++ version you just specify a filename for the cascade. sorry this is probably not much help.

if all else fails i guess you could try to located the face recognition cascade and replace it with the eye one but keeping the name.

apotdd

Re: OpenCV eye tracking.

1 year ago

What I already tried to do was edit the OpenCV.java file. I added this line (as described in the topic which I referred to):

public static final String CASCADE_FRONTALEYES = "haarcascade_frontaleyes.xml";

underneath this line (which refers to the face recogniton):

public static final String CASCADE_FRONTALFACE_ALT = "haarcascade_frontalface_alt.xml";

But then still, I don't know how to refer to this in Processing itself. When I look again at the other topic, it tells me to change this:

opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT2 );

to this:

opencv.cascade( "haarcascade_frontaleyes.xml" );

But then I still have this line:

Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

That refers to the face recognition thing, not the eye recognition. But I have no clue where this "HAAR_DO_CANNY_PRUNING" is coming from, since I can only find it in this OpenCV.java file. But how am I supposed to know what I should write when using the frontaleyes cascade? I also don't know if I still have to change other things.

I have even less experience (yes, it's possible!) with C++, so I think that isn't the best way out either. I tried what you said, and just replaced them, but this doesn't seem to have any effect. I'm not sure whether editing the OpenCV.java files makes any difference at all in the first place.

Top Reply