Hi guys, im using the kinect with SimpleOpenNI through processing, ive managed to get all the skeleton tracking and hand tracking, but my concept is trying to use the hand data as a mouse cursor.

Below is my code, im using a drawSkeleton Class attached to the sketch, this simpy uses a custom regonition/ calibration that ive saved, it pretty much instantly recgonises me and my hand, using a sketch i wrote to save the gesture as a .skel, it works with my much larger house mate aswell. The eclipse is just to show it tracking my hand.

The problem is i cant figure out how to convert the "convertedRightHand.x, convertedRightHand.y" for use with the mouseX, mouseY commands the "convertedRight.." is an int, while mouseX is a float, i cant figure a way to convert the two.

The other is, once achived how would i interactive with the compter as a mouse?

Your Help is apreacited! thank you!

Main sketch

1. import SimpleOpenNI.*;
   SimpleOpenNI kinect;
   
   int calibratedUserID = 0;
   
   void setup(){
      frameRate(30);
     size(640, 480);
     kinect = new SimpleOpenNI(this);
     kinect.enableDepth();
2. 
     //enable skeleton generation for all joints
     kinect.enableUser(SimpleOpenNI.SKEL_PROFILE_ALL);
   }
   
   void draw(){
     kinect.update();
     PImage depth = kinect.depthImage();
     image(kinect.depthImage(), 0, 0);
      
   
3.  IntVector userList = new IntVector();
     if (kinect.isTrackingSkeleton(calibratedUserID));
     drawHands();
    //  println(frameRate);
   }
   
   void onNewUser(int userId) {
     println("start pose detection");
     if (kinect.loadCalibrationDataSkeleton(userId, "calibration.skel")) {
       println("calibration succeeded");
       calibratedUserID = userId;
       kinect.startTrackingSkeleton(calibratedUserID);
     }else{
       println("calibration failed!");
     }
   }
   
   
   void drawHands(){
      int userId = calibratedUserID;
4. 
     //make a vector to store the left hand
           PVector rightHand = new PVector();
           //put the position of the left hand into the vector
           float confidence = kinect.getJointPositionSkeleton(userId,
   
5.                                                                                           SimpleOpenNI.SKEL_LEFT_HAND, rightHand);
6. 
           //convert the detected hand postion, to projective co-ords, that match the depth image
           PVector convertedRightHand = new PVector();
        
           kinect.convertRealWorldToProjective(rightHand, convertedRightHand);
         //display it
           fill(255,0,0);
           ellipse(convertedRightHand.x, convertedRightHand.y, 10, 10);
   }