We are about to switch to a new forum software. Until then we have removed the registration on this forum.
I've been using the kinect 2 and it works pretty well in Processing 3 but now I want to develop some interactivity.
What I want to do is to get the data from the 3D skeleton and tell what object the user is pointing to.
Like point at the lamp and the lamp turns on.
Point at the PC a video starts playing.
Controlling the objects is easy but I'm having a lot of trouble conceptualizing the 3D picking.
How do I detect what the 3D skeleton is pointing at? I can imagine I should cast a ray out of their hand down the finger and check the intersection with collision detection spheres but I have no clue how to implement that. I've tried with some vectors but I just can't check collisions with them. I've read some of the 3D picking threads but they all talk about picking objects with the mouse.
Can anyone help me with this? I'm using the latest processing 3.3.5.