We closed this forum 18 June 2010. It has served us well since 2005 as the ALPHA forum did before it from 2002 to 2005. New discussions are ongoing at the new URL http://forum.processing.org. You'll need to sign up and get a new user account. We're sorry about that inconvenience, but we think it's better in the long run. The content on this forum will remain online.
Page Index Toggle Pages: 1
multi touch library? (Read 4578 times)
multi touch library?
Mar 28th, 2007, 5:56pm
 
hello everyone,

I've made a multi touch interface and am currently using a combination of processing, vvvv, touchlib, oscp5 libraries, to run the interface.

touchlib, is only windows.
http://www.whitenoiseaudio.com/touchlib/

Just wondering, if is it possible, or even reasonable, to put together a library within processing/java, to get around being limited to windows? (the library would read a webcam and produce signals when blobs are detected).

I'm just trying to see if its worth it to make right now. Would writing in java mean performance decrease? or increase?

thanks,
richard

Re: multi touch library?
Reply #1 - Mar 4th, 2008, 10:43am
 
http://nuigroup.com/wiki/touchlib/
Here's a wiki on how to install on windows, mac os x, or ubuntu..
best of luck!
Let me know if you get anything decentlooking in processing. i'd love to test it Wink
Re: multi touch library?
Reply #2 - Mar 6th, 2008, 6:00pm
 
Hello.

I'm working on Multi-touch as well. I'm using touchlib at the moment, on Windows, but I've also used the JMyron library for blob detection, and wrote a bit of code in processing to match up blobs between frames etc. Trouble is, you need to do a lot of work, to match the capabilities of touchLib, including the corrective background filter, and the calibration program.

Also, using JMyron is really heavy, and I ended up needing two computers just to do basic tracking and some simple GUI stuff.

I think you'd be better off trying to get touchLib compiled on OSX, and going down that route.

Just my experiences.

Robin

Re: multi touch library?
Reply #3 - Mar 6th, 2008, 6:22pm
 
thanks for the replies, but I agree at this point using the touchlib libraries seem to be the most efficient at detecting the blobs.

A lot of these other packages tend to be very processor heavy. Since using a webcam to track the IR blobs is a computationally heavy task, it'd be best to have a better piece of hardware to compute the blobs.

I've recently been playing with "multipoint interactive whiteboards using the wiimote." And have noticed using the nintendo wii is not so computationally intensive.

it'd be interesting if you could substitute the wii controller w/ the webcam to process IR blobs, to hopefully reduce the computational load of this stuff.

and it'll be interesting to see how apple/fingerworks multitouch libraries will compare to whats available now.

http://www.cs.cmu.edu/~johnny/projects/wii/
Re: multi touch library?
Reply #4 - Mar 6th, 2009, 10:45pm
 
Have u tried using Processing, TUIO-protocoll with tBeta?
It works very good.

Now the only problem is that processing doesnt have any api for gestures....??

Is anybody here rendering the gestures with processing?
Re: multi touch library?
Reply #5 - Mar 7th, 2009, 12:34am
 
Hi everybody,
i realized a MT-Project with this Combination:
Tracker: Tbeta
Frontend: Java with the TUIO Code from the reactivision project.
I think it's the way to go. TBeta  is cross platform and under the hood there is openframeworks with openCV.
With the TUIO code from http://mtg.upf.edu/reactable/?software i had no problem to get the connection from the backend to frontend. You could check the connection with the TUIO-Simulator if you have no Hardware-Setup for MT.
Here two videos about the project.

http://www.youtube.com/watch?v=Ln9m8AkueiE

http://www.youtube.com/watch?v=KyIsm_aJUXs

(detailed information in about a month on the nui-Forum)
I had to code the gesture recognition by myself. Don't know if anybody coded something before but its not so difficult.
The code for the drag/scale/Rotate stuff i'vo got from this slide: http://www.slideshare.net/XdaX/capita-selecta-multimedia (site 19). Its a very good presentation with many usefull and inspiring infos.
My first attempt was with processing but the Boid simulation was to heavy for the renderer .So i decided to do the rendering in pure opengl with JOGL. But i think for normal application with no heavy 3D stuff you could code in processing.
Re: multi touch library?
Reply #6 - Mar 8th, 2009, 5:04pm
 
Hi guys, I wanted to mention that just today, I got the Java bindings for libTISCH ( http://tisch.sf.net/ ) to run, which therefore now also works in Processing. It's not quite production-ready yet, but I'll put up a beta ASAP. See also here: http://processing.org/discourse/yabb_beta/YaBB.cgi?board=os_libraries_tools;action=display;num=1236273149

As for the benefits: I think the biggest advantage of libTISCH is that the gesture recognition is already integrated, so you only have to create some widgets which already have multitouch-capable default behaviour.

Yours, Florian
Page Index Toggle Pages: 1