Finding position and rotation of an LEGO duplo brick with an vision library

General Discussion Other

x_firm

Finding position and rotation of an LEGO duplo brick with an vision library

in General Discussion • Other • 1 years ago

Hello

I have an project where I would like to find LEGO duplo bricks with an vision library and I don't know where to start.

Could any one point me in the right direction, I have been looking on OpenCV and blobscanner. I think I know how to find just the blobs representing the bricks and there position but I would also want to know the rotation. And also one other problem is the different colors of the bricks.

Hope some one can give me some pointers.. And one more thing is that the processing sketch will be executing on an android tablet that will get images from an network camera..

Replies(1)

jbum

Re: Finding position and rotation of an LEGO duplo brick with an vision library

1 years ago

This sounds really, really hard. Also sounds, very similar to Terry Winograd's program SHRDLU. Maybe do some research on that...

Here's an idea, although it's not very efficient. Given a single known brick, you could render what it looks like at various positions (in 3D), and then compare the rendered image with what the camera is seeing. Find the rendered image which is the closest match.

Top Reply