Computer Vision Libraries and Android!!!

Android Processing

Mike Cj

Computer Vision Libraries and Android!!!

in Android Processing • 10 months ago

Hey has anyone around here ever tried working with any of Computer Vision Libraries with android?

I'v been struggling a lot these days(past a month) trying to get a library work on android platform! I'v almost crashed my head to my bedroom wall trying to figure out a way!

has anyone had these problems too?

Anyways till now,
1.

I'v tried importing openCV library into android...well the openCV2.4.3 library for processing works great with processing(PC) but doesn't work at all as an application to an android..as it didn't find the library for android! and i guess there is even problem with buffers and stuff which the library uses!

So, now i thought I could recompile every thing into a single jar file and can easily be imported...Well, I successfully did import this into a .jar file with the help of Eclipse....So, now i can import the library and no compilation errors but unfortunately this doesn't work and gives out a run-time error i guess

I'm just struck here with openCV now!!!!
getting to work openCV on android with processing for android would be preferable..!

as i'v got no much time for my project submission i need to go ahead!

So, here I'm! tryina look for all the libraries present( Computer Vision)which works as a piece of cake for a PC but unfortunately not even a little on android platform! I'v literally tried out examples from those libraries...NOT YET! and I'm still look for libraries....
Note: While choosing libraries i'm trying to choose only those ones which does some image-processing on PImage types b'coz i think there won't be any problem related to memory buffers!

So, Any suggestions on a "Computer vision" library I can try out for android (Android processing)???
Thanks for any help in advance...

Replies(8)

Jesse Sco..

Re: Computer Vision Libraries and Android!!!

10 months ago

Try Ketai

http://code.google.com/p/ketai/

Mike Cj

Re: Computer Vision Libraries and Android!!!

10 months ago

Thanks for the reply Jesse!

Ketai is a very good motion detection library...I'v tried it and that's the library I'm using for getting camera, and many other sensors work! but, It's not an "Computer vision"(CV) library...there is only one CV thing which can be done with ketai "Face detection"...and i want lot more like "blob detection", "contour detection","Motion tracking" etc...
Any other popular library I might be missing?

julienrat

Re: Computer Vision Libraries and Android!!!

9 months ago

hello,

I tested successfully the library keitai camera coupled with nyARtoolkit, if little help .....

nothing yet about OpenCV (I am parrait difficult to compile android)

have a look here : https://www.youtube.com/watch?v=zRo6hrqlcDY

here for nyartoolkit lib : http://nyatla.jp/nyartoolkit/wp/?page_id=55

indaeproc..

Re: Re: Computer Vision Libraries and Android!!!

7 months ago

Hi Julienrat

I am trying to use nyARtoolkit with keitai camera in android mode.

Yet, when i tried to run the sketches on the device or emulator, i failed it.

Can you teach me how you successfully test both two libraries?

It will be great help if you teach me how to do it

phildar

Re: Computer Vision Libraries and Android!!!

8 months ago

I found this for android: http://code.google.com/p/cvblob-for-android/

well...where should I start to implement it under processing ?
Any clues ?
Thx

phildar

Re: Computer Vision Libraries and Android!!!

8 months ago

I try to implement the blob detection from v3ga ( http://www.v3ga.net/processing/BlobDetection/index-page-download.html)
under processiong/android.
after several times ( when I move fast the tablet), the application crashes... some of could reproduce this ? Some ideas to avoid the problem which seems to be a performance issue.

/**
* <p>Ketai Sensor Library for Android: http://KetaiProject.org</p>
*
*
* blob-detection library: http://www.v3ga.net/processing/BlobDetection/index-page-download.html
*touch your screen to start camera and blob detection.
*/

import ketai.camera.*;
import blobDetection.*;
KetaiCamera cam;

BlobDetection theBlobDetection;
PImage img;
boolean newFrame= false;
void setup() {

orientation(LANDSCAPE);

cam = new KetaiCamera(this, 320, 240, 30);
img =new PImage(80,60);
theBlobDetection = new BlobDetection(img.width, img.height);
theBlobDetection.setPosDiscrimination(true);
theBlobDetection.setThreshold(0.2f); // will detect bright areas whose luminosity > 0.2f;
theBlobDetection.setBlobMaxNumber(1);//Max blob detected = 1;
}

void draw() {
background(0);
image(cam, 0, 0, 1280,800);

if (newFrame)
{
    newFrame=false;
   //image(cam, 0, 0, 640, 480);
    img.copy(cam, 0, 0, cam.width, cam.height,0, 0, img.width, img.height);
    fastblur(img, 2);
    theBlobDetection.computeBlobs(img.pixels);
    drawBlobsAndEdges(true,true);

}
}

void onPause()
{
super.onPause();
//Make sure to releae the camera when we go
// to sleep otherwise it stays locked
if (cam != null && cam.isStarted())
    cam.stop();
}

void onCameraPreviewEvent()
{
cam.read();
// cam.manualSettings();
newFrame = true;
}

void exit() {
cam.stop();
}

// start/stop camera preview by tapping the screen
void mousePressed()
{

if (cam.isStarted())
{
    cam.stop();
}
else
cam.start();
}
void keyPressed() {
if (key == CODED) {
    if (keyCode == MENU) {
      if (cam.isFlashEnabled())
        cam.disableFlash();
      else
        cam.enableFlash();
    }
}
}

// ==================================================
// drawBlobsAndEdges()
// ==================================================
void drawBlobsAndEdges(boolean drawBlobs, boolean drawEdges)
{
noFill();
Blob b;
EdgeVertex eA,eB;
// for (int n=0 ; n<theBlobDetection.getBlobNb() ; n++)
for (int n=0 ; n<1 ; n++)
{
    b=theBlobDetection.getBlob(n);
    //b=theBlobDetection.getBlob(n);
    if (b!=null)
    {
      // Edges
      if (drawEdges)
      {
        strokeWeight(3);
        stroke(0,255,0);

        for (int m=0;m<b.getEdgeNb();m++)
        {
          eA = b.getEdgeVertexA(m);
          eB = b.getEdgeVertexB(m);
          if (eA !=null && eB !=null)
            line(
              eA.x*width, eA.y*height,
              eB.x*width, eB.y*height
              );
        }
      }

      // Blobs
      if (drawBlobs)
      {
        strokeWeight(1);
        stroke(255,0,0);
        rect(
          b.xMin*width,b.yMin*height,
          b.w*width,b.h*height
          );
      }

    }

      }
}

// ==================================================
// Super Fast Blur v1.1
// by Mario Klingemann
// <http://incubator.quasimondo.com>
// ==================================================
void fastblur(PImage img,int radius)
{
if (radius<1){
    return;
}
int w=img.width;
int h=img.height;
int wm=w-1;
int hm=h-1;
int wh=w*h;
int div=radius+radius+1;
int r[]=new int[wh];
int g[]=new int[wh];
int b[]=new int[wh];
int rsum,gsum,bsum,x,y,i,p,p1,p2,yp,yi,yw;
int vmin[] = new int[max(w,h)];
int vmax[] = new int[max(w,h)];
int[] pix=img.pixels;
int dv[]=new int[256*div];
for (i=0;i<256*div;i++){
    dv[i]=(i/div);
}

yw=yi=0;

for (y=0;y<h;y++){
    rsum=gsum=bsum=0;
    for(i=-radius;i<=radius;i++){
      p=pix[yi+min(wm,max(i,0))];
      rsum+=(p & 0xff0000)>>16;
      gsum+=(p & 0x00ff00)>>8;
      bsum+= p & 0x0000ff;
    }
    for (x=0;x<w;x++){

      r[yi]=dv[rsum];
      g[yi]=dv[gsum];
      b[yi]=dv[bsum];

      if(y==0){
        vmin[x]=min(x+radius+1,wm);
        vmax[x]=max(x-radius,0);
      }
      p1=pix[yw+vmin[x]];
      p2=pix[yw+vmax[x]];

      rsum+=((p1 & 0xff0000)-(p2 & 0xff0000))>>16;
      gsum+=((p1 & 0x00ff00)-(p2 & 0x00ff00))>>8;
      bsum+= (p1 & 0x0000ff)-(p2 & 0x0000ff);
      yi++;
    }
    yw+=w;
}

for (x=0;x<w;x++){
    rsum=gsum=bsum=0;
    yp=-radius*w;
    for(i=-radius;i<=radius;i++){
      yi=max(0,yp)+x;
      rsum+=r[yi];
      gsum+=g[yi];
      bsum+=b[yi];
      yp+=w;
    }
    yi=x;
    for (y=0;y<h;y++){
      pix[yi]=0xff000000 | (dv[rsum]<<16) | (dv[gsum]<<8) | dv[bsum];
      if(x==0){
        vmin[y]=min(y+radius+1,hm)*w;
        vmax[y]=max(y-radius,0)*w;
      }
      p1=x+vmin[y];
      p2=x+vmax[y];

      rsum+=r[p1]-r[p2];
      gsum+=g[p1]-g[p2];
      bsum+=b[p1]-b[p2];

      yi+=w;
    }
}

}

phildar

Re: Computer Vision Libraries and Android!!!

8 months ago

and the log :

ATAL EXCEPTION: Animation Thread
java.lang.StackOverflowError
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:345)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:347)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:346)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:347)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:347)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:344)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:347)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:345)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:345)
    at blobDetection.BlobDetection.computeEdgeVertex(BlobDetection.java:347)

Jesse Sco..

Re: Computer Vision Libraries and Android!!!

8 months ago

I don't believe that any of the libraries under Computer Vision for Processing have been ported to Android quite yet.

A quick Google search shows a few native Android libraries though...

{EDIT} I see you already found one...

Top Reply