how to import .3ds file in processing for augmented reality?

archana.s..

how to import .3ds file in processing for augmented reality?

in Contributed Library Questions • 1 year ago

I m new to processing. By using nyartoolkit, mri3d library, I m trying to import a .3ds model in processing . But everytime i run the program i got the .3ds model just near to marker not on the top of marker. So how can i place the 3d model exact on the marker? while running the program it seems not like a 3d, its just like a shape..

I want the real 3d model on the marker .. but how?

I hv already add the file of pattern(patt.Hiro), camera_para and .3ds model named(Toy1.3ds).

Here is my code:

import processing.opengl.*;

import processing.core.*;

import processing.video.*;

import jp.nyatla.nyar4psg.*;

import mri.*;

V3dsScene vscene;

Capture cam;

MultiMarker nya;

void setup(){

//size(640,480,P3D);

size(1270/2,720/2,OPENGL);

try{

vscene=new V3dsScene(this,"Toy1.3ds");

vscene.useMaterial(true);

}

catch(Exception e){

System.out.println(e);

System.exit(0);

}

colorMode(RGB,100);

println(MultiMarker.VERSION);

cam=new Capture(this,1270/2,720/2);

cam.read();

nya=new MultiMarker(this,width,height,"camera_para.dat",NyAR4PsgConfig.CONFIG_DEFAULT);

nya.addARMarker("patt.hiro",80);

}

void draw(){

if(cam.available()!=true){

return;

}

cam.read();

nya.detect(cam);

background(0);

nya.drawBackground(cam);

if(!(nya.isExistMarker(0))){

return;

}

nya.beginTransform(0);

translate(0,0,20);

vscene.draw();

nya.endTransform();

}

Replies(5)

Ja_Ha

Re: how to import .3ds file in processing for augmented reality?

9 months ago

Hi...

I am also working on this ......i tried your code but its not working for me, in my code 3D image is looking fine but i don't know how to map the 3D image with patternimage......in my case 3D image is just stay on screen and there is no tracking. There is no response by the 3D image for the patternimage movement. your early help will be appreciated....thanking you in anticipation.

import processing.opengl.*;
import javax.media.opengl.*;
import java.io.*;
import processing.video.*;
import jp.nyatla.nyar4psg.*;
import mri.*;
int arWidth = 640;
int arHeight = 360;
V3dsScene vscene;
Capture cam;
MultiMarker nya;
String camPara = "C:/Documents and Settings/javed.hasan/My Documents/Processing/libraries/nyar4psg/data/camera_para.dat";
String patternPath = "C:/Documents and Settings/javed.hasan/My Documents/Processing/libraries/nyar4psg/patternMaker/examples/ARToolKit_Patterns";
int numMarkers = 10;
void setup(){
size(640,480,OPENGL);
hint( ENABLE_OPENGL_4X_SMOOTH );
smooth();
frameRate( 60 );
try{
vscene=new V3dsScene(this,"Worker Chainsaw N100612.3DS");
GL gl = ((PGraphicsOpenGL)g).beginGL();
((PGraphicsOpenGL)g).endGL();
vscene = new V3dsScene( gl, dataPath("Worker Chainsaw N100612.3DS") );
vscene.useMaterial(true);
}
catch(Exception e){
System.out.println(e);
System.exit(0);
}
colorMode(RGB,100);
println(MultiMarker.VERSION);
cam=new Capture(this,640,480);
camera();
nya = new MultiMarker(this, arWidth, arHeight, camPara, NyAR4PsgConfig.CONFIG_DEFAULT);
nya.setLostDelay(1);
// load the pattern filenames (markers)
String[] patterns = loadPatternFilenames(patternPath);
// for the selected number of markers...
for (int i=0; i<numMarkers; i++) {
// add the marker for detection
nya.addARMarker(patternPath + "/" + patterns[i], 80);
}
// noStroke();
}
void draw() {
// if there is a cam image coming in...
if (cam.available()) {
cam.read(); // read the cam image
background(cam); // a background call is needed for correct display of the marker results
image(cam, 0, 0, width, height); // display the image at the width and height of the sketch window
// create a copy of the cam image at the resolution of the AR detection (otherwise nya.detect will throw an assertion error!)
PImage cSmall = cam.get();
cSmall.resize(arWidth, arHeight);
nya.detect(cSmall); // detect markers in the image
// set the AR perspective uniformly, this general point-of-view is the same for all markers
nya.setARPerspective();
// run all the ARObjects's in the arraylist => most things are handled inside the ARObject (see the class for more info)
drawMarkers();
// reset to the default perspective
perspective();
}
}
void drawMarkers()
{
float time = millis() * 0.001;
// background( cam );
perspective( -PI*0.2, 4.0/3.0, 1, 5000 );
GL _gl = ((PGraphicsOpenGL)g).beginGL();
camera( 0, -190, -250, 0, -3*sin(time)*2, 8, 0, 1, 0 );
// in case you want to use a custom GL object (usually for eclipse projects)
_gl.glRotatef( 10*time, 0, 1, 0 );
vscene.draw( _gl );
((PGraphicsOpenGL)g).endGL();
rotateY( radians(10*time) );
}
// this function loads .patt filenames into a list of Strings based on a full path to a directory (relies on java.io)
String[] loadPatternFilenames(String path) {
File folder = new File(path);
FilenameFilter pattFilter = new FilenameFilter() {
public boolean accept(File dir, String name) {
return name.toLowerCase().endsWith(".patt");
}
};
return folder.list(pattFilter);
}

archana.s..

Re: Re: how to import .3ds file in processing for augmented reality?

9 months ago

Hello,

You should try this example of openProcessing Loading 3D object .

I think , by this example you can solve your problem.

Thank you

Ja_Ha

Re: how to import .3ds file in processing for augmented reality?

9 months ago

Hello archana ji...

Thank you for your early response....

Ja_Ha

Re: how to import .3ds file in processing for augmented reality?

9 months ago

Hello

thank you for your reply, its really helpful....

but my code not running properly.....my tracking and mapping logics are not clear....i am posting my code please take a look ....

thanking you in anticipation.......

import java.io.*; // for the loadPatternFilenames() function
import processing.opengl.*; // for OPENGL rendering
import jp.nyatla.nyar4psg.*; // the NyARToolkit Processing library
import codeanticode.gsvideo.*; // the GSVideo library
import codeanticode.glgraphics.*;
import saito.objloader.*;
MultiMarker nya;
GSCapture cam;
// declare that we need a OBJModel and we'll be calling it "model"
OBJModel model;
// these booleans will be used to turn on and off bits of the OBJModel
boolean bTexture = true;
boolean bStroke = false;
boolean bMaterial = false;
String camPara = "C:/Documents and Settings/javed.hasan/My Documents/Processing/libraries/nyar4psg/data/camera_para.dat";
// the full path to the .patt pattern files
String patternPath = "C:/Documents and Settings/javed.hasan/My Documents/Processing/libraries/nyar4psg/patternMaker/examples/ARToolKit_Patterns";
// the dimensions at which the AR will take place. with the current library 1280x720 is about the highest possible resolution.
int arWidth = 640;
int arHeight = 360;
// the number of pattern markers (from the complete list of .patt files) that will be detected, here the first 10 from the list.
int numMarkers = 10;
// the maximum rotation speed (x, y, z) at which the RGBCubes will rotate
float mS = 0.2;
void setup()
{
size(640, 480, P3D);
// making an object called "model" that is a new instance of OBJModel
model = new OBJModel(this,"Lancer.obj", "relative", POLYGON);
cam = new GSCapture(this, 640, 480); // initialize the webcam capture at a specific resolution (correct and/or possible settings depend on YOUR webcam)
camera(); // start capturing
// initialize the MultiMarker at a specific resolution (make sure to input images for detection EXACTLY at this resolution)
nya = new MultiMarker(this, arWidth, arHeight, camPara, NyAR4PsgConfig.CONFIG_DEFAULT);
// set the delay after which a lost marker is no longer displayed. by default set to something higher, but here manually set to immediate.
nya.setLostDelay(1);
// load the pattern filenames (markers)
String[] patterns = loadPatternFilenames(patternPath);
// for the selected number of markers...
for (int i=0; i<numMarkers; i++) {
// add the marker for detection
nya.addARMarker(patternPath + "/" + patterns[i], 80);
// turning on the debug output (it's all the stuff that spews out in the black box down the bottom)
model.enableDebug();
model.translateToCenter();
model.scale(.9);
model.printModelInfo();
noStroke();
}
}
void draw()
{
if (cam.available()) {
cam.read(); // read the cam image
background(cam); // a background call is needed for correct display of the marker results
image(cam, 0, 0, width, height); // display the image at the width and height of the sketch window
// create a copy of the cam image at the resolution of the AR detection (otherwise nya.detect will throw an assertion error!)
PImage cSmall = cam.get();
cSmall.resize(arWidth, arHeight);
nya.detect(cSmall); // detect markers in the image
// set the AR perspective uniformly, this general point-of-view is the same for all markers
nya.setARPerspective();
// run all the ARObjects's in the arraylist => most things are handled inside the ARObject (see the class for more info)
drawimage();
// reset to the default perspective
perspective();
}
}
void drawimage()
{
nya.setARPerspective();
lights();
for (int i=0; i<numMarkers; i++) {
// if the marker does NOT exist (the ! exlamation mark negates it)...
if ((!nya.isExistMarker(i))) { continue; }
//this will do nothing until the model material is turned off
// fill(255,0,255);
setMatrix(nya.getMarkerMatrix(i));
scale(2);
pushMatrix();
translate(width/2, height/2, -100);
model.draw();
popMatrix();
}
}
String[] loadPatternFilenames(String path) {
File folder = new File(path);
FilenameFilter pattFilter = new FilenameFilter() {
public boolean accept(File dir, String name) {
return name.toLowerCase().endsWith(".patt");
}
};
return folder.list(pattFilter);
}

Ja_Ha

Re: Re: how to import .3ds file in processing for augmented reality?

8 months ago

Hi..

Thank you for your help

I done that.. :)

NOW i need to do that with face detection so could you please guide me to do that

thanking you in anticipation

Top Reply