GSVideo 0.9 / GLGraphics 0.99

afreise

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Very nice! I have not found the time or task yet to play with GSVideo, but I am a great fan of your GLGraphics library.

Andreas

cedrickie..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Perfect! Thanks alot. i just started to work with the video library for a project and was already impressed by the speed improvements. But thats even better. 50% more impressed now :)

Jesse Sco..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi Andres,

I am on a 64-bit architecture, but when I try to install the latest Snow Leopard 64 bit GSVideo, it gives me an error message about wrong architecture for gstreamer. I can revert to the 32 bit version without issue.

Is there any know issue for this ? Perhaps an incorrect version of a file got packaged ? Or do I have to do any install of gstreamer (at the moment it's just sitting inside the library directory...)

Thanks...

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

The 64 bits packages require a 64 bits JVM. So they cannot be used inside Processing, since it comes with a 32 bits version of Java. They are usually useful for people working with Eclipse. I should add a clarification about this somewhere.

Jesse Sco..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Ok. This is irrespective as to whether I have a 64-bit version of Java SE on my machine ?

If I wanted to have the 64bit version available for when I do work in Eclipse, would it be sufficient to just rename the hear directory and jar file (eg. "GSVideo64") ??

Thanks...

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Not sure what would happen if you rename the directory and jar file. One note though is that the jar file is architecture independent, the problem is with the gstreamer native libraries. 32 bits native libs cannot be loaded from a 64 bits JVM, and viceversa.

An alternative to setup custom locations for the native libs is provided by the GSVideo class that handles initialization of the library. It includes a static String variable called localGStreamerPath which you can set to a specific location of your gstreamer binaries, before creating any object:

GSVideo.localGStreamerPath=/Users/name/.../library/gstreamer/macosx64
mov = new GSMovie(...);

Jesse Sco..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Thanks Andres, I'll give that a try!

jobleonard

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey Andres,

are there limitations to when I can call mov.setPixelDest(tex)? Does it have to be paused, must it be done in setup, something like that? Because I'm trying to put it in my own sketch, but the screen remains blank.

andres

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

You should call setPixelsDest() right after creating the object, but before putting it to pay:

tex = new GLTexture(this);
movie = new GSMovie.(this, "clip.ogg");
movie.setPixelDest(tex);
movie.play(); // or loop

ichingxs4..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi Andres,

I have big problems getting the new release to work. I'm getting Glib error's like I got with the 0.8 release.

The strange thing is that the GSVideo test release is working fine !! ( the version between 0.8 and 0.9 ).

I tried everything , 1.2.1 , 1.5 , 1.5.1 . snow 32...snow 64 ..doesn't matter.

I mixed some parts en pieces together from the test release and the 0.9 release to try to pin point the problem

and it al points to the libglib library.

Any ideas ?

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

this is really puzzling... what exact test release was working for you?

another thing to look at: is there any other versions of libglib installed in your system?

ichingxs4..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

@Andres:

Ok I've found a solution. Although I'm running SnowLeopard 10.6.7 only the GSVideo builds for Leopard are working

for me. All the special SnowLeopard builds crash with the same error:

GLib-ERROR **: gmem.c:405: overflow allocating 1635021569*4 bytes

aborting...

These are my specs and working/non-working setup:

MacBookPro 15,6 " medio 2010 (2.53 Ghz Core i5, 4Gb , Intel HD / NVidia GT 330M )

Mac OSX 10.6.7

Java 13.4.0

Processing 1.2.1 / 1.5 / 1.5.1

GSVideo version: 0.9 Snowleopard 32 (GSVideo-0.9-macosx-snow32.zip ) -- Not working

GLib-ERROR **: gmem.c:405: overflow allocating 1635021569*4 bytes

aborting...

GSVideo version: 0.9 Leopard 32 (GSVideo-0.9-macosx-leo32) -- Working

GSVideo version: 20110411 Leopard 32 (GSVideo-20110411-leopard32.zip) -- Working

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Really strange, as I've done tests on 10.6.7 and didn't see this crash.

For the time being, just use the leopard packages. I'll file this issue in the sourceforge tracker and will look at it again later.

ichingxs4..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Ok. thnx

I'll stay with the leopard32 build.

If I find a reason why the snowleopard32 build is not working for me, I'll report it.

GRTX

jimmij

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hello,

I was wondering what is the best way to use this new version of GSVideo (GSCapture class) with OpenCV library?

Before It worked fine this way:

if (cam.available() == true)
{
cam.read();
opencv.copy(cam,0,0,cam.width,cam.height,0,0,w,h);

now if I use it this way:

if (tex.putPixelsIntoTexture()) {
opencv.copy(tex,0,0,cam.width,cam.height,0,0,w,h);
}

compiler says: NoSuchMethodError: You may be using a library that's incompatible with this version of Processing

and trows this error message: http://pastebin.com/cmDbPG14

I use Processing 1.2.1

Jim.

Thank you very much for these great libs!

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

GLGraphics 0.99 only works with Processing 1.5 or later.

jimmij

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Thanks for the reply,

I tried Processing 1.5.1 and no more error,

however opencv returns blank screen.

i use opencv's copy method which reads PImage as input.

and i tried both 'tex' and 'cam' instances, but It is still blank.

can I transform 'tex' and 'cam' into PImage somehow?

jimmij

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I tried getImage, it shows the image:

if (tex.putPixelsIntoTexture())
{
tex.getImage(img);
opencv.copy(img,0,0,camW,camW,0,0,w,h);

but it's definitely too slow (sort of 15fps)

andres

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

hi, the problem when using the video in opencv is that the glgraphics-gsvideo integration is not useful anymore. It is actually slower than not using it at all. This is because you are copying the video frame from main memory to video memory, and then back to main memory so opencv can access it. But these transfers between main and video memory are slow.

In this case, you can just copy the frames from gsvideo directly into opencv, and should be faster. Something like this:

void setup() {
size(640, 480);
cam = new GSCapture(this, 640, 480);
opencv = new OpenCV(this);
opencv.allocate(640, 480);
}
void captureEvent(GSCapture c) {
c.read();
}
void draw() {
opencv.copy(cam);
...
}

jobleonard

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Say, since your GLGraphics/GSVideo integration will always be pairing a texture and a movie together, why not encapsulate that in a basic class?

Something like this:

import processing.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;
MovieCapsule mov1, mov2;
void setup() {
size(1280, 800, GLConstants.GLGRAPHICS);
frameRate(90);
mov1 = new MovieCapsule(this, "test1.mp4");
mov2 = new MovieCapsule(this, "test2.mp4");
background(0);
noStroke();
}
void draw() {
mov1.update();
mov2.update();
mov1.display();
mov2.display(width >>1, height>>1, width>>1, height>>1);
if (frameCount == 300) {
mov1.dispose();
mov1 = new MovieCapsule(this, "test3.mp4");
}
else if (frameCount == 600) {
mov1.loadMovie("test1.mp4");
}
}
class MovieCapsule {
GSMovie mov;
GLTexture tex;
PApplet pApplet;
float h, b;
boolean newFrame;
MovieCapsule(PApplet _this, String movpath) {
pApplet = _this;
mov = new GSMovie(pApplet, movpath);
tex = new GLTexture(pApplet);
mov.setPixelDest(tex);
tex.setPixelBufferSize(10);
tex.delPixelsWhenBufferFull(false);
mov.loop();
newFrame = false;
}
void update() {
if (mov.available())
mov.read();
if (!newFrame)
newFrame = tex.putPixelsIntoTexture();
}
void display() {
float h = width * tex.height / tex.width;
float b = 0.5 * (height - h);
image(tex, 0, b, width, h);
newFrame = false;
}
void display(int x, int y, int w, int h) {
image(tex, x, y, w, h);
newFrame = false;
}
void loadMovie(String movpath) {
mov.delete();
tex.delete();
mov = new GSMovie(pApplet, movpath);
tex = new GLTexture(pApplet);
mov.setPixelDest(tex);
tex.setPixelBufferSize(10);
tex.delPixelsWhenBufferFull(false);
mov.loop();
newFrame = false;
}
void dispose() {
mov.delete();
tex.delete();
}
}

Couldn't think of a prettier name. It needs some refinement (trying to display while loading a new movie gives funky results, I'm not sure how if it still syncs correctly). Still, in my case a class like this would be a lot easier to use most of the time, since there won't be any confusion about which texture belongs to which movie. It will also make my code a lot less verbose when displaying multiple movies.

What do you think? Something you'd want to build into the library (maybe in the form of an example)?

Ja_Ha

Re: Re: GSVideo 0.9 / GLGraphics 0.99

7 months ago

Hi jobleonard...

I tried your code but getting this error...."The function setPixelDest(Gl Texture) does not exist"

Any idea?

Thanking you in anticipation.

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Yes, your MovieCapsule class makes the use of the glgraphics-gsvideo integration easier.

You should add a condition so the texture is not drawn when video frames have not been read yet. Until this happens, the texture is actually not initialized and drawing it might sometimes result in garbage shown on the screen

I will add a new example using it for the next release of gsvideo. Thanks!

thomas.lo..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey, i have been trying to use GSVideo but i always get the following error:

Exception in thread "Animation Thread" java.lang.UnsatisfiedLinkError: Unable to load library 'gstreamer-0.10': dlopen(/Users/Atom/Documents/Processing/libraries/GSVideo/library/gstreamer/macosx/libgstreamer-0.10.dylib, 9): no suitable image found. Did find:

/Users/Atom/Documents/Processing/libraries/GSVideo/library/gstreamer/macosx/libgstreamer-0.10.dylib: unknown required load command 0x80000022

i found that lib and i tested using 32bit version as well as 64bit. is there anything i am missing ?

ichingxs4..

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I had succes by downloading and installing the leopard version instead of the snowleopard version.

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi, the 64 bits versions won't work from the PDE, since they need a 64 bits Java. They can be useful when using Eclipse.

From my own experience, both the leopard and snow leopard versions of gsvideo (32 bits) work under OSX 10.6 in the PDE, while only the leopard package works in OSX 10.5.

thomas.lo..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I managed to get GSVideo to run using your advice (tyvm!) (OSX 10.5 with 64 bit leopard version), however i now can not use capturing. If i try to use the basic "Getting Started Mac" example it says:

IllegalArgumentException: No such Gstreamer factory: osxvideosrc

when trying to do:

cam = new GSCapture(this, 640, 480);

I also tried using the - cool++ - glgraphics lib. when i want to run the CGshader example it seems that i need to dl Nvidias CG3 toolkit which in turn i can only download when i register as a developer of sorts. Is there any way to get that toolkit somewhere else, or is it necessary to wait 10 business days (as they say) to get it ?

ichingxs4..

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Are you running this example on a Macbook (Pro) with built in camera ? Because you run into this error messages with some of the attached USB webcam's (macam driver ) or other video sources. Sometimes it has to do with the resolution these camera's support or the framerate. But I also had some trouble with pseudo camera's or wrappers like iGlasses. It looks like all the parameters/settings must be in place on driver level (implemented) otherwise the capture module won't start.

I don't have the CG toolkit myself , otherwise I'll post it for you.

thomas.lo..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

hm no. im using an imac and have been using an older version of gsvideo before. i think i once had macam running for some reason, ill check back on that. ty

ichingxs4..

Re: Re: GSVideo 0.9 / GLGraphics 0.99 beeing integrated in SVN version of Processing 0199

2 years ago

Hi Andres,

I've been following the integration of GSVideo into the new 2.0 release of Processing on the SVN reposit.

What is the best place to bug report on this ? A few day's ago the svn builds where working fine. But the builds from yesterday en today won't .

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

hi, yes many things changed in the latest revisions, and probably some features are broken for the time being. Hold on for a while on using the video functionality, because it has just checked in and I need to review the code and make sure it can be at least compiled properly.

akiersky

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey Andres,

I have been noticing some memory leeks associated with the GSMovie and GLTexture video playing. using the MovieCapsule example above (@ jobleonard nice way of handling the setup and playing) I put together this example to test for memory usage:

import processing.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;
MovieCapsule mov1;
void setup() {
size(1280, 800, GLConstants.GLGRAPHICS);
frameRate(90);
mov1 = new MovieCapsule(this, "testMovie.mov");
background(0);
noStroke();
}
void draw() {
mov1.update();
mov1.display();
if (frameCount % 600 == 0) {
mov1.dispose();
mov1 = new MovieCapsule(this, "testMovie.mov");
}
}
class MovieCapsule {
GSMovie mov;
GLTexture tex;
PApplet pApplet;
float h, b;
boolean newFrame;
MovieCapsule(PApplet _this, String movpath) {
pApplet = _this;
mov = new GSMovie(pApplet, movpath);
tex = new GLTexture(pApplet);
mov.setPixelDest(tex);
tex.setPixelBufferSize(10);
tex.delPixelsWhenBufferFull(false);
mov.loop();
newFrame = false;
}
void update() {
if (mov.available())
mov.read();
if (!newFrame)
newFrame = tex.putPixelsIntoTexture();
}
void display() {
float h = width * tex.height / tex.width;
float b = 0.5 * (height - h);
image(tex, 0, b, width, h);
newFrame = false;
}
void display(float x, float y, int w, int h) {
image(tex, x, y, w, h);
newFrame = false;
}
void loadMovie(String movpath) {
dispose();
mov = new GSMovie(pApplet, movpath);
tex = new GLTexture(pApplet);
mov.setPixelDest(tex);
tex.setPixelBufferSize(10);
tex.delPixelsWhenBufferFull(false);
mov.play();
newFrame = false;
}
void dispose() {
mov.setPixelDest(null); //need to clear the pixel dest to flag for garbage collection
mov.delete();
tex.delete();
Runtime.getRuntime().gc(); // force the garbage collection, not necessary, but keeps memory lower
}
}

In the final dispose in the MovieCapsule, I added the setPixelDest(null) to remove the reference, then just to keep things clean I force the garbage collection. Testing with VisualVM without these, the memory usage and heap size increase regularly. After nulling on dispose, peak memory usage is consistent.

Thanks for making the best movie playing class out there!

ak

jobleonard

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Though AFAIK it shouldn't make a difference, what happens if you change:

if (frameCount % 600 == 0) {
mov1.dispose();
mov1 = new MovieCapsule(this, "testMovie.mov");
}

to:

if (frameCount % 600 == 0) {
mov1.dispose();
mov1.loadMovie("testMovie.mov");
}

EDIT: Oh, wait, I misunderstood. You already fixed the problem (incidently, you might have fixed my problem too... my program crashed due to a GStreamer plugin crash involving running out of memory. I'll try the forced garbage collection method).

rudolfoq

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi Andres,

Really nice libs. But Im having a problem because I am trying to use the captured image
from cam in a texture to send it to Syphon.

This is the error:

I am using Processing 1.5.1 and all your libs are working:
- OPENGL2
- Syphon
- GLGraphics
- GSVideo

Any help?
best
rudolfo

andres

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi Rudolfo, I think is better to answer your question on the syphon thread.

jonrose08

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Are there any plans to try and port these over to Android? It looks like GStreamer is running on android

git://anongit.freedesktop.org/gstreamer/gst-android

sorry if this is the wrong question for this thread, I can't help my self after seeing a bunch of features I wish I could use in Android

thanks

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Yes, I'd like to try out gstreamer on Android, and eventually come up with a version of GSVideo for that platform, but it will take some time...

trippedout

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

so is it safe to say that when i use GLGraphics, i cannot switch to Android in processing and expect it to work?

just curious, couldn't find an answer elsewhere and when i try to compile my app or any of ur examples through Processing it gives me a strange error saying "package codeanticode.glgraphics does not exist" which doesn't make much sense...

am i doing something wrong?

EDIT:

to clarify - reading other posts i realiezd i have to 'add file' to get libraries noticed, but now, any example and code that i write with GLGraphics forcecloses and this is the most common error

FATAL EXCEPTION: Animation Thread

java.lang.NoClassDefFoundError: processing.opengl.PGraphicsOpenGL

at codeanticode.glgraphics.GLModel.initModelCommon(Unknown Source)

at codeanticode.glgraphics.GLModel.<init>(Unknown Source)

at processing.android.test.screensaver_logo.ScreenSaver_Logo.createSphere(ScreenSaver_Logo.java:383)

at processing.android.test.screensaver_logo.ScreenSaver_Logo.setup(ScreenSaver_Logo.java:94)

at processing.core.PApplet.handleDraw(PApplet.java:1783)

at processing.core.PGraphicsAndroid2D.requestDraw(PGraphicsAndroid2D.java:161)

at processing.core.PApplet.run(PApplet.java:1674)

at java.lang.Thread.run(Thread.java:1019)

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi, GLGraphics only works in the standard mode of Processing, as it doesn't support Android yet.

trippedout

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

ok great. i assumed as much but thanks for the reply. your library is fantastic thanks for the hardwork and actually responding to threads :)

sixswitch

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey Andres,

I am loving GLGraphics, but have a question:

If I need to create a GLModel in a separate thread, what should I use for the PApplet parameter in the constructor?

I have created many binary files from the vertices of an animated GLModel. I want to loading and parse these files in a sketch, and I need to do this in a separate thread. But I need a GLModel instance to access the loadVertices() function, and no matter what, I get errors when I try and create a GLModel in the separate thread.

I have tried passing the thread constructor a reference to the PApplet (results in 'invalid memory access' error, I think because it's trying to jump to the main thread); I have also tried instantiating a second PApplet in the separate thread, which results in this exception:

Exception in thread "Thread-2" java.lang.NullPointerException

at codeanticode.glgraphics.GLModel.initModelCommon(Unknown Source)

at codeanticode.glgraphics.GLModel.<init>(Unknown Source)

at testLoadVertices2$LoadVertsThread.loadDeltas(testLoadVertices2.java:293)

at testLoadVertices2$LoadVertsThread.run(testLoadVertices2.java:280)

I don't know if there's a way to work around this...going to keep working on it, but any help would be much appreciated!

sixswitch

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Okay, in case it helps anyone else, the standard method ended up working (passing 'this' into the thread constructor), but only after I moved the GLModel instantiation into a method within the thread that was not called from the thread's run() method. In other words, the main thread calls a setParams method of the separate thread class, which creates the dummy GLModel, and then the main thread triggers a condition in run() which calls a method to do the work of the thread.

I don't have the slightest clue why this worked. Hopefully it will continue to do so!

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi, what do you exactly do in the setParams() method of the thread? Are you using the loadVertices(), loadColors(), etc. methods to load your binary data?

sixswitch

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi Andres!

I'm really only using the GLModel in the thread as a convenient way to load in data from sequential binary vertex-list files. I'm not ever accessing the vertices of that model...

Here's the code for the thread. When the GLModel instantiation is placed in loadDeltas, it throws the invalid memory access error. As below, it works fine.

It's probably something stupid I'm doing...

class LoadVertsThread extends Thread {
private boolean running;
private boolean available;
private boolean triggerCapture;
public PApplet sketch;
private String filenameRoot;
private String directory;
private int firstFile, lastFile, vertices;
private int totalFrames;
private ThreadStatus threadStatus;
public GLModel dummyModel;
private ArrayList vertexBuffer;
private ArrayList prevVertexBuffer;
private float[][] vertexDeltas;
LoadVertsThread(PApplet sk){
running = false;
available = false;
vertexBuffer = new ArrayList();
prevVertexBuffer = new ArrayList();
threadStatus = new ThreadStatus(true, "idle");
sketch = sk;
}
float[][] getDeltas(){
available = false;
threadStatus.update("deltas fetched");
return vertexDeltas;
}
boolean available(){
return available;
}
void flipTriggerCapture(){
triggerCapture = !triggerCapture;
}
void setParams(String file, String dir, int first, int last, int verts){
threadStatus.update("setting parameters");
filenameRoot = file;
directory = dir;
firstFile = first;
lastFile = last;
vertices = verts;
dummyModel = new GLModel(sketch, vertices, POINTS, GLModel.STATIC);
}
void start(){
running = true;
super.start();
}
void run(){
while (running) {
if(triggerCapture){
triggerCapture = !triggerCapture;
loadDeltas();
}
try {
// Wait five seconds
sleep((long)(5000));
}
catch (Exception e) {
}
}
}
void loadDeltas(){
threadStatus.update("loading deltas");
totalFrames = lastFile - firstFile;
vertexDeltas = new float[totalFrames][vertices*4];
PVector currentPoint, lastPoint, delta;
threadStatus.update("starting load of " + totalFrames + " frames");
for(int frameIndex = firstFile+1; frameIndex < lastFile; frameIndex++){
threadStatus.update("loading frame " + frameIndex);
// if we're on the first rep, get the 'previous' buffer filled up
if(frameIndex == firstFile+1){
vertexBuffer = dummyModel.getVertices(directory + "/" + filenameRoot + frameIndex + ".bin");
}
prevVertexBuffer = vertexBuffer;
vertexBuffer = dummyModel.getVertices(directory + "/" + filenameRoot + frameIndex + ".bin");
for(int vertexIndex = 0; vertexIndex < vertices; vertexIndex++){
currentPoint = (PVector) vertexBuffer.get(vertexIndex);
lastPoint = (PVector) prevVertexBuffer.get(vertexIndex);
delta = new PVector().sub(currentPoint, lastPoint);
vertexDeltas[frameIndex][vertexIndex*4] = delta.x;
vertexDeltas[frameIndex][vertexIndex*4+1] = delta.y;
vertexDeltas[frameIndex][vertexIndex*4+2] = delta.z;
vertexDeltas[frameIndex][vertexIndex*4+3] = 1.0;
}
threadStatus.update("finished loading frame " + frameIndex);
}
threadStatus.update("finished loading frames");
available = true;
}
void quit(){
println("ending thread");
running = false;
interrupt();
}
}
class ThreadStatus {
String threadStatus;
boolean printStatusOnChange;
ThreadStatus(boolean printStatus, String initialStatus) {
printStatusOnChange = printStatus;
update(initialStatus);
}
void update(String statusString){
threadStatus = statusString;
if(printStatusOnChange){
println("Thread status: " + threadStatus);
}
}
}

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Ah, I think I understand the problem... A GLModel object cannot be instantiated from another thread because of OpenGL. The constructor of GLModel invokes some OpenGL functions in order to initialize the object, and it does so using the OpenGL context created in the main thread (which gets from the PApplet argument)... but OpenGL functions cannot be called from a thread different from the one that created the context.

sixswitch

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Interesting! That does make sense. Does that mean that the loadParams() method actually runs on the main thread, even though it's in the Thread class?

Thanks so much for the quick answer. The libraries are fantastic, I can't believe how fast this is going.

sixswitch

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey Andres,

One other question. Right now, I'm saving vertices to a binary file using saveVertices().

When I call loadVertices(), all of the vertex coordinates (in all dimensions) are 'wrapped' around at about 324. Meaning if I save the following set of vertices:

... (0, 0, 300), (0, 0, 306), (0, 0, 312), (0, 0, 318), (0, 0, 324), (0, 0, 330), (0, 0, 336), (0, 0, 342) ...

what I get back is

... (0, 0, 300), (0, 0, 306), (0, 0, 312), (0, 0, 318), (0, 0, 324), (0, 0, -325.36), (0, 0, -319.36), (0, 0, -313.36 ) ...

I'm not doing anything strange, just straight saveVertices() and loadVertices(). getVertices() exhibits the same remapping. There's no particular significance that I can see to the number 324.

To be honest I'm not even sure how to work around this, given that it's like modulus and the actual coords are discarded...I'm trying to pull this together for a showing tomorrow and this is my last big sticking point so I really appreciate any insight you can offer! It's only thanks to your libraries I've gotten as far as I have :)

Thanks,

Jacob

sixswitch

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

This example demonstrates the issue on my machine as simply as possible. Hit 'v' to toggle loading & displaying the saved vertexes on and off. The model should remain the same but instead 'wraps around'. Any help is much appreciated, I can't figure out what is causing this! Example uses PeasyCam.

import peasy.org.apache.commons.math.*;
import peasy.*;
import peasy.org.apache.commons.math.geometry.*;
import processing.opengl.*;
import codeanticode.glgraphics.*;
PeasyCam cam;
GLModel mod;
GLGraphics renderer;
boolean loadVertsFromFile;
void setup(){
size(1024, 768, GLConstants.GLGRAPHICS);
loadVertsFromFile = false;
cam = new PeasyCam(this, 5000);
cam.setMinimumDistance(50);
cam.setMaximumDistance(40000);
mod = new GLModel(this, 400, POINTS, GLModel.STREAM);
mod.initColors();
mod.setColors(255, 255);
mod.setBlendMode(ADD);
//mod.setPointSize(4);
renderer = (GLGraphics) g;
}
void draw(){
mod.beginUpdateVertices();
for(int i = 0; i<20; i++){
for(int j = 0; j<20; j++){
int modIndex = j + i * 20;
mod.updateVertex(modIndex, (float) j*50, (float) i*50, (float) 400 + j*50);
}
}
mod.endUpdateVertices();
mod.saveVertices("data/frame.bin");
if(loadVertsFromFile){
mod.loadVertices("frame.bin");
}
renderer.beginGL();
//renderer.setDepthMask(false);
background(0);
renderer.model(mod);
renderer.endGL();
}
void keyPressed(){
if(key == 'v'){
loadVertsFromFile = !loadVertsFromFile;
if(loadVertsFromFile){
println("loading vertices from file");
} else {
println("displaying vertices in model");
}
}
}

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey, the problem was that the load/save functions were using shorts to store the vertices. I changed to floats, so it should work now.

Grab this new test package and let me know.

sixswitch

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Works perfectly now. Thank you so much for the super-quick fix. Total lifesaver!

ashleyjam..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hope someone can help me im using glgrpahics and an arduino and ive got crashes

Im using mac osx 10.6.8 and processing 1.5.1

Running glgraphics on its own is fine, and running the arduino on its own and recieving an input and just printing it to the console

Combine the 2 codes and i get an error

Invalid memory access of location 0x0 eip=0x95ca03ab

I then get a nice crash report to send to apple which seems to point to

Process: java [1336]

Path: /usr/bin/java

Identifier: com.apple.javajdk16.cmd

Version: 1.0 (1.0)

Code Type: X86 (Native)

Parent Process: JavaApplicationStub [1265]

PlugIn Path: /Applications/Processing.app/Contents/Resources/Java/modes/java/libraries/opengl/library/macosx/libjogl.jnilib

PlugIn Identifier: libjogl.jnilib

So i fixed the rxtx issue with the serial issues you can get with processing 1.5.1 and arduino on a mac but now i seem to get a crash when running with opengl / glgrpahics

Its wierd as the glgraphics demos run fine, but if i try and combine the arudino recieve code in one of the demos it crashes

Does anyone know of this issue or how to help

TBH im using glgrpahics to render as it looks nicer but if it wont work then ill have to try something else :-( (and recode)

As a wierd aside - when i run the code without the arduino plugged in it works fine ?????

Can i mention im using the serial library and not the arduino library within processing

ashleyjam..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

ps tried it on my pc winxp pc - will try my win7 tonight but cant even get gsgrapgics to work rendering POINT_SPRITES as it says it isnt valid - its def in the javadoc and works on the mac though ??

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I'm not sure right now about the source of the crash on OSX, but the GLModel.POINT_SPRITES constant should be available for sure in version 0.99 of GLGraphics. What version are you using?

ashleyjam..

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

the .POINT_SPRITES doesn't work in processing 1.2.1 - it does work in 1.5.1 though :-) im using 0.99 latest lib from you

However - more testing today - win7 causes crash as well and cannot render the sprite

//

Anyway back to my issue - im literally using the example with the sprites - this runs fine on its own. My arduino code runs fine on a seperate sketch on its own..... but when i combine the arduino code into the example - the code also runs fine UNTIL i close the code, attach the arduino and then rerun the sketch and it gives the error above and then it crashes within 5 seconds. It always quotes the opengl library as the issue but im assuming its memory share resources however surely opengl doesnt use same resources as the rxtxserial recieveing from the arduino ?

Id mega appreciate it because the reason im using opengl and more specifically your lib is because of the sprite rendering and the ability t render the particles for my installation much better.

What i might do if poss is run a screencast so you can see

//

I already had to fix the rxtx error with using arudino on a mac osx and processing serial library ( the arduino library doesnt work at all ) so i had the issue with the serial lib for arduino crashing on my seperate arudino sketch but once that was fixed the arduino receive code is fine

btw - i mega appreciate your response :-) and i follow your blog and im pleased your working on p2.0

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Just to clarify things a little: you are using the built-in serial library to get the data from the arduino, and not the Processing-Arduino library, right?

If you combine your arduino-related code with any sketch using the opengl library (but not glgraphics), do you still observe the crash?

ashleyjam..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Yes im using processing serial library to recieve the arduino inputs - even though i have the processing arduino lib installed it doesnt work for me

Yes i get a crash with any of the inbuilt examples within the glgraphics folder and also the opengl folder such as the spacejunk code etc

So its somewhere todo with using processings serial and opengl libraries at the same time in the same sketch (i think)

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Seems like a tricky problem...

What if you compile processing from the latest version of the source available in the svn repository? I suggest this because the OpenGL library in the trunk (renamed as P3D) doesn't use JOGL anymore but JOGL2 instead and this might solve this apparent incompatibility between the opengl and serial libraries in Processing 1.5.1 (which seems to me that occurs at the level of the JNI, which is the binding between Java and native libraries).

Even though GLGraphics doesn't work at this point with the newest revisions in the repository, much of its functionality, sprites and particle systems in particular, are in fact part of P3D (take a look at the Rocked or Trefoil examples in the opengl category).

ashleyjam..

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

ill give it a go - but do you say it wont work using glgrpahics and sprites using particles ? I can use toxiclibs or fisica for some of my background layers in the grpahics but the main generative part is using custom sprites rendered using glgraphics

Many many thanks for taking the time to reply

Im sure its a bug / problem that may gey resolved with 2.0 but it sounds like youll be the man sorting it ;-)

ashleyjam..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi its the exact same problem with using 0.99 processing running and opengl sketch such as trefoil with adding in some serial code to receive an input you get an out of memory error id also

Error with OPENGL and Processing 0.99 and using import library Serial and OpenGL

Stable Library

=========================================

Native lib Version = RXTX-2.1-7

Java lib Version = RXTX-2.1-7

[0] "/dev/tty.usbserial-A9005cAv"

[1] "/dev/cu.usbserial-A9005cAv"

[2] "/dev/tty.Bluetooth-PDA-Sync"

[3] "/dev/cu.Bluetooth-PDA-Sync"

[4] "/dev/tty.Bluetooth-Modem"

[5] "/dev/cu.Bluetooth-Modem"

Invalid memory access of location 0x0 eip=0x95ca03ab

EXACT SAME LOCATION FOR MEMORY using processing 1.5.1 and GSGRAPHICS and SERIAL

GLGraphics version: 0.99

Maximum sprite size supported by the video card: 64.0 pixels.

Stable Library

=========================================

Native lib Version = RXTX-2.1-7

Java lib Version = RXTX-2.1-7

[0] "/dev/tty.usbserial-A9005cAv"

[1] "/dev/cu.usbserial-A9005cAv"

[2] "/dev/tty.Bluetooth-PDA-Sync"

[3] "/dev/cu.Bluetooth-PDA-Sync"

[4] "/dev/tty.Bluetooth-Modem"

[5] "/dev/cu.Bluetooth-Modem"

Invalid memory access of location 0x0 eip=0x95ca03ab

IS it to do with Arudino and a OpenGL sharing resources ????

It always gives the OpenGL error when it pops up with the crash report

some of it below cos its very very long

Process: java [441]

Path: /usr/bin/java

Identifier: com.apple.javajdk16.cmd

Version: 1.0 (1.0)

Code Type: X86 (Native)

Parent Process: JavaApplicationStub [436]

PlugIn Path: /Applications/Processing.app/Contents/Resources/Java/modes/java/libraries/opengl/library/macosx/libjogl.jnilib

PlugIn Identifier: libjogl.jnilib

PlugIn Version: ??? (???)

Date/Time: 2011-08-23 13:55:41.620 +0100

OS Version: Mac OS X 10.6.8 (10K549)

Report Version: 6

Interval Since Last Report: 63899 sec

Crashes Since Last Report: 44

Per-App Interval Since Last Report: 11816 sec

Per-App Crashes Since Last Report: 44

Anonymous UUID: 92B35772-0973-4D82-91D3-AE4278BAC248

Exception Type: EXC_BAD_ACCESS (SIGBUS)

Exception Codes: KERN_PROTECTION_FAILURE at 0x0000000000000000

Crashed Thread: 27 Java: Thread-3

Application Specific Information:

Java information:

Exception type: Bus Error (0xa) at pc=0000000095ca03ab

Java VM: Java HotSpot(TM) Client VM (20.1-b02-384 mixed mode macosx-x86)

Current thread (00000000100acc00): JavaThread "Thread-3" [_thread_in_native, id=-1315184640, stack(00000000b18be000,00000000b19be000)]

Stack: [00000000b18be000,00000000b19be000]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)

j com.sun.opengl.impl.GLImpl.glGetError()I+0

j processing.opengl.PGraphicsOpenGL.report(Ljava/lang/String;)V+14

j codeanticode.glgraphics.GLGraphics.renderTriangles(II)V+3

j processing.core.PGraphics3D.endShape(I)V+142

j processing.core.PGraphics.endShape()V+2

j processing.core.PGraphics.quad(FFFFFFFF)V+36

j processing.core.PGraphics.rectImpl(FFFF)V+11

j processing.core.PGraphics.rect(FFFF)V+152

j processing.core.PApplet.rect(FFFF)V+28

j LunaSwarmTest.serialEvent(Lprocessing/serial/Serial;)V+22

v ~StubRoutines::call_stub

j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0

j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87

j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6

j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+161

j processing.serial.Serial.serialEvent(Lgnu/io/SerialPortEvent;)V+153

j gnu.io.RXTXPort.sendEvent(IZ)Z+382

v ~StubRoutines::call_stub

j gnu.io.RXTXPort.eventLoop()V+0

j gnu.io.RXTXPort$MonitorThread.run()V+12

v ~StubRoutines::call_stub

ashleyjam..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

p.s its the same using even toxiclibs but i get a different crash error but using processings serial library and other libraries causes crashes.

im going (i think) to create my own node/particle class and se if that can work - im just unsure on rendering so it looks good

ashleyjam..

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

without swearing....... *&^$%£^@&!*£&$%

Got it to work by moving the arduino recieve code out of the

void serialEvent (Serial myPort) {

}

deleting this void

and put the code in the draw and it works.

This is something that needs flaggin in the wiki or changed within processing somewhere

as a code example i used to have

void serialEvent (Serial myPort) {

fill(255, 5);

rect(0, 0, width, height);

String inString = myPort.readStringUntil('\n'); // \n

if (inString != null) {

inString = trim(inString);

float inByte = float(inString);

int[] sensors = int(split(inString, ","));

for (int sensorNum = 0; sensorNum < sensors.length; sensorNum++) {

print("Sensor " + sensorNum + ": " + sensors[sensorNum]);

}

// map them to the range 0-255

squeeze1 = map(sensors[3], 0, 1023, 0, 255);

stroke(255,squeeze1);

fill(255,squeeze1);

ellipse(50,50,squeeze1+50,squeeze1+50);

}//endif

}//end void

and now its just all in the draw and it works fine - no crashes with GLGraphics anymore.

How incredibly simple to fix.

paolop

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi everybody!

I am trying to use GSVideo and GLGraphics to play a number of videos at the same time while applying dynamic masks to each of them - the result should be a dynamic collage - but for some reason i can't make it to work (on ubuntu 11.04 32bit)...

anyone who can help? here is the code i am using:

import processing.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;

GSMovie m1,m2;
GLTexture tex1,tex2;
PGraphics mask1,mask2;

int x,y,l;

void setup() {
size(1920, 1080, GLConstants.GLGRAPHICS);
background(0);


// Use texture tex as the destination for the movie pixels.
tex1 = new GLTexture(this);
m1 = new GSMovie(this, "1.MOV");
m1.setPixelDest(tex1);
m1.loop();

tex2 = new GLTexture(this);
m2 = new GSMovie(this, "2.MOV");
m2.setPixelDest(tex2);
m2.loop();

    mask1 = createGraphics(width, height, JAVA2D);
    mask2 = createGraphics(width, height, JAVA2D);

}

void movieEvent(GSMovie movie) {
m1.read();
m2.read();
}

void draw() {
// If there is a new frame available from the movie, the
// putPixelsIntoTexture() function will copy it to the
// video card and will return true.

// create masks

mask1.beginDraw();
mask1.smooth();
mask1.noStroke();
mask1.fill(0);
x = int(random(0, width));
y = 0;
l = int(random(0, width-x));
mask1.rect(x,y,x+l,height);
mask1.fill(255);
x = int(random(0, width));
y = 0;
l = int(random(10, width-x));
mask1.rect(x,y,x+l,height);
mask1.endDraw();

mask2.beginDraw();
mask2.smooth();
mask2.noStroke();
mask2.fill(0);
x = int(random(0, width));
y = 0;
l = int(random(0, width-x));
mask2.rect(x,y,x+l,height);
mask2.fill(255);
x = int(random(0, width));
y = 0;
l = int(random(10, width-x));
mask2.rect(x,y,x+l,height);
mask2.endDraw();

if (tex1.putPixelsIntoTexture()) {
    tint(255,255);
    tex1.mask(mask1);
    image(tex1,0,0);
}

if (tex2.putPixelsIntoTexture()) {
    tex2.mask(mask2);
    image(tex2,0,0);
}
println(frameCount);
}

thank you very much!!
ciao
paolo

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

i was able to play the video converted into a .wmv file at a smaller resolution, but the mask is still not working...any idea?

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

hi, the problem in this case is that the video image is only stored in the video card memory as an OpenGL texture, so calling mask() has no effect since it operates on the pixels array.

One solution is to call the updateTexture() method right after getting the video pixels, and loadPixels() before drawing:

if (tex1.putPixelsIntoTexture()) {
tex1.updateTexture(); // copy texture to pixels
tint(255,255);
tex1.mask(mask1);
tex1.loadTexture(); // copy pixels to texture
image(tex1,0,0);
}

the disadvantage of this approach is that you are copying data from GPU to CPU memory (updateTexture) and back (loadPixels) which are slow operations. If performance is a concern, then you would need to re-implement your masks using texture filters. Take a look at the IrregularMask example included with GLGraphics. It might help.

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

thank you very much Andreas!
I was already taking a look at the example, but the solution you proposed works perfectly...
thanks again
paolo

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

now with 3 videos the problem is that the screen remains blank and the sketch stops running after a few frames...
and it doesn't say anything about errors or insufficient memory...is there a way i can make it work? :)
here is the code...

import processing.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;

GSMovie m1, m2, m3;
GLTexture tex1, tex2, tex3;
PGraphics mask1, mask2, mask3;

int [] fibonacci = {
1, 1, 2, 3, 5, 8, 13, 21, 34, 55
};

int x, y, l;
int rf, rx;
int module=10;

void setup() {
size(1280, 720, GLConstants.GLGRAPHICS);
background(0);

// Use texture tex as the destination for the movie pixels.
tex1 = new GLTexture(this);
m1 = new GSMovie(this, "1_720p.wmv");
m1.setPixelDest(tex1);
m1.loop();

mask1 = createGraphics(width, height, JAVA2D);

tex2 = new GLTexture(this);
m2 = new GSMovie(this, "4_720p.wmv");
m2.setPixelDest(tex2);
m2.loop();

mask2 = createGraphics(width, height, JAVA2D);

tex3 = new GLTexture(this);
m3 = new GSMovie(this, "3_720p.wmv");
m3.setPixelDest(tex3);
m3.loop();

mask3 = createGraphics(width, height, JAVA2D);
}

void movieEvent(GSMovie movie) {
m1.read();
m2.read();
m3.read();
}

void draw() {
// If there is a new frame available from the movie, the
// putPixelsIntoTexture() function will copy it to the
// video card and will return true.

// create masks
// 1
mask1.beginDraw();
mask1.noStroke();
mask1.background(0);

rf = floor(random(0, fibonacci.length));
l = module*fibonacci[rf];
rx = floor(random(0, ((width)/5)));
x=rx*module;
y=0;

mask1.fill(255, 255/(fibonacci[rf]*0.25));
mask1.rect(x, y, l, height);

mask1.endDraw();

// 2
mask2.beginDraw();
mask2.noStroke();
mask2.background(0);

rf = floor(random(0, fibonacci.length));
l = module*fibonacci[rf];
rx = floor(random(0, ((width)/5)));
x=rx*module;
y=0;

mask2.fill(255, 255/(fibonacci[rf]*0.25));
mask2.rect(x, y, l, height);

mask2.endDraw();

// 3
mask3.beginDraw();
mask3.noStroke();
mask3.background(0);

rf = floor(random(0, fibonacci.length));
l = module*fibonacci[rf];
rx = floor(random(0, ((width)/5)));
x=rx*module;
y=0;

mask3.fill(255, 255/(fibonacci[rf]*0.25));
mask3.rect(x, y, l, height);

mask3.endDraw();

//

if (tex1.putPixelsIntoTexture()) {
    tex1.updateTexture(); // copy texture to pixels
    tint(255, 255);
    tex1.mask(mask1);
    tex1.loadTexture();   // copy pixels to texture
    image(tex1, 0, 0);
}

if (tex2.putPixelsIntoTexture()) {
    tex2.updateTexture(); // copy texture to pixels
    tint(255, 255);
    tex2.mask(mask2);
    tex2.loadTexture();   // copy pixels to texture
    image(tex2, 0, 0);
}

if (tex3.putPixelsIntoTexture()) {
    tex3.updateTexture(); // copy texture to pixels
    tint(255, 255);
    tex3.mask(mask1);
    tex3.loadTexture();   // copy pixels to texture
    image(tex3, 0, 0);
}

println(frameCount);
}

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

i'll try to re-implement the masks using texture filters...might be a stupid question: but is there i way i can use PGraphics objects (which i draw dynamically for each frame) as masks to apply to GLTexture objects?

thanks again!

paolo

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

ok, thanks for the update. I think I have seen similar errors happen recently (movie stop playing after a few frames)... This might help me to figure out the problem.

What is the codec and resolution of your videos?

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

hi andreas,

the dimensions of the video are 1280 x 720
codec: microsoft windows media 9
framerate: 30fps
bitrate: 4027 kbps

i just tried with 720 x 576 videos and it doesn't work as well... (later i'll try with 1024 x 576 but i suppose it's not going to be any better with larger res...)

thanks for your help!

paolo

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

About your questions:

1) Using PGraphics as a mask in a texture filter: no, it is not possible. One way to have a dynamic mask would be to use a GLGraphicsOffScreen object to draw the mask into an offscreen canvas, and then pass its texture as the parameter for the texture filter.

2) Video playback freezing after first frames: could you re-encode your video using h264 or xvid, and see if this error still happens?

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I'll try right now and i'll let you know!
Thanks!

paolop

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

thanks andres - i tried and it works better using x264 encoded videos... i could play 3 videos at a time (576p) but for some reason i couldn't get the masks to be drawn "incrementally" (i mean not from scratch at every frame)...it would just crash

and i don't understand why this piece of code won't work:

import processing.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;
int nclips = 3;
GSMovie [] clips = new GSMovie[nclips];
GLTexture [] textures = new GLTexture [nclips];
//GLTexture [] maskedTextures = new GLTexture [nclips];
GLGraphicsOffScreen [] masks = new GLGraphicsOffScreen [nclips];
int [] fibonacci = {
1, 1, 2, 3, 5, 8, 13, 21, 34, 55
};
int x, y, l;
int rf, rx;
int module=10;
int f = 0;
GSMovieMaker mm;
void setup() {
size(1024, 576, GLConstants.GLGRAPHICS);
background(0);
// Use texture tex as the destination for the movie pixels.
for (int i =0; i<nclips; i++) {
textures[i] = new GLTexture(this);
clips[i] = new GSMovie(this, i+".mp4");
clips[i].setPixelDest(textures[i]);
clips[i].loop();
masks[i] = new GLGraphicsOffScreen(this, width, height);
// maskedTextures[i] = new GLTexture(this);
masks[i].beginDraw();
masks[i].background(0);
masks[i].endDraw();
}
mm = new GSMovieMaker(this, width, height, "field_video.ogg", GSMovieMaker.THEORA, GSMovieMaker.BEST, 10);
mm.setQueueSize(50, 10);
mm.start();
}
void movieEvent(GSMovie movie) {
clips[f].read();
}
void draw() {
// If there is a new frame available from the movie, the
// putPixelsIntoTexture() function will copy it to the
// video card and will return true.
//System.gc();
masks[f].beginDraw();
masks[f].noStroke();
rf = floor(random(0, fibonacci.length));
l = module*fibonacci[rf];
rx = floor(random(0, ((width)/5)));
x=rx*module;
y=0;
masks[f].fill(255, 255/(fibonacci[rf]*0.25));
masks[f].rect(x, y, l, height);
rf = floor(random(0, fibonacci.length));
l = module*fibonacci[rf];
rx = floor(random(0, ((width)/5)));
x=rx*module;
y=0;
masks[f].fill(0);
masks[f].rect(x, y, l, height);
masks[f].endDraw();
if (textures[f].putPixelsIntoTexture()) {
textures[f].updateTexture(); // copy texture to pixels
textures[f].mask(masks[f]);
textures[f].loadTexture(); // copy pixels to texture
image(textures[f], 0, 0);
}
loadPixels();
mm.addFrame(pixels);
println(frameCount);
if (frameCount == 5000) {
// Finish the movie
mm.finish();
// Quit running the sketch once the file is written
exit();
}
}

it gives me this error:

0:00:08.290474000 4532 7AD0DB90 ERROR ffvideoscale .:0:: no frame!

0:00:08.290474000 4532 7AD0DB90 ERROR ffvideoscale .:0:: get_buffer() failed (-1 0 0 00000000)

0:00:08.290474000 4532 7AD0DB90 ERROR ffvideoscale .:0:: decode_slice_header error

do you have any idea? i would like to make a dynamic collage of videos...maybe this is not the best way to do it?

thanks a lot

paolo

andres

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I think is better if you start another topic about this issue. This one is becoming way too long.

jobleonard

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Because of a project requiring a GPU with a lot of RAM, but not much processing power, I wound up with a PC with the odd combination of an Atom 330 processor and a Radeon HD 6850 graphics card.

I figured I'd use it for my movie-installation. Turns out every example in the GLGraphics and GSVideo library works (ok, the CGShader examples don't work either, but there's an explanation for that), except the GLGraphics/GSVideo integration! :(

EDIT: Wait, not every example works. I hadn't tried the GLGraphics/Textures/ examples yet. " BasicUse" also crashes, "ShaderLib" and "ShaderToy" run but crash as soon as I press a key. "BandedBlend" and "IrregularMask" display nothing. Every other example works fine.

The frames are decoded, but displayed flickering with what I suspect is random trash from the memory, and then the program crashes after a couple of seconds.

Looks like this:

Actually, that's not quite it (because it crashed while saving this file and this is what GIMP could recover). Here's the log-file of the crash:

http://pastebin.com/t6dQDRkU

I'm running Ubuntu 11.04, GSVideo 0.9, and GLGraphics 20110612 (I'm going to try other test releases now, see if that makes a difference). I'm not sure if the problem lies with the libraries, or with the drivers. Any ideas what I could try?

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Well, the video card should run all the GLGraphics examples without trouble. However, I never seen this combination of a low-power processor with a high-end GPU, and I don't know if there any incompatibilities. I found this thread discussing this kind of setup, and the consensus seem to be that the Atom is too weak to handle such video cards.

From the error log you posted, it seems that crash originates somewhere in the native code at the graphics driver level:

Stack: [0x489ee000,0x489ff000], sp=0x489fe288, free space=64k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [+0x416] __kernel_vsyscall+0x2
C [fglrx_dri.so+0x1837bf3]
C [libpthread.so.0+0x5e99]

Did you try playing videos through GSVideo without the GLGraphics integration? Do you see any crashes in that case?

jobleonard

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Without the integration it runs, but not as fluently because I'm running multiple HD movies (at most two at a time).

The link you posted is about gaming, which tends to max out both CPU and GPU. If I have an application that uses the GPU but not much of the CPU I'd expect it to work without any problems. Since your libraries unload nearly all the hard work (decoding and displaying the movie) to the GPU it should run just fine, right? Of course, driver incompatibilities are a different problem altogether... and since half of the shader examples also crash.

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Yes, looks like a driver problem... Are you able to run other applications (not Processing sketches) that use OpenGL/GLSL shaders?

jobleonard

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Didn't have any installed. I'm going to try Pouet.net, maybe they have some stuff.

andres

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

You could try this: Phoronix Test Suite, which includes graphics tests.

jobleonard

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

I forgot to say whether or not it worked. Basically, the test suite prove the problem was caused by the Ati drivers for Linux. After switching to Windows 7 the GLGraphics/GSVideo integration finally worked, but the CPU couldn't deal with running two movies simultaneously (for crossfading) - the second movie tended to freeze or not even start running. I guess you were right about the it being too weak (maybe it's a threading problem?). So I upgraded my main PC with the 6850, and got the software to run on there without any problems.

The downside to that solution is that I had to live without my work-PC for the duration of the exposition, and because the exposition was at a music festival there was also the risk it breaking down due to people spilling beer over it or something.

andres

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi, I also some threading issues when using the gsvideo-glgraphics interop method and playing several videos at once. I added a switch in the new releases of gsvideo/ glgraphics (yes, these are the 1.0 but didn't even have time to write anything else about them) that apparently solves these issues (not sure if this was the problem in you case, but it might help). All you need to do is to call movie.setPixelDest(tex, true).

jobleonard

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

That's great, and on top of that these fixes/added features generally will help me out as well :)

* Automatic switching between 32 and 64 bits modes.

* Added 64 bits support to windows.

* Fixed implementation of jump-to-position method, and added isSeeking() method

to use in combination with jump()

amnon.owed

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Let me start by saying... thanks andres for all your great efforts!

I've been running some technical tests in GLGraphics and GSVideo for a project that will produce some extreme widescreen visuals on top of a video background (to be projected). The resolution I'm talking about is about 12000 x 1200 pixels. Yes, I understand that this resolution is pretty insane.

On the GLGraphics side I found that the max texture size of my video card is 16384 (2 to the power 14). This is the current maximum for high end video cards. This is fine as it covers the intended output. I've tested with a GLGraphicsOffScreen up to that size and it works. Of course above that it crashes, due to the hardware limitation of current video cards. A prerequisite however is that it's running on 64bit as it allows better memory usage. On 32bit it results in an opengl out of memory / frame buffer is incomplete error. So the GLGraphics side with a high res GLGraphicsOffScreen only works well on 64bit.

On the GSVideo side you already answered in this thread that on windows it currently only runs on 32bit. I also found that the H.264 codec which I was using is constrained to 4096×2048 @ 30fps (level 5.1). For testing I've used the HDVideo example with GLGraphics integration. I haven't thoroughly tested large resolution videos yet (partly due to the mentioned limitations of H.264 which I wasn't aware of earlier), but the preliminary results are not as good as I would hope:

3000x600 (MP4) => works, runs smoothly at 30 fps, all is well!
4096x1200 (MP4) => only first frame is shown, 0 fps, "OpenGL error 1285 at render_triangles in: out of memory"
12000x1200 (MOV) => doesn't do anything. No error message.

I am hoping that 64bit will automagically solve at least some stuff as it did with the GLGraphics side.

Some questions I have now:

What would be the best video format for working (a) with extremely high resolutions (b) in GSVideo?
Anybody got experience with extremely high resolutions in GSVideo and if so, what is the maximum you got working?
Is there an indication when the 64bit gstreamer dll's will be available so GSVideo can be enjoyed on 64bit windows?

Thanks and keep up the good work!

jobleonard

Re: Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Keep us posted on your experiments! I find this very interesting from a technical perspective (and I'm also curious as to what it is that you're making).

Did you try tweaking the settings for buffering frames to see if that has any influence?

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi, I never tried gsvideo with movies larger 1920x1080, so my experience is quite limited here.

I'm not sure what platform you are on, in the case you are working with windows, this package of gsvideo automatically supports 64 bits, so if you install the expert version of processing together with a 64 bits JDK, you should be able to run everything, including movie playback, in 64 bits.

amnon.owed

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Wow, excellent!

I tried the latest package (I'm indeed running processing expert + 64bit JDK on windows 7) and it works great. This will mean I'll be able to integrate everything under 64bit, which is already a great improvement. More good news is that the 4096x1200 H.264 MP4 could be run in 64bit. No more out of memory issues. So that's another step forward. All of this gives me a good baseline for further testing.

@ jobleonard: I tested if the buffer settings impacted the fps (which drops somewhat at 4000+ resolution). However neither setPixelBufferSize() nor delPixelsWhenBufferFull() have an impact. I guess because the rendering speed is not the bottleneck. Rather the opposite, it seems the data retrieval takes much time. I suppose they do impact the memory if the movie fps is greater than the display speed. However at these high resolutions, getting a decent fps in the first place is the challenge.

I have done some more searching on the highest supported resolutions by different codecs. Two very promising codecs are Dirac and Theora, which both support (virtually) unlimited resolutions, thus blowing the good ol' H.264 right out of the water. I know both are supported by gstreamer, so I'm assuming/hoping they are also supported by GSVideo. Anyway, I'll have some more time to try different resolutions/codecs in the weekend. So far so good.

lotelx

Question about GLTextureWindow

2 years ago

Hi andres. Thanks for your beautiful libraries!!

I have a little problem with GLTextureWindow

When I try to get the width or height of GLTextureWindow inside setup
I get NullPointerException

The simplified code taked from examples:

import processing.opengl.*;
import codeanticode.glgraphics.*;

GLGraphicsOffScreen canvas;
GLTextureWindow texWin;

void setup() {
size(300, 300, GLConstants.GLGRAPHICS);
canvas = new GLGraphicsOffScreen(this, 400, 400);
texWin = new GLTextureWindow(this, 0, 0, 400, 400);
texWin.setTexture(canvas.getTexture());
println("ERROR Getting width: " + texWin.getWidth());
}

void draw() {
background(255);
}

But if i get the width inside draw() all is ok.

I ask this because in a project with eclipse with controlP5 i try to get the width pressing a button.
In this case the problematic line is not inside size() (is an event) but i have the same error.

Thanks!

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Ok, I see the error in the code of GLGraphics, although it should only result in getWidth() return 0 instead of a NullPointerException... Are you using an older version of GLGraphics?

lotelx

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi,
I'm using GLGraphics 0.99 & Snow Leopard & Processing 1.5

Hi have this error with getWidth & getHeight only when is inside setup()

GLGraphics version: 0.99
Exception in thread "Animation Thread" java.lang.NullPointerException
    at codeanticode.glgraphics.GLTextureWindow.getHeight(Unknown Source)
    at texturewindowerror.setup(texturewindowerror.java:35)
    at processing.core.PApplet.handleDraw(PApplet.java:1608)
    at processing.core.PApplet.run(PApplet.java:1530)
    at java.lang.Thread.run(Thread.java:680)

Thanks!

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hello, this new release eliminates the crash, but getWidth/getHeight still return 0 if called in setup(). This is because the actual window frame hasn't been initialized yet. As a workaround you can use the resolution of the texture, since the window frame is always created with exactly that res.

amnon.owed

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Something strange happened when rendering to a GLGraphicsOffScreen and the example below recreates the problem. It seems to me things are scaled to 50% when using beginGL()-endGL() on a GLGraphicsOffScreen. Or is it me?

This occurs in both GLGraphics 0.99 and GLGraphics 1.0.0.

import processing.opengl.*;
import codeanticode.glgraphics.*;
GLGraphicsOffScreen off;
void setup() {
size(1000, 600, GLConstants.GLGRAPHICS);
off = new GLGraphicsOffScreen(this, width, height);
PImage img = createImage(width, height, RGB);
img.loadPixels();
for (int y=0; y<img.height; y++) {
for (int x=0; x<img.width; x++) {
int loc = x + y * img.width;
img.pixels[loc] = color(map(y, 0, height, 255 ,0),map(x, 0, width, 255 ,0),map(y, 0, height, 255 ,0));
}
}
img.updatePixels();
GLTexture tex = new GLTexture(this);
tex.putImage(img);
off.beginDraw();
off.noStroke();
tex.render(off, 0, 0, width, height); // normal size
off.endDraw();
off.beginDraw();
off.beginGL();
tex.render(off, 0, 0, width, height); // half size
// off.image(tex, 0, 0, width, height); // half size
off.endGL();
off.endDraw();
}
void draw() {
image(off.getTexture(), 0, 0);
}

andres

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hi, I can reproduce this error in my computer. I will open an issue about this in the sourceforge page of glgraphics, so I don't forget to take care about it later. Thanks for the feedback!

sixswitch

Re: GSVideo 0.9 / GLGraphics 0.99

2 years ago

Hey Andres,

I'm having some trouble trying to draw text to the screen using GLGraphics and Proscene. Would you be able to offer any thoughts on flat / 'screen' mode / HUD-style text in GLGraphics?

The thread is here...

http://forum.processing.org/topic/hud-screendrawing-with-text-or-type-using-glgraphics-and-proscene

Thanks!

Jacob

radamar

Re: GSVideo 0.9 / GLGraphics 0.99

11 months ago

hey Andres,

how can I play HD movies on processing 2.xx ? I know the GLGraphics now is parte of the processing core, but what about the textures and setPixelDest that we used with GLGraphics and GSVideo?

andres

Re: GSVideo 0.9 / GLGraphics 0.99

11 months ago

If you use the P2D/P3D renderers and the built-in video library, then the setPixelDest mechanism from GLGraphics/GSVideo will just work under the scenes without you having to add any special code.

radamar

Re: GSVideo 0.9 / GLGraphics 0.99

11 months ago

hi Andres,

thanks, i'll try it out!

bach44

Re: GSVideo 0.9 / GLGraphics 0.99

9 months ago

Hi Andres

Could you confirm whether GlGraphics 1.0 is compatible with Processing 2.0b7? Can't seem to get any of the examples to run without errors

Exception in thread "Animation Thread" java.lang.NoClassDefFoundError: processing/opengl/PGraphicsOpenGL$ImageCache

at java.lang.Class.getDeclaredConstructors0(Native Method)

at java.lang.Class.privateGetDeclaredConstructors(Class.java:2389)

at java.lang.Class.getConstructor0(Class.java:2699)

at java.lang.Class.getConstructor(Class.java:1657)

at processing.core.PApplet.makeGraphics(PApplet.java:1743)

at processing.core.PApplet.size(PApplet.java:1596)

at processing.core.PApplet.size(PApplet.java:1567)

at FishEye.setup(FishEye.java:39)

at processing.core.PApplet.handleDraw(PApplet.java:2117)

at processing.core.PGraphicsJava2D.requestDraw(PGraphicsJava2D.java:193)

at processing.core.PApplet.run(PApplet.java:2020)

at java.lang.Thread.run(Thread.java:680)

Caused by: java.lang.ClassNotFoundException: processing.opengl.PGraphicsOpenGL$ImageCache

at java.net.URLClassLoader$1.run(URLClassLoader.java:202)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:190)

at java.lang.ClassLoader.loadClass(ClassLoader.java:306)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)

at java.lang.ClassLoader.loadClass(ClassLoader.java:247)

... 12 more

andres

Re: GSVideo 0.9 / GLGraphics 0.99

9 months ago

Hi, GLGraphics 1.0 is not compatible with any 2.0 release. The library needs to be substantially re-written in order to work with the new OpenGL renderers in 2.0.

Replies(97)

Statistics

Tags

Actions

Related Posts