Video formatting for GSVideo

akiersky

in Contributed Library Questions • 2 years ago

Hi All,

I am using the gsvideo lib to play a large background video scaled 2x. I play the video through once, then hold the last frame in the texture while other parts of the app animate, then the video resets and we go through the process of playing again.

However, it seems that sometimes, the second (or third, fourth, maybe not at all) the video stalls partway in (also inconsistant). Because other classes are waiting for the video to finish, the entire app halts. No errors, the video seems to just pause. I have even gone as far as to tell the video to play each frame it loads.

When the video is finished, I stop it and delete, then set it to null. when it replays I make a new GSMovie object. maybe this isn't necessary, but it seemed to make it work more often.

So Im wondering if the format of the video is a problem, it is currently a h264 mov file at about 3000x600 (for a large video wall, these dimensions are actually only half size) is there another format that works more consistently? or is there a way to tell the movie to keep playing? is my telling it to play each frame killing it somehow?

I can give some code, but there are a lot of dependancies, really if you have a way to replay a gsvideo, that seems like my main issue.

thanks for any ideas!

Replies(4)

akiersky

Re: Video formatting for GSVideo

2 years ago

so here is a slimmed down version of what is happening, but for whatever reason, the issue dosen't show up. but maybe there is still something wrong with my method here that someone could suggest a better way.

I tried to detect if the video had frozen by saving the last frame's time time and testing against the current time, then seeking just slightly ahead, but it seems that the jump() method of GSMovie fails every time for me. hmm...

here's my setup (also needed is ijeoma's motion lib: http://ekeneijeoma.com/processing/ijeomamotion/ ):

import processing.opengl.*;
import javax.media.opengl.*;
import codeanticode.glgraphics.*;
import codeanticode.gsvideo.*;
import javax.imageio.*;
import ijeoma.motion.*;
import ijeoma.motion.timeline.*;
import ijeoma.motion.tween.*;
BGvideo bgv;
Runtime rtime;
public void init() {
/// to make a frame not displayable, you can
// use frame.removeNotify()
frame.removeNotify();
frame.setUndecorated(true);
// addNotify, here i am not sure if you have
// to add notify again.
frame.addNotify();
super.init();
}
void setup()
{
size(6144, 1366, GLConstants.GLGRAPHICS);
hint(DISABLE_OPENGL_2X_SMOOTH);
hint(ENABLE_OPENGL_4X_SMOOTH);
hint(DISABLE_OPENGL_ERROR_REPORT);
frameRate(90);
background(255);
registerDraw(this);
frame.setLocation(0, 0);
rtime = Runtime.getRuntime();
Motion.setup(this);
bgv = new BGvideo("WCintro_half.mov", this);
goNow();
}
void draw() {
background(255);
}
public void goNow() {
bgv.go();
noCursor();
}
PApplet getThis() {
return this;
}
void movieEvent(GSMovie movie) {
movie.read();
}
void videoComplete() {
}
public void resetEverything() {
println("c12 video resetting called");
bgv.out();
}
public void collectGarbage(){
//Garbage Collection on loop///////////////////////////////////
long present1 = rtime.freeMemory();
println("After running the program, we have : " + present1 + " bytes");
rtime.gc();
long present2 = rtime.freeMemory();
println("After collecting garbage we have : " + present2 + " bytes");
}

and BGvideo.pde:

public class BGvideo {
GSMovie myMovie;
GLTexture tex;
PImage img;
videoTest app;
float xx = 0;
float yy = 0;
int w = 768*8;
Boolean hasPlayed;
String vidUrl;
Tween t;
public BGvideo (String videoFile, videoTest app) {
app.registerDraw(this);
this.app = app;
this.vidUrl = videoFile;
hasPlayed = false;
t = new Tween(0, height, 2, MotionConstant.SECONDS, 0, MotionConstant.QUAD_EASE_IN);
}
void setupVideo() {
myMovie = new GSMovie(app, vidUrl);
tex = new GLTexture(app);
tex.delPixelsWhenBufferFull(true);
tex.setPixelBufferSize(5);
tex.enableFastTextureLoad();
myMovie.frameRate(myMovie.getSourceFrameRate());
myMovie.setPixelDest(tex);
}
public void go() {
hasPlayed = false;
setupVideo();
myMovie.play();
println("movie started");
}
public void out() {
t.play();
hasPlayed = false;
}
void draw () {
if (myMovie != null && myMovie.isPlaying()) {
//println("bgvideo isPlaying, ready? " + myMovie.ready()+ ": " + myMovie.time() + "/" + myMovie.duration());
//myMovie.play();
if (myMovie.ready()) {
//myMovie.read();
try{
//if(tex.putPixelsIntoTexture()){
tex.putPixelsIntoTexture();
tex.render(xx, yy, w, height);
//}
} catch (Error e) {
app.goNow();
}
}
hasPlayed = true;
} else if (hasPlayed) {
xx-=2;
image(tex, xx, yy, w, height);
image(tex, xx+width, yy, w, height);
if (xx <= -width) {
xx = 0;
app.resetEverything();
}
} else {
hasPlayed = false;
yy = t.getPosition();
image(tex, xx, yy, w, height);
image(tex, xx+width, yy, w, height);
if (yy == height) {
println("resetting! ");
yy = 0;
xx = 0;
moveOn();
if (myMovie != null) {
println("myMovie is persisting");
myMovie.delete();
myMovie = null;
}
app.collectGarbage();
app.goNow();
}
}
}
public void moveOn() {
myMovie.stop();
myMovie.delete();
myMovie = null;
app.videoComplete();
}
}

thanks for any help!!

akiersky

Re: Video formatting for GSVideo

2 years ago

Update,

so it seems that animation compression works quite nicely, looks smoother, and seems to be a little more stable. I am still having issues of the video hanging, almost pausing on a frame, in fact, exactly pausing, the time just stopps, but the isPlaying() is still true.

I have removed the enableFastTextureLoad() from the GLtexture, as the docs said it is experimental, I replaced it with loadTextureFast() which seems to do the same thing?? but no results there either. I also clean up the texture by setting to zero and deleteing it at the end of the larger loop.

I tried increasing the pixel buffer to 10, with no results, currently I am working with it at 1, which seems to be better, but it's hard to say.

The biggest issue is that I need to feel comfortable walking away. The instal is on site at the client's global headquarters, and will be mostly unmonitored by someone who could reset if something goes wrong. Im going to look into a failsafe to help in a worst case situation.

any thoughts ?

thanks, ak

akiersky

Re: Video formatting for GSVideo

2 years ago

I just got an fatal error about atioglxx.dll, right after a reget_buffer() error;

0:10:46.651986000 9652 6054E8C0 ERROR ffvideoscale .:0:: reget_buffer() failed
0:10:46.653986000 9652 6054E8C0 ERROR ffvideoscale .:0:: reget_buffer() failed
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x69b82a55, pid=9652, tid=4752
#
# JRE version: 6.0_24-b07
# Java VM: Java HotSpot(TM) Client VM (19.1-b02 mixed mode windows-x86 )
# Problematic frame:
# C [atioglxx.dll+0xb52a55]
#
# An error report file with more information is saved as:
# C:\Program Files\processing-1.5.1\hs_err_pid9652.log
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

which seems to be the ati opengl driver, that crashed the whole app, checking online, it looks like all my drivers are up to date. Seeing this brings back some thoughts that it could be the graphics card running out of memory?? or having troubles addressing the memory it has stored.

the error occoured on a loop of the video, right before it started. I am still suspicious that gs video could be the root of the issue

Is there a way to 'garbage collect' the graphics card, or somehow release/clean it's memory? i don't really know what I am talking about but thought I would ask.

thanks!

andres

Re: Video formatting for GSVideo

2 years ago

As a first comment, don't use the fast loading functionality in GLTexture, since it doesn't really work :-)

I'd consider trying a lower resolution video, just to make sure that the size of the video frames and textures are not causing the crashes.

Top Reply