Code for generating 360 Stereoscopic videos with Processing

benjamin

Hi!

I started looking into generating 360 video with Processing at the back end of 2016 using a modification to the dome projection example sketch and an equirectangular shader. It was a neat little trick, taking a cubemap and running it through the shader to generate frames for a 360 video.

Going further down the rabbit hole I ended up putting together a sketch that generates a full top/bottom stereoscopic frame that can be used to render out a 360 video. This was based largely on the Unreal Engine plug in by Kite & Lightning, and a lot of reading of Paul Bourke's research into stereoscopy.

I've made the code public on GitHub to see what the Processing community at large makes of it https://github.com/tracerstar/processing-360-video

This is a music video I made that was generated using the code https://vimeo.com/218341125

At some point I'll do a full write up of how to use the code and add some simpler examples, as well as some tricks on how to get the best quality video from the rendered frames, but I wanted to share it and see what people can make with it.

The simple shader examples run surprisingly fast (depending on what you're drawing to the screen), but the full stereoscopic example is quite slow (1 frame per 30 seconds on a decent graphics card). It's not intended as a realtime solution, but a renderer for frames of a video.

At this point, there's no plans to make a full library with it, it's kind of an "as is" sketch, but it does the job, and the results are pretty reasonable.

Hope you enjoy it!

th75

Very impressive! Thanks for sharing