We closed this forum 18 June 2010. It has served us well since 2005 as the ALPHA forum did before it from 2002 to 2005. New discussions are ongoing at the new URL http://forum.processing.org. You'll need to sign up and get a new user account. We're sorry about that inconvenience, but we think it's better in the long run. The content on this forum will remain online.
IndexProgramming Questions & HelpSound,  Music Libraries › ESS FFT audio visualisation
Page Index Toggle Pages: 1
ESS FFT audio visualisation (Read 862 times)
ESS FFT audio visualisation
Nov 3rd, 2008, 7:49pm
 
Hi,

I'm new to processing and wish to create an audio visualisation. After trawling through all the great posts on the forum, i'm still struggling to understand how to create visuals based on an mp3.

I understand the ESS library seems most suited to this purpose, particularly for avoiding lag. I also understand that FFT data is read, from which visuals can be created, and this is based on frequency. However, for example, using dave bollingers HalfOctaveVUDemo (http://www.davebollinger.com/works/p5/fftoctana/) how can I assign visuals other than graphs/waves to different frequencies and bins they fall into?

There seems to be a lack of information for beginners, but obviously im missing something as there are many great audio visualisations being produced!

Any help greatly appreciated.
Re: ESS FFT audio visualisation
Reply #1 - Nov 3rd, 2008, 11:03pm
 
There probably aren't a lot of specific examples because there is soo much variety in what you might want to draw in response to your audio.  It's entirely up to you.  So, the question is:  what do YOU want to draw, and what aspects of it do YOU want to control with the audio?

For example, let's say you determine that FFT bin #10 (for example, number picked at random) is representative of a kick drum that occurs regularly.  So, what do you want to do about it?  How about every time that value exceeds some threshold you draw a red square.  Now you have a red square kick drum visualizer.  Get it?  Or any of a million other things, for ex...  Use an fft value directly to scale an object (so it gets "larger" when the fft of that frequency is "louder").  Or use the fft value as rotation, or to change color, or to accellerate it in some direction, etc...  Or use *changes* in fft values, between frames, rather than the values themselves, to control stuff.  (say, the delta of bin 10 controls an X coordinate, delta bin 20 controls a Y coordinate, delta bin 30 controls a Z coordinate -- now you're "driving around" in 3D)  Or find something that can be controlled by the peak values of the fft bins, etc.  Use your imagination, plenty of other possibilities...

$.02:  Minim is probably the most versatile library currently, and has perhaps the best fft implementation.  ESS still has some specific usefulness when rendering offline to help fill a functionality gap in Minim.  The Sonia plugin still remains useful in live situations as you might (potentially) get some hardware performance advantage that the pure-Java libs (potentially) miss out on.  Others will likely have differing opinions.  ;)

hth
Page Index Toggle Pages: 1