I want to hear continues sound as long as I paint.

General Discussion Other

papaki123

I want to hear continues sound as long as I paint.

in General Discussion • Other • 1 year ago

I am working on a project that must convert real time drawings to music.

I started with some drawing tools, like paintbrush, spray and so on. Now I am thinking to map colors (I convert them to grayscale) to musical notes, the speed of the mouse to volume, the thickness of the paintbrush to amplitude.

The user will also be able to choose an instrument, piano, guitar, violin and others.

I decided to work with minim 2.1.0 beta. I made a toneInstrument (like the examples in minim) and I call it, when drawing.

The problem is that I hear the same note pressed again and again and it doesn' t sound good. I want to hear continues sound as long as I paint.

How can I do this?

Any ideas, please?

Thank you for your time.

Replies(17)

djdune

Re: I want to hear continues sound as long as I paint.

1 year ago

I don't think toneInstrument is the object you want to use, because you have to tell it how long the note is when you create it. Can anyone else recommend an approach that would work in real time?

Disclaimer: Haven't worked with minim. I do know the music language SuperCollider, though, and recommend you to look at it some day if you find yourself wanting to work with music a lot. It's a significant time investment to learn though.

o0diego0o

Re: I want to hear continues sound as long as I paint.

1 year ago

i believe you should try something related to the use of MIDI...

theres a program called PD that uses midi protocol of windows, mac or linux and it can communicate with processing. i recall using it once, but im not an expert anymore.

also theres a lib for processing that use midi. i dont know if you can control that much like you want, but probabily yes.
its names is midibus.

PD stands for Pure Data.

sonic555gr

Re: I want to hear continues sound as long as I paint.

1 year ago

Καλησπέρα

Hello,
There is a problem solver in your case but requires you to know at least one music creation program.

oscP5 library for processing along with max msp for instance, will give you the desired result... oscP5 is a protocol for transmiting data between programs. You post the values that come from painting, max msp recieves them and translates them into sound, it is fast and pretty clean.

you can find oscP5 here

pixelfren..

Re: I want to hear continues sound as long as I paint.

1 year ago

OSC is a good solution, but Max/MSP costs money and is rather complex.

You could try Pd (free), but I would also recommend Chuck (also free) which has some nice analogue modelled instruments in it. It's command-line, but you can run it as a server, so it will sit there listening for the OSC messages you send it from Processing.

I've done this a couple of years back and it worked very nicely, with good sound. I think I also used the oscP5 library.

If you already have music production software then you may be able to receive OSC with that, so you can use whatever instruments you have. Ableton Live will do it, for instance.

epicjeffe..

Re: Re: I want to hear continues sound as long as I paint.

1 year ago

Ableton Live does not receive OSC messages as far as I can remember. You can also get the pd library for processing, as berengerr said but getting into pd has a pretty steep learning curve. Check out the beads library, it seems to be much better than minim and friendlier than learning a new language. http://www.beadsproject.net/

www.epicjefferson.com www.avmachinists.org

gesamtkun..

Re: I want to hear continues sound as long as I paint.

1 year ago

Why not create sounds files following something like ADSR envelopes ? You can do this with a simple wave editor, from a good sample create :

attack.wav
loop.wav
end.wav

And then load them all and trigger them manually with minim when the user presses, drags or releases the mouse.

You'll have to split your code between instruments like piano or guitar at one side and violin or trumpet at the other side because ones are single notes played once ( i.e. just an "attack.wav" that you can simply stop when the user stops drawing) and others are sustained sounds which you'll have to reprocess in order to loop them correctly.

berengerr

Re: I want to hear continues sound as long as I paint.

1 year ago

Hello ,

I'm a pd user learning processing so I thought I could give you some insights. The sound part is totally what pd is made for. Now you can use libpd to embed a pd patch directly into your processing sketch.

http://mgmartwarehouse.blogspot.com/2011/04/compiling-libpd-as-processing-library.html

If you are on linux and osx there are pre compiled libraries that should works straight away, you will just have to be sure that Jack (audio server) is set up on your computer.

Cheers

zuzuneku

Re: I want to hear continues sound as long as I paint.

1 year ago

Ελληνες!!

sonic555gr

Re: Re: I want to hear continues sound as long as I paint.

1 year ago

he he he.... Ναι, είμαστε :P

noncom

Re: I want to hear continues sound as long as I paint.

1 year ago

From your post I see that you are entirely new to sound synthesis. Sound synthesis is a serious science to learn. If you want to be able to work in this area with success, you have to invest time into learning it first. Because I personally do not see any point in writing a music creation program if you can't tell volume from amplitude.

For now I can tell you that there IS a pretty simple and efficient way in realizing what you want with minim library. Once I had a similar task and getting a very robust and flexible solution with it was easy enough. This forum is about programming, so I cannot explain you all the theroy of adjacent areas here, you have to go for it yourself first.

But in your particular case, I think that synthesis is not the only way out, especially if you want to hear sounds of real instruments. You could get away with sampled sounds. And minim would also work too. But please... be a man and first invest some time into understanding what you want.. then we might get a pretty interesting and professionally arranged installation instead of another creation that emits erratic beeping and slurping sounds and is called art...

kritzikra..

Re: I want to hear continues sound as long as I paint.

1 year ago

hey!

a few things:

1. amplitude directly relates to the volume

2. yes, sound synthesis from scratch is very tricky,

if you really want to do it ... here's some code from the synthesis part

i wrote for soundythingie: https://github.com/kritzikratzi/soundythingie/blob/master/src/pointPlayer.cpp#L114

(it's OF, but if should give you an idea how annoying this is to code)

3. there _should_ be something like pitch bending in midi,

i've never used it so far, but i heard it exists :)

good luck!

hansi.

chrismous

Re: I want to hear continues sound as long as I paint.

1 year ago

Πάμε μωρή Ελλαδάρα!!!! (Άσχετο, αλλα στο ΤΗΧΕΙ σπουδάζετε???)

Well, technically speaking did you found the way to design the different sounds hearing like instruments??? This could be your first problem!! So, for this you can use the Java sound library... or SoundCipher from http://explodingart.com/soundcipher/index.html which is a library for Processing

This is an example that draw lines and play music/notes based in the random position of a line http://explodingart.com/soundcipher/tutes/draw_sync/draw_sync_tute.html

The problem is that I hear the same note pressed again and again and it doesn' t sound good. I want to hear continues sound as long as I paint.

Basically, did you mapped the sketch width/height with the toning machine???

               
                map(value, low1, high1, low2, high2)
                where:
                value is the incoming value to be converted
                lows are probably the 0,0 (x,y) of your sketch and 
                high 1 & 2 are probably the width and height...

In your code the sound is playing while you are pressing the mouse button for example or you don't want that?? If you want to play sounds when the mouse button is pressed probably you want as well fade in and fade out in order to have more clear and well designed sounds... So, try to share a bit of your code to helped you.... If you have all the separate components (sounds, drawing, interface etc.) it's about one or two days work....

hamoid

Re: I want to hear continues sound as long as I paint.

1 year ago

I uploaded a minimal example using Processing and SuperCollider.

This example sends the mouse position from Processing to SuperCollider.

Supercollider smoothes out the sudden pitch changes using a function called lag().

The sound is just a sine wave. Synthesizing a violin sound is not easy.

In any case you couldn't make a continuous sound in the case of a piano or a guitar.

If you need really high quality sounds there is commercial software with great quality pianos, violins, guitars, etc.

papaki123

Re: I want to hear continues sound as long as I paint.

1 year ago

First of all thank you all for your time.

I don't know much about handling the sound. I'm reading and trying to understand.

I 'll need some time to try out your suggestions and my spare time is limited. If I manage to make it work, I'll post it.

chrismous

Re: I want to hear continues sound as long as I paint.

1 year ago

OK i am back again... I thought that I soved you some basic problems as well I thought that are in a right direction. My approach is not the best one due to you have to explain a bit deeper your idea and the functionality that you want. Furthermore, as you don't have experience in programming I wrote down some comments... Enjoy!!!

import ddf.minim.*;
import ddf.minim.signals.*;
Minim minim;
AudioOutput out;
SineWave sine;
boolean isMouseDown = false;
void setup(){
size(700, 300, P2D);
smooth();
background(0);
minim = new Minim(this); //Just some lines for minim
out = minim.getLineOut(Minim.STEREO);
sine = new SineWave(440, 0.5, out.sampleRate()); // here the sine is generated it has F (frequency) = 440Hz , 0.5 amplitude and sample rate for line out
sine.portamento(200); //set the portamento speed on the oscillator to 200 milliseconds
out.addSignal(sine);
out.mute();// I mute here the sound in order to play only if mouse is pressed
smooth();
}
void draw(){
if(isMouseDown){
float freq = map(mouseX, 0, width, 1500, 60); // mapping mouseX --> (width value) position with freq varible
sine.setFreq(freq); // the generated sine frequency as calculated in the previous line
out.unmute();//unmute sound!!!! mouse is pressed!!!!!
noStroke();
fill(mouseX,mouseY,255); // parametrize the R and G values of RGB fill by mouse X,Y position
ellipse(mouseX,mouseY,20,20); // the ellipse that draw in the sketch
}else{
out.mute();// mute sound again
}
}
void mousePressed(){
isMouseDown=true; //mouse is pressed
}
void mouseReleased(){
isMouseDown=false; //mouse is not pressed
}
void stop(){ // you don't need to know anything about that... just put it!!!
out.close();
minim.stop();
super.stop();
}

currank

Re: I want to hear continues sound as long as I paint.

1 year ago

Hello,

I have written some Processing code which talks to PureData that does something like what you need, see these projects:

https://github.com/curran/PDJava

In particular, the XYFreqMod program generates tones which are determined by the mouse X and Y position, only when the mouse is down:

https://github.com/curran/PDJava/blob/master/src/XYFreqMod.java

https://github.com/curran/PDJava/blob/master/pd/xyfreqmod.pd

The code is in Java, wrapping the Processing API, but the code should also work in Processing itself with minimal changes.

Best,

Curran

spiroz

Re: I want to hear continues sound as long as I paint.

10 months ago

I thing using libpd (puredataP5) is the best solution. But you also need to learn Pure Data, whitch is easy (its the free - version of Max/MSP). Maybe also SuperCollider but i haven't use it yet. I 've tried minim and beads. Both of them crash sound after a while for some reason (μεγάλες μαλακίες).

The bad thing is that the connection between processing and pure data has no documentation (only the class java API of the library ceperated in two parts, with the downloaded libpd.zip), and only two examples. Also it implements an old version of pd and many of the abstractions and etra libraries don 't work, but there is always an alternative.

The good thing is that you can figured it out yourself, because eventually there are about 5 to 10 methods that you can use to achieve controling sound, that are quite enough to make sound for pd. Also pd community (forums) is quite big and well organised and maybe find ready made parts or the whole "code / patch" of what you want.

Top Reply