I am using Kinect with Windows library (https://github.com/ThomasLengeling/KinectPV2) in processing and detecting all the skeleton joints and positions. What I want to do is to combine sounds and music according to movements of the skeleton joints. (e.g. control pitch or volume of a sound according to the x-position of the left hand). Something like this (). As I don't have any experience with music software I would like to ask you which method you recommend in order to implement this. A possible approached that I've found to combine with processing is by using Max7 (). But I am not sure if Max is the most suitable approach as I am aware that there are many other software (Ableton, virtual midi controllers). In respect to Max7, I am thinking that I could do that by controlling a slider using the skeleton joint position(e.g as the hand moves right the slider value will increase but I don't know how I could do that - assign the position values from processing to a Max's slider). Any guidelines would be appreciated!

Michael

void mousePressed() {
  println(mouseX,mouseY);
  int ret = output.sendNoteOn(0, 3, 3);
  println("returned from send note", ret);
  ret = output.sendSysex(new byte[] {(byte)0xF0, 1, 2, 3, 4, (byte)0xF7});
  println("returned from sysEx ", ret);
}

Anyone know what I am doing wrong?

Finally cracked my new project of triggering midi in Ableton via webcam movement but the midi signal is very glitchy and intermittent, despite my console telling me is it sending out signals. I feel it might be an issue with buffer size as when I'm sending a small amount of data, it works okay. Anything bigger and it glitches.

If you need a screen recording of what is happening, let me know. Otherwise I've posted the code underneath. Thanks!

import gab.opencv.*;
import processing.video.*;
import ipcapture.*;
import org.opencv.core.Rect;
import themidibus.*; //Import the library

OpenCV opencv;
IPCapture cam;
MidiBus midi; 


void setup() {
  size(640, 480);
  //video = new Movie(this, "street.mov"); MUTED
  cam = new IPCapture(this, "http://" + "100.38.83.153:8081/mjpg/video.mjpg?resolution=640x480", "", "");
  cam.start();
  opencv = new OpenCV(this, 640, 480);

  opencv.startBackgroundSubtraction(5, 3, 0.5);
  MidiBus.list();
  midi = new MidiBus(this, -1, "IAC Bus 1");

  //video.loop();
  //video.play();
}

void draw() {
  if (cam.isAvailable()) {
    cam.read();
    image(cam, 0, 0);  
    opencv.loadImage(cam);
    opencv.updateBackground();

    opencv.dilate();
    opencv.erode();

    noFill();
    stroke(255, 0, 0);
    strokeWeight(5);
    for (Contour contour : opencv.findContours()) {


      println(contour.getBoundingBox().x);
      println(contour.getBoundingBox().y);
      int x = contour.getBoundingBox().x;
      int y = contour.getBoundingBox().y;

      contour.draw();

      if ((x < 700) && (x > 650)) 
        println("x1");
      midi.sendNoteOn(0, 60, 127);
      midi.sendNoteOff(0, 60, 127);

      if ((x < 649) && (x > 600)) 
        println("x2");
      midi.sendNoteOn(0, 61, 127);
      midi.sendNoteOff(0, 61, 127);


      if ((x < 599) && (x > 550)) 
        println("x3");
      midi.sendNoteOn(0, 62, 127);
      midi.sendNoteOff(0, 62, 127);

      if ((x < 549) && (x > 500)) 
        println("x4");
      midi.sendNoteOn(0, 63, 127);
      midi.sendNoteOff(0, 63, 127);


      if ((x < 499) && (x > 450)) 
        println("x5");
      midi.sendNoteOn(0, 64, 127);
      midi.sendNoteOff(0, 64, 127);

      if ((x < 449) && (x > 400)) 
        println("x6");
      midi.sendNoteOn(0, 65, 127);
      midi.sendNoteOff(0, 65, 127);

      if ((x < 399) && (x > 350)) 
        println("x7");
      midi.sendNoteOn(0, 66, 127);
      midi.sendNoteOff(0, 66, 127);


      if ((x < 349) && (x > 300)) 
        println("x8");
      midi.sendNoteOn(0, 67, 127);
      midi.sendNoteOff(0, 67, 127);

      if ((x < 299) && (x > 250)) 
        println("x9");
      midi.sendNoteOn(0, 68, 127);
      midi.sendNoteOff(0, 68, 127);

      if ((x < 249) && (x > 200)) 
        println("x10");
      midi.sendNoteOn(0, 69, 127);
      midi.sendNoteOff(0, 69, 127);


      if ((x < 199) && (x > 150)) 
        println("x11");
      midi.sendNoteOn(0, 69, 127);
      midi.sendNoteOff(0, 69, 127);

      if ((x < 149) && (x > 100)) 
        println("x12");
      midi.sendNoteOn(0, 69, 127);
      midi.sendNoteOff(0, 69, 127);

      if ((x < 99) && (x > 50)) 
        println("X13");
      midi.sendNoteOn(0, 69, 127);
      midi.sendNoteOff(0, 69, 127);

      if ((x < 49) && (x > 1)) 
        println("x14");
      midi.sendNoteOn(0, 69, 127);
      midi.sendNoteOff(0, 69, 127);


      if ((y < 700) && (y > 650)) 
        println("y1");
      midi.sendNoteOn(1, 60, 127);
      midi.sendNoteOff(1, 60, 127);

      if ((y < 649) && (y > 600)) 
        println("x2");
      midi.sendNoteOn(1, 61, 127);
      midi.sendNoteOff(1, 61, 127);


      if ((y < 599) && (y > 550)) 
        println("y");
      midi.sendNoteOn(1, 62, 127);
      midi.sendNoteOff(1, 62, 127);

      if ((y < 549) && (y > 500)) 
        println("x4");
      midi.sendNoteOn(1, 63, 127);
      midi.sendNoteOff(1, 63, 127);


      if ((y < 499) && (y > 450)) 
        println("y5");
      midi.sendNoteOn(1, 64, 127);
      midi.sendNoteOff(1, 64, 127);

      if ((y < 449) && (y > 400)) 
        println("y6");
      midi.sendNoteOn(1, 65, 127);
      midi.sendNoteOff(1, 65, 127);

      if ((y < 399) && (y > 350)) 
        println("y7");
      midi.sendNoteOn(1, 66, 127);
      midi.sendNoteOff(1, 66, 127);


      if ((y < 349) && (y > 300))
        println("y8");
      midi.sendNoteOn(1, 67, 127);
      midi.sendNoteOff(1, 67, 127);

      if ((y < 299) && (y > 250)) 
        println("y9");
      midi.sendNoteOn(1, 68, 127);
      midi.sendNoteOff(1, 68, 127);

      if ((y < 249) && (y > 200)) 
        println("y10");
      midi.sendNoteOn(1, 69, 127);
      midi.sendNoteOff(1, 69, 127);


      if ((y < 199) && (y > 150)) 
        println("y11");
      midi.sendNoteOn(1, 69, 127);
      midi.sendNoteOff(1, 69, 127);

      if ((y < 149) && (y > 100)) 
        println("y12");
      midi.sendNoteOn(1, 69, 127);
      midi.sendNoteOff(1, 69, 127);

      if ((y < 99) && (y > 50)) 
        println("y13");
      midi.sendNoteOn(1, 69, 127);
      midi.sendNoteOff(1, 69, 127);

      if ((y < 49) && (y > 1)) 
        println("y14");
      midi.sendNoteOn(1, 69, 127);
      midi.sendNoteOff(1, 69, 127);
    }



    // void movieEvent(Movie m) {
    //  m.read();
  }
}

EDIT. Sorry, being stupid and can't get the code quoted properly! Edit 2, Got it ;)

void MIDI_TX(unsigned char MESSAGE, unsigned char PITCH, unsigned char VELOCITY)

I've looked up all similar TRIPLE_DOT errors online but cannot seem to figure out what exactly might be going wrong with the code. Any advice would be much appreciated!

// BY: MARK DEMERS | May 2009
// DESCRIPTION: Demo sketch to play notes from middle C in the 4th octave up to B in the 5th octave and then back down.
// HOOK-UP:
// 1. Plug USB cable from Arduino into your computer.
// USAGE:
// 1. Install and Set-up Serial MIDI Converter from SpikenzieLabs
// 2. Open, compile, and upload this sketch into your Arduino.
// 3. Run Serial MIDI Converter in the background.
// 4. Launch your music software such as Garage Band or Ableton Live, choose a software instrument and listen to the music.

int note = 0;     

void setup() 
{
  Serial.begin(57600);                                       // Default speed of the Serial to MIDI Converter serial port
}

void loop() 
{

  for(int note=60; note<=83; note++)                        // Going Up
  {
    MIDI_TX(144,note,127);                                  // NOTE ON
    delay(100);

    MIDI_TX(128,note,127);                                  // NOTE OFF
    delay(100);
  }

  for(int note=82; note>=61; note--)                       // Coming Down
  {
    MIDI_TX(144,note,127);                                  // NOTE ON
    delay(250);

    MIDI_TX(128,note,127);                                  // NOTE OFF
    delay(250);
  }

}


void MIDI_TX(unsigned char MESSAGE, unsigned char PITCH, unsigned char VELOCITY) 
{
  Serial.print(MESSAGE);
  Serial.print(PITCH);
  Serial.print(VELOCITY);
}

I want to be able to connect my midi Keyboard up to the computer and then output the audio to light up LEDs. I am wondering if anybody has done this or how to go about it? Ideally I would love to be able to manipulate the code so that whichever keys i am playing i can control the output effects (colour, fade, etc).

I know I will need to use an arduino as well but I am just not sure how to do all this. Any help would be greatly appreciated.

Thanks

I have a few months of experience with Processing, but I guess that this is an algorithm related question.

So, I have a processing project that plays sounds when the user press some PAD on MIDI or even KEYBOARD and I want to try to play a beap continuously according to BPM.

What I have tried:

import processing.sound.*; SoundFile beap; int bpm = 95; int secs = 1; void setup() { frameRate(60); fullScreen(); beap = new SoundFile(this, "sounds/bip.mp3"); } void draw(){ secs++; beap.play(); }

But, this of course plays beap continuously. Anybody can help me?

NOTE: changing frameRate(); does not help because it'll mess with rendering graphics.

Thanks

when the .mid file plays C1 note, draw the function sample1.

when the .mid file plays C2 note, draw the function sample2.

Is it possible?

The whole thing works cool, but:

-somehow other circles start to appear for some reason that I don't want.

-it would be nice to avoid the delay as like this some notes are missed, but without it nothing appears.

-can't export pdf because of unknown exception. (image works) (???)

here is the code and image

thanks for your help!

import themidibus.*;
import processing.pdf.*;

boolean record=false;

MidiBus myBus; // The MidiBus

void setup() {
  size(800, 800);
  background(255);

  MidiBus.list();
  myBus = new MidiBus(this, 1, 0);

}
float x;
float y;
float t;
float time;

void draw() {
  if (record) {
    save("pic.tif");
    record = false;
  }
  t = millis()/10000.0f;
  delay(10);

}
void noteOn(int channel, int pitch, int velocity) {
  // Receive a noteOn
  float velo = map (velocity, 0, 127, 1, 20);
  translate(400, 400);
  rotate(t);
  translate(10,0);
  fill(255,0);
  ellipse(50+(pitch*3), 0, velo, velo);
  println(t);
}

void noteOff(int channel, int pitch, int velocity) {
  // Receive a noteOff
}

void controllerChange(int channel, int number, int value) {
  // Receive a controllerChange
}

void delay(int time) {
  int current = millis();
  while (millis () < current+time) Thread.yield();
}

void keyPressed() {
  if (key == 'q') {
    record=true;
  }
}

(

Cheers Andreas

I've been fooling around minim library to do some sound analysis.

What I want to achieve is performing FFT but do this for certain frequency ranges which are as follows;

20hz - 80hz = ........ Low Bass
80hz - 320hz = ...... Midbass
320hz - 1280hz = ... Midrange
1280hz - 5120hz = .. High Midrange/Low Treble
5120hz - 20840hz = . High Treble

For each range I need to get a magnitude so that I can send them to arduino.

Is this something possible to achieve.

Also I need to use the soundcard output of the computer as input data rather than using the built-in microphone with AudioInput function. However, couldn't find any way to do so. I reckon this is something feasible since I read the following comment lines under getLineIn function;

//it's feasible that the user may have the actual audio output of the computer as the active audio input

I do really appreciate if someone help me to sort those things.

Thank you.

For my project (https://forum.processing.org/two/discussion/comment/60203) I have 4 x 4 objects. I use an array to define the 16 objects, but somehow it seems easier if I could use indexes that refer to the row and colum each object is in.

Someting like this: object11, object12, object13, object14 object21, object22, object23, ...

Is this easy doable? If yes, how?

Thank you ;-)

I am a musician, not a programmer, and I've been developing in Processing a code to test the ear capabilities of my students. The think is that I want microtonal distances (3Hz) so when I designed it with a SineWave it worked perfectly, but I want to improve the sound. Midi has 127 notes separated by a half-step, but not smaller. I want to move all my codes to p5.js., and before starting I wanted to ask, do you think I can get this result?

What I need to do is to turn the knobs on my controller to change a few variables in P5 sketch.

Does anyone know any compatible libraries or how to execute my idea?

I bummed into a interesting article about how to create a generative music composition from 2D Cellular Automata. The following is the link of the mentioned article: cmr.soc.plymouth.ac.uk/publications/CapturingTheAesthetic.pdf

This idea is to perform the mapping from a Game Of Life generation based on a polar co-ordinate system with the origin at the grid center. This approach is illustrated below:

I am trying to implement this idea in processing. The authors provided a brilliant algorithm how this can be achieved:

I was doing quite well until I got stuck in point 3 (the highlighted part). Can anyone suggest how it is possible to iterate from the center of the grid to the boarder for every value of tita? (in order to examine the state of each cell along the line which is by an angle tita from the centre).

This is what I've got so far:

The red line represents the the iterations of tita around the boarder. A new generation is created with each revolution.

Any tips of how step 3 (of the algorithm above) can be implemented will be greatly appreciated! :)

"AudioContext : no AudioIO specified, using default => beads.JavaSoundAudioIO. JavaSoundAudioIO: Chosen mixer is Default Audio Device. "

It might be for something dumb, since I sort of don't know what I'm doing, but I'm fairly lost and am just wonder if anyone knows a way to make a polyphonic synthesizer thats controlled by a MIDI controller, before I invest a lot of time into trying to do this.

// MIDI_SYNTH_01.pde
// this example builds a simple midi synthesizer
// for each incoming midi note, we create a new set of beads 
// (encapsulated by a class)
// these beads are stored in a vector
// and destroyed when we get a corresponding note-off message
// Import the MidiBus library
import themidibus.*;
// import the beads library
import beads.*;
// our parent MidiBus object
MidiBus busA;
AudioContext ac;
Gain MasterGain;
ArrayList synthNotes = null;
void setup()
{
 size(600, 400);
 background(0);
 // the MidiBus constructor takes four arguments
 // 1 - the calling program (this)
 // 2 - the input device
 // 3 - the output device
 // 4 - the bus name
 // in this case, we just use the defaults
 busA = new MidiBus(this, 0, 0, "busA");
 synthNotes = new ArrayList();
 ac = new AudioContext();
 MasterGain = new Gain(ac, 1, 0.5);
 ac.out.addInput(MasterGain);
 ac.start();

 background(0);
 text("This program will not do anything if you do not have a MIDI device", 100, 100);
 text("connected to your computer.", 100, 112);
 text("This program plays sine waves in response to Note-On messages.", 100, 124);
}
void draw()
{
 for( int i = 0; i < synthNotes.size(); i++ )
 {
 SimpleSynth s = (SimpleSynth)synthNotes.get(i);
 // if this bead has been killed
 if( s.g.isDeleted() )
 {
 // destroy the synth (set things to null so that memory 
 // cleanup can occur)
 s.destroy();
 // then remove the parent synth
 synthNotes.remove(s);
 }
 }
}
// respond to MIDI note-on messages
void noteOn(int channel, int pitch, int velocity, String bus_name) {
 background(50);
 stroke(255); fill(255);
 text("Note On:", 100, 100);
 text("Channel:" + channel, 100, 120);
 text("Pitch:" + pitch, 100, 140);
 text("Velocity:" + velocity, 100, 160);
 text("Recieved on Bus:" + bus_name, 100, 180);

 synthNotes.add(new SimpleSynth(pitch));
}
// respond to MIDI note-off messages
void noteOff(int channel, int pitch, int velocity, String bus_name){
 background(0);
 stroke(255); fill(255);
 text("Note Off:", 100, 100);
 text("Channel:" + channel, 100, 120);
 text("Pitch:" + pitch, 100, 140);
 text("Velocity:" + velocity, 100, 160);
 text("Recieved on Bus:" + bus_name, 100, 180);

 for( int i = 0; i < synthNotes.size(); i++ )
 {
 SimpleSynth s = (SimpleSynth)synthNotes.get(i);
 if( s.pitch == pitch )
 {
 s.kill();
 synthNotes.remove(s);
 break;
 }
 }
}




// this is our simple synthesizer object
class SimpleSynth
{
 public WavePlayer wp = null;
 public Envelope e = null;
 public Gain g = null;
 public int pitch = -1;

 // the constructor for our sine wave synthesizer
 SimpleSynth(int midiPitch)
 {
 pitch = midiPitch;
 // set up the new WavePlayer, convert the MidiPitch to a 
 // frequency
 wp = new WavePlayer(ac, 
 440.0 * pow(2, ((float)midiPitch - 
 59.0)/12.0), 
 Buffer.SINE);
 e = new Envelope(ac, 0.0);

g = new Gain(ac, 1, e);
 g.addInput(wp);
 MasterGain.addInput(g);
 e.addSegment(0.5, 300);
 }
 // when this note is killed, ramp the amplitude down to 0 
 // over 300ms
 public void kill()
 {
 e.addSegment(0.0, 300, new KillTrigger(g));
 }
 // destroy the component beads so that they can be cleaned 
 // up by the java virtual machine
 public void destroy()
 {
 wp.kill();
 e.kill();
 g.kill();
 wp = null;
 e = null;
 g = null;
 }
}

On Ubuntu I'm using virmidi to create virtual MIDI ports. When I run my sketch, which used The MidiBus library, it does not detect any of these virtual devices. (Renoise, OTOH, sees these virtual devices just fine.)

I thought this might just be a Java thing but I have other Java code running on the same machine that does find and interact with these virtual devices (and can receive the MIDI messages sent by Renoise over a virtual MIDI device).

In digging though some code I learned that an available virtual MIDI input device can be detected by checking getMaxTransmitters. For real devices this should return a positive value. Available virtual devices return -1.

When the MidiBus code runs all the virtual input devices have getMaxTransmitters == 0. In the other Java code (a JRuby program that uses the same underlying Java system libs as MidiBus) these devices have getMaxTransmitters == -1.

Has anyone else run into this? It may well be some quirk of my setup, so I'm curious to hear from anyone else who has virtual MIDI devices on Ubuntu with the MidiBus library.

I'm trying to use multiple mixer with the Minim library. Basically, I'm using several USB-Sound Cards in order to get multiple Audio Outputs - I have several mp3's played at the same time, and each mp3 is supposed to go to another speaker.

That's what I have so far (based on the setOutputMixer-Example) and that works fine:

import ddf.minim.*;
import ddf.minim.signals.*;
import controlP5.*;
import javax.sound.sampled.*;
AudioPlayer player;
Minim minim;
Minim minim2;
AudioOutput out;
AudioOutput out2;

Mixer.Info[] mixerInfo;
SineWave sine;
SineWave sine2;

void setup()
{
  size(512, 275);

  minim = new Minim(this);
  minim2 = new Minim(this);

  mixerInfo = AudioSystem.getMixerInfo();

  for(int i = 0; i < mixerInfo.length; i++)
  {println(i + " = " + mixerInfo[i].getName());} 

  sine = new SineWave(220, 0.3, 44100);
  sine2 = new SineWave(20, 1.5, 40100);
 }

void draw()
{
  Mixer mixer = AudioSystem.getMixer(mixerInfo[2]);
  minim.setOutputMixer(mixer);
  out = minim.getLineOut(Minim.STEREO);  
  out.addSignal(sine);

  Mixer mixer2 = AudioSystem.getMixer(mixerInfo[1]);
  minim2.setOutputMixer(mixer2);
  out2 = minim2.getLineOut(Minim.STEREO);  
  out2.addSignal(sine2);
 }

Now the question: Instead of the sine, I want to play mp3's, but I can't manage to add the mp3's to the different mixers (Sorry, I'm kind of a beginner...)

Anyone knows how to do that?

Thanks! Rebecca

I am using TheMidiBus on an installation. Running Processing 2.1.1 on OS X 10.8.5.

Processing does not quit, but TheMidiBus is:

The MidiBus Warning: Disabling noteOn(int channel, int pitch, int velocity) because an unkown exception was thrown and caught
java.lang.reflect.InvocationTargetException
    at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at themidibus.MidiBus.notifyParent(Unknown Source)
    at themidibus.MidiBus$MReceiver.send(Unknown Source)
    at com.sun.media.sound.AbstractMidiDevice$TransmitterList.sendMessage(AbstractMidiDevice.java:679)
    at com.sun.media.sound.MidiInDevice.callbackShortMessage(MidiInDevice.java:172)
    at com.sun.media.sound.MidiInDevice.nGetMessages(Native Method)
    at com.sun.media.sound.MidiInDevice.run(MidiInDevice.java:140)
    at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 2000
    at PASSAGES.noteOn(PASSAGES.java:177)
    ... 10 more

Thank anyone in advance for their insights.

However, I don't want to completely learn how to code using Processing just to do one thing. I have looked around the internet and not found anything relevant. If anyone could send me a link or show me the process of what I need to do, it would be a great help. Any help is appreciated! Thanks ahead of time!

I'm trying to use the MIDIBus library, but already when using the "Basic" example it gives me an error:

The MidiBus Warning: No available input MIDI devices named: "Java Sound Synthesizer" were found

Available MIDI Devices: ----------Input---------- [0] "Real Time Sequencer" ----------Output---------- [0] "Gervill" [1] "Real Time Sequencer"

I would like to use Processing to create some MIDI data and send it via some virtual port to some soft synth. Does somebody has an idea how I could do this?

I'm running Ubuntu 12.04 (64Bit) and Processing 2.1

Thanks

is it possible to send midi cc commands with processing and the promidi library? I can still send midi notes out of it but i want also open a reverb bus in my daw.

We have just release our last interactive project, Stimula, and want to share it with you.

It’s a real time interpretation of information generated by a plant while reacting to human and environmental stimuli. The piece which combines generative, sound and interactive design brings to the light the fact that the plant is a living organism. In this setup, the plant is no longer considered as a simple decoration object.

I hope you will enjoy it.