Processing Forum

MInim AudioSample to AudioPlayer to allow looping

[1 Reply]
- 10-Jun-2013 04:41 PM
- Forum: Core Library Questions
I have been trying to determine how to create audio from pixels. There are many near-answers for questions, but very little useful code.

This is an example using the CreateSample method in Minim. It is derived from examples on the Minim site. It fails after a certain number of plays, probably due to the same problems discussed on this page: http://code.compartmental.net/tools/minim/manual-audiosample/ The solution was to make a FilePLayer player... but it doesn't work for samples.
2. /// this is intended to mimic finding pixels on an image and sending them to an audio output for other uses
4. import ddf.minim.*;
5. import ddf.minim.signals.*;
6. // we must import this package to create an AudioFormat object
7. import javax.sound.sampled.*;
9. Minim minim;
10. AudioSample wave;
11. // we'll use a sine wave signal to generate a buffer of floats
12. // that will be used to create an AudioSample.
13. SineWave sine;
15. // when we create a sample we need to provide an AudioFormat so
16. // the sound will be played back correctly.
17. AudioFormat format = new AudioFormat( 44100, // sample rate
18. 16, // sample size in bits
19. 1, // channels
20. true, // signed
21. true // bigEndian
22. );
24. // we'll make a MONO sample, but there is also a version
25. // of createSample that you can pass two float arrays to:
26. // which will be used for the left and right channels
27. // of a stereo sample.
28. float[] samples = new float[1024*8];
31. void setup()
32. {
33. size(512, 200, P3D);
34. // always start Minim before you do anything with it
35. minim = new Minim(this);
37. // make a sine wave!
38. sine = new SineWave( 220, // frequency in Hz
39. 0.5, // amplitude
40. 44100 // sample rate
41. );
44. /// array should mimic a line of pixels being read by whatever algorithm I use.
45. for (int i=0;i<(1024*8);i++){
46. samples[i]=random(-200,200);
47. }
49. // finally, create the AudioSample
50. wave = minim.createSample( samples, // the samples
51. format, // the format
52. 1024 // the output buffer size
53. );
54. frameRate(10);
55. minim.debugOn();
57. }
59. void draw()
60. {
61. background(0);
63. /// array should mimic a line of pixels being read by whatever algorithm I use.
64. for (int i=0;i<(1024*8);i++){
65. samples[i]=random(-2,2);
66. }
67. // create the AudioSample
68. wave = minim.createSample( samples, // the samples
69. format, // the format
70. 1024 // the output buffer size
71. );
72. wave.trigger();
75. stroke(255);
76. // use the mix buffer to draw the waveforms.
77. for (int i = 0; i < wave.bufferSize() - 1; i++)
78. {
79. line(i, 100 - wave.left.get(i)*50, i+1, 100 - wave.left.get(i+1)*50);
80. }
81. }
84. void stop()
85. {
86. // always close Minim audio classes when you are done with them
87. wave.close();
88. minim.stop();
89. super.stop();
90. }
I know there may be better ways to do this, but the idea of creating an audio buffer from an array that is constantly changing as it is read from pixels would be incredibly useful (I've spent weeks trying to find a solution for doing this with pure data and chuck, but this solution would be incredibly useful) This particular version has a tendency to go silent, and I think it is a buffer issue since there is no real way of clearing an audio sample.

Could someone help me with this, please?

I've checked the following ideas but with no luck (don't understand the code, or solutions never posted)

http://code.google.com/p/processing/source/browse/trunk/processing/java/libraries/minim/examples/frequencyModulation/frequencyModulation.pde?r=10251 (the fm.offset, fm.amplitude and fm.frequency don't seem to work)

https://github.com/ddf/Minim/blob/master/examples/Synthesis/frequencyModulation/frequencyModulation.pde (same problems, different name endings)

http://processing.org/discourse/beta/num_1200904097.html ... It might work, but it isn't commented very well, and I have no idea how the class MuzikMaker works... (it's also from 2008, so I don't know if it was ever resolved, or if other, better solutions exist. )

Thank you, if you can help me figure this out.

PS: I tried to incorporate an 'isPlaying' check, but those don't exist for AudioSamples...

Send data stream over OSC

[0 Replies]
- 28-May-2013 09:20 AM
- Forum: Contributed Library Questions
I have some information I would like to send over OSC. It probably will never be over the width of the screen, and I can limit it's size.

It would be about 2048 or so bytes.

This is an attempt to send pixel information derived from a multitouch processing sketch to a program like PureData or ChucK, where it will (hopefully) be rendered into sound.

I know OSC has a format for sending blobs ( http://opensoundcontrol.org/book/export.html/1 ) but I have not found any examples for how to do so in Processing. I know several people have recommended NOT using this particular format as a relatively constant stream, but I may be limited in how to accomplish this for my project.

The project is to render pixels as audio. I'm hoping to use ChucK as it may provide the mechanisms for making more harmonic sounds than straight pixels to audio.

What is the best way for generating audio from raw data?

[0 Replies]
- 21-May-2013 10:38 AM
- Forum: General Discussion
- Sub forum: Other
I have a project I shall be working on which will be using raw data (think pixels from an image) that will be modified slightly (to fit the 44khz audio frequency) and used to generate audio.

I am having difficulty in doing this, however. Many of the various libraries or alternative programs (minim, supercolider, chuck & pd) work on a 'create digital notes' basis after analyzing the data, but I would like to format this information as if it were a live microphone signal.

Is there a particular term I should search for? A "virtual microphone" library or another suggestion for how to do this? I keep finding 'almost' solutions but nothing really works well.

thanks for your suggestions,

Gerry.

cannot access curve applet

[1 Reply]
- 24-Oct-2012 10:38 AM
- Forum: General Discussion
- Sub forum: Other
I am not sure where to post this, but I was accessing this page: http://processing.org/learning/curves/code/try_curve/index.html

from this page: http://processing.org/learning/curves/

Halfway down the page it says:

The only way to understand this better is to play with it. Here is an applet that lets you do just that.

and the link doesn't work.

The specific problem is that it says 403 forbidden, I don't have permission to access it.

cannot store video feed to image array

[6 Replies]
- 09-Oct-2012 10:14 PM
- Forum: Core Library Questions
This is inspired by openframeworks code shared by James George.

I am basically trying to save frames from a video feed into an image array, and then choose how that image array will be shown.

I can get it to work, almost, but it seems that the images which I am saving are all turning out the same. I can do the same thing with opencv, but it hiccups and does not work very well.

Here is the gist of the code:
2. import processing.video.*;
3. Capture video;
5. int frameNumber = 0; //start at frame 1
6. int fBM = 60; //fBM = frameBufferMaximum
7. PImage img;
8. PImage[] frameBuffer = new PImage[fBM+1]; //store 60 frames
10. void setup() {
11. size(800, 480, P2D);
13. // Uses the default video input, see the reference if this causes an error
14. video = new Capture(this, 640, 480);
15. video.start();
17. background(0);
18. img = createImage(video.width,video.height,RGB);
20. //prepare the image array
21. for (int i=0;i<fBM;i++){
22. frameBuffer[frameNumber]=createImage(video.width,video.height,RGB);
23. }
24. }
27. void draw() {
28. if (video.available()) {
29. video.read();
30. video.loadPixels();
32. //copy the video frame
33. img.copy(video,0,0,video.width,video.height,0,0,video.width,video.height);
35. //store the video frame
36. frameBuffer[frameNumber]=img;
38. frameBuffer[frameNumber].updatePixels();
40. frameNumber ++;
42. if (frameNumber > fBM) {
43. for (int i=0;i<fBM-1;i++){
44. //push frames down the array
45. frameBuffer[i]=frameBuffer[i+1];
46. frameNumber = fBM;
47. }
48. }
50. }
51. //draw the images on screen
52. for (int i=frameNumber;i>0-1;i--){
53. if((frameBuffer[i] != null)){
54. image(frameBuffer[i],width-2*i,0,100,height);
55. }
56. }
57. }
This should be fairly straight forward, but it seems all of the images are the same, current frame of video being shown. It should be generating a relative video delay with this process, but it doesn't work that way.

I've searched several forums, but cannot figure out how to get a video frame to be copied as an image for later use. It's very perplexing. Any help would be appreciated.

how can I use multiple HTTP clients in a processing sketch?

[9 Replies]
- 21-Sep-2012 10:04 AM
- Forum: Contributed Library Questions
I have a sketch which uses the http library found here ( http://francisli.github.com/processing-http/ ) to get instagram information on popular instagram photographs. I would also like to be able to get specific information on the uploader of the photograph through another http request.

I can only find examples of single requests and am not sure how I could go about getting more specific information through another http request.

The code is here: https://github.com/nosarious/instagram_Array

but I am including it here as well. Any help would be appreciated.
1. import com.francisli.processing.http.*;
3. String clientID = " "; //put your clientID here Get it from instagram site: http://instagram.com/developer/
5. int totalCheck = 9;
6. int currentItem = 0;
8. PImage[] userphoto = new PImage[totalCheck];
9. PImage[] profilepicture = new PImage[totalCheck];
10. String[] username = new String[totalCheck];
11. String[] userID = new String[totalCheck];
12. String tag[] = new String[totalCheck];
13. String[] tagStrings = new String[totalCheck];
14. String[] search = new String[totalCheck];
15. int[] comments = new int[totalCheck];
16. int[] likes = new int[totalCheck];
20. float likedCount[];
23. HttpClient client;
24. HttpClient Personal;
26. void setup() {
28. size(800, 800, P2D);
29. smooth();
30. // create new client
31. client = new HttpClient(this, "api.instagram.com");
33. // use https
34. client.useSSL = true;
36. // search for the artist Radiohead
37. String mediaLookup = "popular";
39. // instantiate a new HashMap
40. HashMap params = new HashMap();
42. // pass parameters as key-value pairs
43. params.put("client_id", clientID);
45. for (int i=0;i<totalCheck-1;i++){
46. // make the request
47. client.GET("v1/media/popular?client_id="+clientID);
48. }
50. }
53. void draw() {
54. if (currentItem==totalCheck-1){
56. imageMode(CENTER);
57. for (int i=0;i<totalCheck;i++){
59. imageMode(CENTER);
61. if (profilepicture[i] != null) {
62. image(profilepicture[i], 82, 90, 90, 90);
63. }
65. if (userphoto[i] != null) {
66. image(userphoto[i], 100*i-50, height/2-30, 100, 100);
67. }
69. delay(100); // small delay
70. }
71. }
72. }
74. void responseReceived(HttpRequest request, HttpResponse response) {
76. //// we get the server response as a JSON object
77. JSONObject content = response.getContentAsJSONObject();
80. // println(content);
82. //// get the "data" value, which is an array
83. if (content.get("data") != null) {
85. currentItem ++;
87. JSONObject data = content.get("data");
89. //// get the first element in the array
90. JSONObject first = data.get(0);
92. //// the "user" value is another dictionary, from which we can get the "full_name" string value
93. if (first.get("user").get("id").stringValue() != null) {
94. println(first.get("user").get("id").stringValue());
95. }
97. if (first.get("user").get("full_name").stringValue() != null) {
98. println(first.get("user").get("full_name").stringValue());
99. }
100. //// get profile picture
101. if (first.get("user").get("profile_picture").stringValue() != null) {
102. println(first.get("user").get("profile_picture").stringValue());
103. }
104. //// the "images" value is another dictionary, from which we can get different image URL data
105. if (first.get("images").get("standard_resolution").get("url").stringValue() != null) {
106. println(first.get("images").get("standard_resolution").get("url").stringValue());
107. }
108. if (first.get("likes").get("count").intValue() != 0) {
109. println("Likes: "+first.get("likes").get("count").intValue());
110. likes[currentItem] = first.get("likes").get("count").intValue();
111. }
113. if (first.get("comments").get("count").intValue() != 0) {
114. println("Comments: "+first.get("comments").get("count").intValue());
115. comments[currentItem] = first.get("comments").get("count").intValue();
116. }
117. if (first.get("user").get("id").stringValue() != null) {
118. userID[currentItem] = first.get("user").get("id").stringValue();
119. }
120. if (first.get("user").get("full_name").stringValue() != null) {
121. username[currentItem] = first.get("user").get("full_name").stringValue();
122. }
123. if (first.get("user").get("profile_picture").stringValue() != null) {
124. String profilepicture_url = first.get("user").get("profile_picture").stringValue();
125. profilepicture[currentItem] = loadImage(profilepicture_url, "png");
126. }
127. if (first.get("user").get("profile_picture").stringValue() != null) {
128. String userphoto_url = first.get("images").get("standard_resolution").get("url").stringValue();
129. userphoto[currentItem] = loadImage(userphoto_url, "png");
130. image(userphoto[currentItem],100,100);
131. }
132. println(currentItem);
133. }
135. }

Response title

Attachments

New to this Portal?

Activity Trend