Howdy, Stranger!
We are about to switch to a new forum software. Until then we have removed the registration on this forum.
Categories
- All Categories 25.7K
- Announcements & Guidelines 13
- Common Questions 30
- Using Processing 22.1K
- Programming Questions 12.2K
- Questions about Code 6.4K
- How To... 4.2K
- Hello Processing 72
- GLSL / Shaders 292
- Library Questions 4K
- Hardware, Integration & Other Languages 2.7K
- Kinect 668
- Arduino 1K
- Raspberry PI 188
- Questions about Modes 2K
- Android Mode 1.3K
- JavaScript Mode 413
- Python Mode 205
- Questions about Tools 100
- Espanol 5
- Developing Processing 548
- Create & Announce Libraries 211
- Create & Announce Modes 19
- Create & Announce Tools 29
- Summer of Code 2018 93
- Rails Girls Summer of Code 2017 3
- Summer of Code 2017 49
- Summer of Code 2016 4
- Summer of Code 2015 40
- Summer of Code 2014 22
- p5.js 1.6K
- p5.js Programming Questions 947
- p5.js Library Questions 315
- p5.js Development Questions 31
- General 1.4K
- Events & Opportunities 288
- General Discussion 365
In this Discussion
- hamoid February 2014
Answers
Yes it can. You can use the Minim library to load a sound file and get the volume or the frequencies using FFT as it plays. At the same time you can use the Video library to load and play video. You can access the pixels of each video frame and manipulate them as you wish, using the values you obtained from the sound. This would be all live.
If you don't want live effects, but you want to convert a video file into a new video file, affected by sound properties of a sound file, it can also be done, but it might be more work. First I would analyze the sound file and save the data as a text file, I would use ffmpeg to split the video file into single frames (a ton of images on disk), then write a program that reads the data from the text files and modifies the frames one by one. Finally I would put together all the modified frames as a video file using ffmpeg again.