21–30 of 48 posts
http://www.warmplace.ru/soft/pixivisor/
The last two videos on the page are particularly impressive, which demonstrate video mixing using two channels of an audio mixer, and video blurring from multi-path audio reflections.
The author of the modular synth "SunVox" made a live tool called "PixiVisor" that does something similar. http://www.warmplace.ru/soft/pixivisor/ The last two videos on the page are particularly impressive, which demonstrate video mixing using two channels of an audio mixer, and video blurring from multi-path audio reflections.
Being able to do interface with external off the shelf audio gear with an otherwise software only solution would be the goal of all this.
Is that something like metasynth ( http://www.metasynth.com ) ? You import a picture and use it through FFT to generate sound ?
Nope! Less fancy than that. I just take the bitstream and 'choose' to interpret it as audio.
For it to work somewhat well, a raw video format like YUV444P is used.
Hi HN, I just finished adding video support (and stubbed out audio support). Due to already using ffmpeg for image manipulations, this turned out to be rather easy. Give it a try using something like this: $ ./mangle.sh in.mp4 out.mp4 --color-format=yuv444p --bits=8 --blend=0.4 overdrive 17 hilbert -n 5001
For folks wanting to play around with this on OSX:
brew install ffmpeg lame brew install sox --with-lame
The --with-lame is important if you want to process mp4s.
Might want to consider putting some kind of progress indicator (simple polling on tmp_audio_in.u8 vs tmp_audio_out.u8). I ended up looking at the output directory with
watch -n .5 ls -la /tmp/audio_shop-DIRECTORY
I think the cleanup isn't working quite right, getting a rm unlink failure.
Seriously, this is a neat hack.
Neat. I assume it would be possible to do the same thing in reverse then? As in, use image editing effects on audio clips?
That might be the a better way of doing things actually, since visual tools are 2-dimensional by nature.
Hi HN, I just finished adding video support (and stubbed out audio support). Due to already using ffmpeg for image manipulations, this turned out to be rather easy. Give it a try using something like this: $ ./mangle.sh in.mp4 out.mp4 --color-format=yuv444p --bits=8 --blend=0.4 overdrive 17 hilbert -n 5001
This is fantastic. For folks wanting to play around with this on OSX: brew install ffmpeg lame brew install sox --with-lame The --with-lame is important if you want to process mp4s. Might want to consider putting some kind of progress indicator (simple polling on tmp_audio_in.u8 vs tmp_audio_out.u8). I ended up looking at the output directory with watch -n .5 ls -la /tmp/audio_shop-DIRECTORY I think the cleanup isn't…
I'll keep hacking at it this stuff for at least a little bit.
The author of the modular synth "SunVox" made a live tool called "PixiVisor" that does something similar. http://www.warmplace.ru/soft/pixivisor/ The last two videos on the page are particularly impressive, which demonstrate video mixing using two channels of an audio mixer, and video blurring from multi-path audio reflections.
Earlier quoted context omitted.
I am curious. I do not know much about image encoding and the such. What other types are there besides linear either row by row or column by column? It seems to me that those two are the only logical ways to map pixels.
Any permutation could be used, but I suppose you'd want to use ones that form some sort of visually recognisable pattern. For example, a spiral emerging from the centre of the image, or all the even numbered pixels from a linear scan followed by all those indexed by an odd number.
Would this be middle-out compression?
I'd like to store music files in my phone's camera roll, and easily upload them to a website where some Javascript could decode and play them.