Live data from Hacker News

TSAC: Low Bitrate Audio Compression

bellard.org

71–80 of 101 posts

Re: TSAC: Low Bitrate Audio Compression

#71
post #51

Bellard strikes again... Are we almost converting music to MIDI at this point? As I understand it the model is learning the landscape of sound combinations that are interesting to humans and as such there will be no combination of raw bytes in the recorded file that will result in white noise (for example) being heard because this is never trained for. What if it was though?

There are plenty of interesting musical pieces using white noise.

Re: TSAC: Low Bitrate Audio Compression

#72
post #20

Earlier quoted context omitted.

That’s incredible, especially the second one that kind of creates a new song. I guess that’s the danger when it’s based on a generative model.

I like how it degrades in such an analog way

Really? it sounds super tinny and digital, more like when Neo is first pulled out of the matrix.

Re: TSAC: Low Bitrate Audio Compression

#73
post #49
post #31

Earlier quoted context omitted.

Innovation goes in steps and iterations ;) When mp3 came out, I could just barely play a song encoded from 44.1kHz/16 bit stereo on my PC, taking almost 100% CPU. Today they can be played on a cheap microcontroller. I like that they share their work, it can lead to something some day.

When MP2 came out, my computer was barely able to play a song in 44.1 kHz 16 bit mono. I think bitrate was 192 kbps, but not sure. (Later on I was so surprised MP4 didn't replace MP3!)

If you thought it was weird that they went to video with MP4, imagine my shock that the next generation they got into firearms.

Re: TSAC: Low Bitrate Audio Compression

#74
post #13

Always love a good bellard ship. This is definitely better than some of the others out there. I threw together some comparisons here at 7kb/s for mp3/opus/aac: https://non.io/TSAC-Comparisons Happy to add other comparisons if others want any. Overall, it's FAR better at these lower bit rates, but that doesn't mean it's necessarily good. One issue I see off the bat is that volume is fairly inconsistent in the output f…

I've encoded xHE-AAC at 6 kbit/s mono, which is the closest match I could get. It performs much better and is widely supported (Android 9/iOS 13/macOS 10.15/Windows 11), although there are no free low bitrate encoders available yet. I used the Fraunhofer IIS Pro with EZ CD Audio Converter. It would be great if you could add it: https://filebin.net/x46m1x7n6d2t7e6b

Re: TSAC: Low Bitrate Audio Compression

#76
post #13

Always love a good bellard ship. This is definitely better than some of the others out there. I threw together some comparisons here at 7kb/s for mp3/opus/aac: https://non.io/TSAC-Comparisons Happy to add other comparisons if others want any. Overall, it's FAR better at these lower bit rates, but that doesn't mean it's necessarily good. One issue I see off the bat is that volume is fairly inconsistent in the output f…

I've encoded xHE-AAC at 6 kbit/s mono, which is the closest match I could get. It performs much better and is widely supported (Android 9/iOS 13/macOS 10.15/Windows 11), although there are no free low bitrate encoders available yet. I used the Fraunhofer IIS Pro with EZ CD Audio Converter. It would be great if you could add it: https://filebin.net/x46m1x7n6d2t7e6b

Yes! This is even at 44.1 kHz, so you might even find that you get perceptually better results by trying a lower sampling rate (32 kHz, 22 kHz, etc.).

Re: TSAC: Low Bitrate Audio Compression

#77
post #73
post #49

Earlier quoted context omitted.

When MP2 came out, my computer was barely able to play a song in 44.1 kHz 16 bit mono. I think bitrate was 192 kbps, but not sure. (Later on I was so surprised MP4 didn't replace MP3!)

If you thought it was weird that they went to video with MP4, imagine my shock that the next generation they got into firearms.

That escalated quickly

Re: TSAC: Low Bitrate Audio Compression

#78
post #65

Earlier quoted context omitted.

Archiving over a long period of time might be a use case. I often wonder, how much of the data currently in circulation will be lost at some point? HDD/SSD last a couple of years. Most of the data in the cloud will be copied over, but some will be lost. If you extrapolate to a 1000, 1 000 000 years, how much will remain? Will something survive the civilization collapse? I guess most people don't care, but some will .…

The only data that survives a civilization-level collapse is that which requires as little decoding as possible; in other words, plaintext. Future archaeologists aren't going to have a working copy of your GAN-based audio decoder. Translate your data into text (in as many major languages as possible), carve it into stone, and stuff it in a cave in the desert.

I would worry more about future archaeologists not being able to access e.g. Nvidia and TSMC engineering secrets than their ability to decode my cat pictures and shitty piano practice.

Re: TSAC: Low Bitrate Audio Compression

#79
post #63
post #20

Earlier quoted context omitted.

I like how it degrades in such an analog way

Reminds me of what it sounds like to tune an old FM radio

Does anyone know how I would recreate this effect with 2 mp3s acting as 2 radio stations? I have tried fading in samples of static but it doesnt feel the same.

Re: TSAC: Low Bitrate Audio Compression

#80
FYI it looks to be MIT/BSD license.

Separately:

>The Transformer model is evaluated in a deterministic and reproducible way. Hence the result does not depend on the exact GPU or CPU model nor on the number of configured threads.

That's neat. So even though it's "AI-based" its output is guaranteed to be the same for a given input?

Post reply on HN