The Sound of Pixels

#1

Post by myth_drannon » Mon, Sep 24, 2018, 12:16 PM UTC

The Sound of Pixels
sound-of-pixels.csail.mit.edu

Re: The Sound of Pixels

#2

Post by keyle » Tue, Sep 25, 2018, 12:34 AM UTC

Cool stuff. Any real world usage/benefits for this? I can't think of any.

Re: The Sound of Pixels

#3

Post by drhodes » Tue, Sep 25, 2018, 12:50 AM UTC

keyle wrote: post #2

Cool stuff. Any real world usage/benefits for this? I can't think of any.

matching faces with voices in a surveillance situation, which person is talking?

Re: The Sound of Pixels

#4

Post by vernie » Tue, Sep 25, 2018, 12:51 AM UTC

drhodes wrote: post #3

keyle wrote: post #2

Cool stuff. Any real world usage/benefits for this? I can't think of any.

matching faces with voices in a surveillance situation, which person is talking?

That's actually this paper: https://ai.googleblog.com/2018/04/looking-to-listen-audio-vi...

Re: The Sound of Pixels

#5

Post by hrayr » Tue, Sep 25, 2018, 12:55 AM UTC

Interesting, I was wondering what to do with my audiblepixel.com domain.

Re: The Sound of Pixels

#6

Post by utopcell » Tue, Sep 25, 2018, 12:57 AM UTC

keyle wrote: post #2

Cool stuff. Any real world usage/benefits for this? I can't think of any.

It would be great for practicing songs. In this scenario you would be clicking on the instrument to turn off.

Re: The Sound of Pixels

#7

Post by funkdified » Tue, Sep 25, 2018, 1:03 AM UTC

This is going to be huge for the hard of hearing.

Re: The Sound of Pixels

#8

Post by jovial_cavalier » Tue, Sep 25, 2018, 1:32 AM UTC

funkdified wrote: post #7

This is going to be huge for the hard of hearing.

how

Re: The Sound of Pixels

#9

Post by pjgrad » Tue, Sep 25, 2018, 1:57 AM UTC

funkdified wrote: post #7

This is going to be huge for the hard of hearing.

Unlike reading, I don't think audio can convey the same meaning in a different sensory format. At best, they perceive it but in an alien way to most people. It's like describing a painting in musical notes.

Re: The Sound of Pixels

#10

Post by pjgrad » Tue, Sep 25, 2018, 2:02 AM UTC

pjgrad wrote: post #9

funkdified wrote: post #7

This is going to be huge for the hard of hearing.

Unlike reading, I don't think audio can convey the same meaning in a different sensory format. At best, they perceive it but in an alien way to most people. It's like describing a painting in musical notes.

And the "some" to that "most" are those with synesthesia