Live data from Hacker News

Artificial Intelligence Generates Christmas Song from Holiday Image

news.developer.nvidia.com

81–90 of 115 posts

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#81
post #78

Earlier quoted context omitted.

I'm interested that you used some Christmas songs as training (which wasn't obvious from what I read of the paper). Were they pop songs, traditional, or a mix? Further to my comment up there[0] - and I don't wish to sound a grinch because this is a really cool project - but would I be right in thinking you spent more time on the image description than the music? I saw that you specify a scale for the melody, would it…

Thanks for the comments! Are you asking the lyrics or music generation? For lyrics, we actually didn't train on Christmas songs. Training data was a large collection of romance novels. (See neural-storyteller by Jamie Kiros). The "Christmas trick" we did was applying a "style shifting" after image captioning and before lyrics generation, where the shifting vector was obtained from ~30 Christmas songs. For the music g…

Thanks for the reply! I was concentrating on the music specifically. I thought the lyrics generation was really enjoyable.

I was asking more if you'd used any traditional carols, as they can have a more definitively "christmassy" sound than a pop song with sleighbells laid over the top.

Overall I meant that I think the music would be more convincing either following the chords in the melody, or sticking to a single mode for both melody and accompaniment.

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#82
post #56

Earlier quoted context omitted.

How long did it take to go from really silly and obviously impractical flying machine designs to working, practical ones?

Thousands of years? Who knows how long before the Wright Brothers people have been attempting flight?

ythn, you should start where we had the combustion engine, since it was a source of huge amounts of power (the power density of the fuel) that was already effectively being turned into motion.

What I'm saying is that the server farms @ Google, Amazon, and elsewhere, are at the stage of the "combustion engine" -- not just 'powerful enough', but more powerful than necesssary. I base this on a count of the number of neurons in the human brain, their rough topology and connectedness, how quickly and often they fire, etc.

In that sense, I think you will find it almost impossible to conclude that our server farms today do not have sufficient power to simulate 86 billion neurons' 7k connections each, at a lowly few hundred herz. They are not even more connected than we are able to simulate, precisely because we can saturate links over a million roundtrips before we meet brain's realtime behavior. (Or at least, thousands of times.)

So perhaps "we are just imitating birds by gluing feathers to cardboard wings, flapping them, and hoping flight just sort of happens" -- but while having an engine attached that's at least an order of magnitude more powerful than is required to achieve flight.

In that context, the story we're replying to is like a video of someone achieving a 2 second flight - with a lot of feathers flying everywhere. It might not seem like much, but given what we know an 86-billion-neuron neural net is capable of, it is exciting.

The results of AI based on neural nets that I see being posted every single day are absolutely astounding.

this is happening right in front of your eyes. you're witnessing the birth of flight.

no, the engines won't fly the way birds do -- but they're more than powerful enough to start flying, and you are seeing this every single day.

By the way, you know there's not a particular push toward trying to make neural nets that are self-conscious or feel pain, etc? This just isn't a primary goal of researchers at this very second.

Just as flight engineers don't really try to make ornithopters. We have better and more powerful things to be doing.

this is an absolutely miraculous time. And you're not seeing it - which is sad.

This isn't some kind of pipe dream. These are results coming out every single day.

Here's a neural net designed to make horror art out of normal photos:

http://nightmare.mit.edu/

And that's just one thing out of many. Nuance's Dragon systems have practically eliminated the entire profession of medical transcriptionist. (Just google regarding 'medical transcription dead' without quotes to find people from that industry reporting on its demise.) Becoming a medical transcriptionist today is like going to typewriter repair school. Because speech recognition techniques based on machine learning have gotten that good.

Go, an incredibly nuanced game with a staggering possibility space, has fallen to machine learning competing with a lifetime of competitive human mastery.

It doesn't matter in what order or how the next breakthroughs come that go toward sentient or at least very intelligent interaction. We know what the limits are. And we know based on the topology and computation involved, that we have massively more than enough horsepower.

so while you might point to flying feathers and crashing airplane and deride it, I think about the jet engine behind those flying feathers and my heart skips a beat when I see it sustain flight for 2.3 seconds before producing "A hundred and half hour ago" like a human toddler blabbering incoherently and without even understanding those words.

Because I know what else AI has been accomplishing, and I know the horsepower behind it. you need to expand your thinking and realize that our algorithms and machine learning techniques are playing catchup with hardware that has been sitting around being dumb.

That's right: computers have just been sittin' around, bein' dumb, while they have all the computational power necessary to surpass humans in every realm of neural computation. mark my words, ythn. no pipe dream involved.

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#83
post #59

Earlier quoted context omitted.

Instead of five, don't you mean "two to three"? And under that comparison, isn't it scary how much it does sound that way? Like a kid who hears words together but don't know what they mean yet? (and doesn't really get the cultural things around it.) To me it sounds like a quite musical 2-3 year old stringing words together. Doesn't it strike anyone else that way? These things are going to grow up very, very soon! We…

By your own argument, any program that a single human being can write can also contain only 700MB of source code, including graphics and videos etc, which is obviously not true.

you are right, I went too far. but the size of DNA is a good indication of how complex the high-level wiring and topology of neurons likely is, that is, until that neural net has been been trained at all.

it takes years to train a human neural net to even been able to speak (toddlers.) But regarding the architecture, there's good reason to think that the wiring for it is not infinitely complex, taking trillions of terabytes etc - or anywhere close to that.

I think that on some level it is fair to say that the wiring that makes people's brains human is in some sense encoded in DNA.

However, I will grant that this might not be helpful. After all, if we posit or assume as axiomatic that the whole universe is deterministic and here, these 100 megabytes of source code can model it and if you did that with 10^100 bytes and FLOPS, you'd after a few days of running it you'd find humans inside - well, then, sure, in some sense 100 megabytes "describes" the entropy inside human brains, but in another sense that is not useful in any way.

so perhaps DNA is the same and the "knowledge" that 700 MB or so can produce a human if you run it in biological substrate after carrying it out in a womb, and then raise it with human culture for 72 months it will speak just fine, is not necessarily an indication of what kind of information we would need to give a neural net and how much coding it would take to take on the same behavior. So while to me personally it remains an indication, I agree I went too far.

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#84
post #54

Earlier quoted context omitted.

I don't think you are correct from an information computation point of view. When looking at the computation done by neurons in the brain it is sufficient to abstract away the lower-level substrate in which it occurs. You and other posters are all correct regarding the huge volume of information on which human minds are trained. it's hardly unsupervised learning either :) --------- EDIT: In response to your comment,…

I will confess to not being an expert, but I disagree: I don't think it's sufficient to abstract away the lower-level substrate when the OP was referring to DNA as source code, which absolutely depends on that level of detail to both construct the system (the brain) and to enable the continued development and maturation of that system (a physical, real brain). I was not referring to the huge volume of information nec…

you are right, I went too far. see my other comment:

https://news.ycombinator.com/item?id=13081551

however, that just concerns the DNA argument. We know roughly how many neurons there are in humans and their connectedness.

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#85

Earlier quoted context omitted.

What I mean by uncompressed is that you're reading the cytosine (C), guanine (G), adenine (A), or thymine (T) as being two bits per base pair (1 of 4 possibilities). There are 3 billion base pairs, which is 6 billion bits, divided by 8 to get bytes you get 750 MB. The human genome is somewhat redundant and can be further compressed. That is just the string of "ones and zeros" (ACGT) could be run through whatever comp…

What your link is describing is the size of the Genome encoded into bits . In other words, that's the size of the file containing an entire genome compressed into base pairs in order to store the raw base pair encoding on disk as digital data. That is definitively not the measure of the amount of information encoded into the DNA. Nor can you guess at that encoding by modeling DNA base pairs as 2 bits. DNA base pairs…

you are right - see my comments under here (1 down):

https://news.ycombinator.com/item?id=13081551

however, that just concerns the DNA argument. We know roughly how many neurons there are in humans and their connectedness.

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#86
post #5

it is scary, sounds like GLAdOS singing "still alive"!

It sounds more like a corrupt core.

"Cave here. It's Christmas time, and you know what that means: Christmas bonuses have been suspended until further notice. We've gotta pay the judgement on that pesky class-action with something. But don't let that get you out of the Christmas spirit. The lab boys have come up with a way to stay festive by hooking up the Christmas Core to the lab's PA system. So enjoy free, continuous, computer-generated Christmas music from now until January 5!"

"Cave again. Apparently the Christmas music has been causing some employees severe emotional and psychological distress. We've had reports of people sticking their heads into active particle accelerators and drinking Repulsion Gel to get away from the sound. So until a full investigation has been conducted and the Christmas Core thoroughly debugged, we are discontinuing the Christmas music. We do not need another class-action on our hands, folks."

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#88

"The best Christmas present in the world is a blessing." This algorithm is throwing down some wisdom

I think generating fortune cookies is a really low hanging fruit for current AI. Someone could put it together in a week-end.

I once developed a hierarchical Markov chain, and I decided to use it to generate fortune cookie wisdom because I thought people would be more willing to overlook grammatical mistakes or be willing to interpret it as an expression of deep truth. http://www.kylem.net/stuff/fortunes.html (You might need to increase the "sense" parameter.)

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#89
post #88

Earlier quoted context omitted.

I think generating fortune cookies is a really low hanging fruit for current AI. Someone could put it together in a week-end.

I once developed a hierarchical Markov chain, and I decided to use it to generate fortune cookie wisdom because I thought people would be more willing to overlook grammatical mistakes or be willing to interpret it as an expression of deep truth. http://www.kylem.net/stuff/fortunes.html (You might need to increase the "sense" parameter.)

"The supreme happiness in life is simply to serve as a warning to others."

Oh my god, I'm in stitches. What a fun project, thanks for sharing!

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#90
post #88

Earlier quoted context omitted.

I think generating fortune cookies is a really low hanging fruit for current AI. Someone could put it together in a week-end.

I once developed a hierarchical Markov chain, and I decided to use it to generate fortune cookie wisdom because I thought people would be more willing to overlook grammatical mistakes or be willing to interpret it as an expression of deep truth. http://www.kylem.net/stuff/fortunes.html (You might need to increase the "sense" parameter.)

"If at first you don't succeed, destroy all evidence that you cannot change, and you will feel better."
Post reply on HN