Live data from Hacker News

NotebookLM's automatically generated podcasts are surprisingly effective

simonwillison.net

71–80 of 511 posts

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#71
post #52

Earlier quoted context omitted.

I think and hope that you're wrong. There's always been cheese, and there's a lot of it now. But there is still a market for top-notch insight. For example, Perun. This guy delivers an hourlong presentation on (mostly) the Ukraine-Russia war and its pure quality. Insights, humour, excellent delivery, from what seems to be a military-focused economist/analyst/consultant. We're a while away from some bot taking this ki…

Seriously, hardcore history? I dont even remember where I heard from him, but I think it was a Lex podcast. So I checked out hardcore history and was mightily disappointed. To my ears, he is rambling 3 hours about a topic, more or less unstructured and very long-winded, so that I basically remember nothing after having finished the podcast. I tried several times again, because I wanted it to be good. But no, not the…

Hardcore History can certainly be off kilter, and the first eppy of any series tends to be a slog as he finds his groove. That said, Wrath of the Khans, Fall of the Republic, and the WW1 series do blossom into being incredible gripping series.

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#72

OK, this is pretty amazing, but is there a "Valley Girl" setting in NotebookLM somewhere? In the sample given in this article, both of the "podcasters" had to add a "like", like every 5 seconds. I couldn't take it: > this tech is just like leaps and bounds of where it was yesterday like we're watching it go from just spitting out words to like...

"Like" is a filler word I barely notice, along with lower key words like "right" or "uh uh". But the NotebookLM constantly exclaiming "Exactly" and "Precisely" stand out and are driving me a bit loopy. I wonder if you can prompt inject them away.

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#73

I don’t think this is all that impressive, the generated podcast is pretty shallow - lots of ‘whoa meta’ and the word ‘like’ thrown into every sentence. Yes, it will generate a middle-of-the-road waffling podcast, but not one with any real depth.

Imagine showing this and your comment to someone 5 years ago.

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#76
post #67
post #60

Earlier quoted context omitted.

If it was vomit, why did you spend an hour on it? People complain about 2 minutes of audio sometimes, I cannot imagine a full hour of an unknown podcast, it must have been quite interesting.

Because they assumed that there was a good reason that their friend sent it!? I had a friend who did the same to me, I was sent a message asking my opinion on a tech topic. I spent 30min researching/reading to make sure my reply was accurate and then found out the question was generated by a LLM, and he just wanted to show off how good a LLM was. It will color every interaction you have with that person...

If it was vomit, it will be recognized quickly, AI or not, not an hour of listening for sure; yes, even if it was sent by a friend.

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#77

NotebookLM's is incredibly good at generating the affect and structure of a quality podcast. This is in-line with all art, music, and video created by LMM at the moment. They are imitating a structure and affect, the quality of the content is largely irrelevant. I think the interesting thing is that most people don't really care, and AI is not to blame for that. Most books published today have the affect of a book, b…

I would disagree it's trying to be a "quality" podcast. As usual with AI, it's an average over averages, incredibly mediocre, sometimes borderline satire. For instance, in this example podcast they say "and trust me, guys, you wanna hear all about this", which is where I would usually turn off, because nothing of quality can come after this sentence.

In my company, HR now uses AI to do training videos. It's hilariously funny, because it looks like a satire on training videos (well, granted, it's funny for a minute or two, then it shifts to annoying).

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#78
post #69
post #52

Earlier quoted context omitted.

Seriously, hardcore history? I dont even remember where I heard from him, but I think it was a Lex podcast. So I checked out hardcore history and was mightily disappointed. To my ears, he is rambling 3 hours about a topic, more or less unstructured and very long-winded, so that I basically remember nothing after having finished the podcast. I tried several times again, because I wanted it to be good. But no, not the…

Yea there are much better examples of quality history podcasts, that are non-rambling. E.g. Mike Duncan podcasts (Revolutions, History of Rome), or the Age of Napoleon podcast. But even those are really just very good digestions of various source materials, which seems like something where LLMs will eventually reach quite a good level.

[deleted]

Re: NotebookLM's automatically generated podcasts are surprisingly effective

#80
post #68

NotebookLM's is incredibly good at generating the affect and structure of a quality podcast. This is in-line with all art, music, and video created by LMM at the moment. They are imitating a structure and affect, the quality of the content is largely irrelevant. I think the interesting thing is that most people don't really care, and AI is not to blame for that. Most books published today have the affect of a book, b…

I ran one of my papers into it, mind blown how well they dumbed it down without losing too much details (still quite a lot was ommitted). I wonder if it's domain specific, and I wonder what's the variance by topic.

Same here. In fact, I typically struggle communicating my scientific research to journalists, and next time I'll use this. It found some good metaphors to make even a quite math-heavy paper's core concepts understandable to the audience without losing correctness, which is something that both I and the journalist typically fail to do (I keep the correctness but don't make it understandable enough, so then journalists start coming up with metaphors and do the opposite).

A lawyer friend of mine also suggested giving it the Spanish civil code, a long, arid legal text. The podcast of course didn't cover the whole text in 10 minutes, which would be impossible, but they selected some interesting tidbits and actually had me hooked until the end and made me learn a few things about it, which is no small merit. And my friend was quite impressed and didn't complain about correctness.

Post reply on HN