Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

NotebookLlama: An open source version of NotebookLM

github.com

Post reply on HN
Print view View original

21–30 of 78 posts

Re: NotebookLlama: An open source version of NotebookLM

#21

Post by famouswaffles »

ttul wrote: post #12

The more I listen to NotebookLM “episodes”, the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. The two speakers interrupt and speak over each other in an uncannily humanlike manner. I wonder whether they basically fine tuned against a huge library of actual podcasts along with the podcast transcr…

Following up on swyx, the TTS is probably Google finally releasing Soundstorm from the basement.

https://google-research.github.io/seanet/soundstorm/examples...

Re: NotebookLlama: An open source version of NotebookLM

#22

Post by famouswaffles »

swyx wrote: post #16
ttul wrote: post #12

The more I listen to NotebookLM “episodes”, the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. The two speakers interrupt and speak over each other in an uncannily humanlike manner. I wonder whether they basically fine tuned against a huge library of actual podcasts along with the podcast transcr…

> the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. I have good and bad news for you - they did not! We were the first podcast to interview the audio engineer who led the audio model: https://www.latent.space/p/notebooklm TLDR they did confirm that the transcript and the audio are generated sepa…

Soundstorm is probably the TTS https://google-research.github.io/seanet/soundstorm/examples...

Re: NotebookLlama: An open source version of NotebookLM

#23

Post by jrm4 »

Great to see this: Fellow tech-geeks, ignore the NotebookLM thing at your peril.

NotebookLM, far and away, has been the "AI Killer App" for the VAST MAJORITY of bright-but-not-particularly-techy people I know. My 70ish parents and my 8 year old kid are both just blown away by this thing and can't stop playing with it.

Edit: As someone pointed out below, I absolutely mean just the "podcast" thing.

Re: NotebookLlama: An open source version of NotebookLM

#24

Post by danpalmer »

behnamoh wrote: post #18
danpalmer wrote: post #2

I'm not so sure this is an open source NotebookLM as it is a few experiments in an iPython notebook. What NotebookLM does at an LLM level is not particularly novel, it's the packaging as a product in a different way than what others are doing that I think is interesting. Also the "podcast" bit is really just an intro/overview of a large corpus, far more useful is being able to discuss that corpus with the bot and get…

> What NotebookLM does at an LLM level is not particularly novel, it's the packaging as a product... Disagreed. NLM is novel in how the two hosts interrupt and overlap each other. No other OSS solution does that, they just take turns talking.

Fair point, although to me the "audio overviews" are a minor feature of the product.

Re: NotebookLlama: An open source version of NotebookLM

#25

Post by TibbityFlanders »

rmorey wrote: post #14
ttul wrote: post #12

The more I listen to NotebookLM “episodes”, the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. The two speakers interrupt and speak over each other in an uncannily humanlike manner. I wonder whether they basically fine tuned against a huge library of actual podcasts along with the podcast transcr…

I feel similarly about NotebookLM, but have noticed one odd thing - occasionally Host A will be speaking, and suddenly Host B will complete their sentence. And usually when this happens, it's in a way that doesn't make sense, because Host A was just explaining something to or answering a question of Host B. I'm actually not sure what to make of that, but it's interesting to note

[dead]

Re: NotebookLlama: An open source version of NotebookLM

#26

Post by jeffbee »

jrm4 wrote: post #23

Great to see this: Fellow tech-geeks, ignore the NotebookLM thing at your peril. NotebookLM, far and away, has been the "AI Killer App" for the VAST MAJORITY of bright-but-not-particularly-techy people I know. My 70ish parents and my 8 year old kid are both just blown away by this thing and can't stop playing with it. Edit: As someone pointed out below, I absolutely mean just the "podcast" thing.

Are we talking about NotebookLM generally or specifically the podcast stunt?

Re: NotebookLlama: An open source version of NotebookLM

#27

Post by jrm4 »

jeffbee wrote: post #26
jrm4 wrote: post #23

Great to see this: Fellow tech-geeks, ignore the NotebookLM thing at your peril. NotebookLM, far and away, has been the "AI Killer App" for the VAST MAJORITY of bright-but-not-particularly-techy people I know. My 70ish parents and my 8 year old kid are both just blown away by this thing and can't stop playing with it. Edit: As someone pointed out below, I absolutely mean just the "podcast" thing.

Are we talking about NotebookLM generally or specifically the podcast stunt?

Good question: I absolutely mean the podcast stunt.

Re: NotebookLlama: An open source version of NotebookLM

#29

Post by dartos »

jrm4 wrote: post #27
jeffbee wrote: post #26

Earlier quoted context omitted.

Are we talking about NotebookLM generally or specifically the podcast stunt?

Good question: I absolutely mean the podcast stunt.

Idk if I’d call it a killer app.

The podcasts are grating to listen to and usually only contain very surface information I could gain from a paper’s abstract.

It’s a wildly impressive technical achievement though.

Post reply on HN