61–70 of 78 posts
Earlier quoted context omitted.
I would just hope that they disingeniously stop promoting these kind of things as open source
This content could easily be a blog post and worth a read. But it’s in notebook form to make it interactive. It’s a tired comment narrative about these being about open source.
Earlier quoted context omitted.
I think this is an important enough quality that betrays that there are no two minds here creating 1+1=3. One cheap trick to overcome this uncanny valley may be to actually use two separate LLMs or two separate contexts / channels to generate the conversations and take "turns" to generate the followup responses and even interruptions if warranted. Might mimic a human conversation more closely.
Funnily, even two different LLMs, when put in conversation with each other, can end up completing each other's sentence. I guess it has something to do with the sequence prediction training objective.
This is in fact pretty explicitly not open source: https://github.com/meta-llama/llama-recipes/blob/d83d0ae7f5c... (And given there is no LICENSE file, I’m afraid you can only use this code as reference at best right now)
The more I listen to NotebookLM “episodes”, the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. The two speakers interrupt and speak over each other in an uncannily humanlike manner. I wonder whether they basically fine tuned against a huge library of actual podcasts along with the podcast transcr…
I feel similarly about NotebookLM, but have noticed one odd thing - occasionally Host A will be speaking, and suddenly Host B will complete their sentence. And usually when this happens, it's in a way that doesn't make sense, because Host A was just explaining something to or answering a question of Host B. I'm actually not sure what to make of that, but it's interesting to note
Earlier quoted context omitted.
Idk if I’d call it a killer app. The podcasts are grating to listen to and usually only contain very surface information I could gain from a paper’s abstract. It’s a wildly impressive technical achievement though.
The point being made is that while this may be grating for you. It is magic for a large part of the population. This combined with chatgpt advanced voice mode shows a direction of travel for AI agents. It makes it possible to imagine a world where everyone has personalized tutors and that world isn't very far away.
My issue with AI hype is exactly this. Everything is “imagine if this was just better enough to be useful”
“Imagine if we had an everything machine”
“Image everyone having a personal assistant/artist/tutor/programmer”
“Imagine a world where finance is decentralized and we all truly own our digital stuff”
I’m not much of a visionary, admittedly, but it’s exhausting being told to imagine products that only half exist now.
Having worked with LLMs in the autonomous agent space, I think we’re very far away from agents actually doing useful work consistently.
There are still so many problems to be solved around the nature of statistical models. And they’re hard problems where the solution, at least at the product level, boils down to “wait for a better model to come out”
I’m just tired of people imagining a future instead of building useful things today
Earlier quoted context omitted.
> the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. I have good and bad news for you - they did not! We were the first podcast to interview the audio engineer who led the audio model: https://www.latent.space/p/notebooklm TLDR they did confirm that the transcript and the audio are generated sepa…
Soundstorm is probably the TTS https://google-research.github.io/seanet/soundstorm/examples...
I tried to build something kind of like NotebookLM (personalized news podcasts) over the past months ( https://www.tailoredpod.ai ), but biggest issue is that the existing good TTS Apis are so expensive that a product such as NotebookLM is not really possible for a normal company that doesn't have internal access to Google's models. OpenAI has the cheapest / quality good enough TTS Api, but even then generating hours…
Earlier quoted context omitted.
I wish chatgpt or Claude would make an an Android Auto app that I can use while driving.
you could just Bluetooth your speakers
It only creates the podcasts right? I am more interested in the other features of NotebookLM. The podcasts are fun but gimmicky.