261–269 of 269 posts
I love the tongue-in-cheek paradox myth that the Bitcoin whitepaper was written by a future god-AI to increase demand for GPUs (and thus boost supply) so we are able to assemble the future god-AI.
Earlier quoted context omitted.
> part of your llm prompt (usually your most recent question?) gets fed as a query for the embedding/vector database How is it embedded? Using a separere embedding model, like Bert or something? Or do you use the LLM itself somehow? Also, how do you create content for the vector database keys themselves? Also just some arbitrary off the shelf embedding? Or do you train it as part of training the LLM?
Yeah its completely seperate. The LLM just gets some extra text in the prompt, that is all. The text you want to insert is "encoded" into the database which is not particularly compute expensive. You can read about one such implementation here: https://github.com/chroma-core/chroma
Just when I went back to the post for some quote material...
The page now says "This content has been removed at the request of OpenAI." I wonder why they did it.
https://archive.ph/rcbem The page now says "This content has been removed at the request of OpenAI." I wonder why they did it.
Earlier quoted context omitted.
> part of your llm prompt (usually your most recent question?) gets fed as a query for the embedding/vector database How is it embedded? Using a separere embedding model, like Bert or something? Or do you use the LLM itself somehow? Also, how do you create content for the vector database keys themselves? Also just some arbitrary off the shelf embedding? Or do you train it as part of training the LLM?
Yeah its completely seperate. The LLM just gets some extra text in the prompt, that is all. The text you want to insert is "encoded" into the database which is not particularly compute expensive. You can read about one such implementation here: https://github.com/chroma-core/chroma
Earlier quoted context omitted.
Have you found plugins to be useful? For what it's worth I've found the model actually performs significantly worse at most tasks when given access to browsing, in part because it relies on that instead of its own in built knowledge. I haven't found a good way to have it only access the web for specific parts of its response.
The only plugin I found useful was the diagramming one, forgot what it's called. But you can quickly make code (or other) flowcharts etc. And browsing in rare cases.
Earlier quoted context omitted.
When you stop listening to what Sam Altman says and just focus on what he does, you can see the guy is a bit of a snake. Greedy power-hungry man imho.
Sam Altman is responsible for leading the team that have revolutionised AI in its position within society. There is plenty to criticise OpenAI for but what he and they have achieved is extraordinary, and there is no need for that sort of toxic personal attack.