221–230 of 965 posts
I’m impressed by the benchmarks but really intrigued by the press release with the example prompt ~”Tell me some concerts I can go to on Saturday”. Clearly they are able to add their Meta data to context, but are they also crawling the web? Could this be a surface to exfiltrate Meta data in ways that scraping/ APIs cannot?
Earlier quoted context omitted.
Wild considering, GPT-4 is 1.8T.
Once benchmarks exist for a while, they become meaningless - even if it's not specifically training on the test set, actions (what used to be called "graduate student descent") end up optimizing new models towards overfitting on benchmark tasks.
Ahhh that takes me back!
Initial observations from the Meta Chat UI... 1. fast 2. less censored than other mainstream models 3. has current data, cites sources I asked about Trump's trial and it was happy to answer. It has info that is hours old --- Five jurors have been selected so far for the hush money case against former President Donald Trump ¹. Seven jurors were originally selected, but two were dismissed, one for concerns about her im…
It's likely RAG / augmented with web data. Would be interested if local execution returned the same results.
Guess the moat is disappearing day by day.
I am always excited to see these Open Weight models released, I think its very good for the ecosystem and definitely has its place in many situations. However since I use LLMs as a coding assistant (mostly via "rubber duck" debugging and new library exploration) I really don't want to use anything other than the absolutely best in class available now. That continues to be GPT4-turbo (or maybe Claude 3). Does anyone k…
Do you mind my asking, if you're working on private codebases, how you go about using GPT/Claude as a code assistant? I'm just removing IP and pasting into their website's chat interface. I feel like there's got to be something better out there but I don't really know anyone else that's using AI code assistance at all.
Earlier quoted context omitted.
Lex walked so that Dwarkesh could run. He runs the best AI podcast around right now, by a long shot.
I agree that it is the best AI podcast. I do have a few gripes though, which might just be from personal preference. A lot of the time the language used by both the host and the guests is unnecessarily obtuse. Also the host is biased towards being optimistic about LLMs leading to AGI, and so he doesn't probe guests deep enough about that, more than just asking something along the lines of "Do you think next token pre…
Zuck has an interview out for it as well, https://twitter.com/dwarkesh_sp/status/1780990840179187715
Lots of great details in the blog: https://ai.meta.com/blog/meta-llama-3/ Looks like there's a 400B version coming up that will be much better than GPT-4 and Claude Opus too. Decentralization and OSS for the win!