Earlier quoted context omitted.
Claude has the same restriction [0], the whole of Europe (except Albania) is excluded. Somehow I don't think it is a retaliation against Europe for fining Meta and Google. I could be wrong, but a business decision seems more likely, like keeping usage down to a manageable level in an initial phase. Still, curious to understand why, should anyone here know more. [0] https://www.anthropic.com/claude-ai-locations
It's because of regulations! The same reason that Threads was launched with a delay in EU. It simply takes a lot of work to comply with EU regulations, and by no surprise will we see these launches happen outside of EU first.
Meta Llama 3
631–640 of 965 posts
Re: Meta Llama 3
#632I tried generating a Chinese rap song, and it did generate a pretty good rap. However, upon completion, it deleted the response, and showed > I don’t understand Chinese yet, but I’m working on it. I will send you a message when we can talk in Chinese. I tried some other languages and the same. It will generate non-English language, but once its done, the response is deleted and replaced with the message
I'm seeing the same behaviour. It's as if they have a post-processor that evaluates the quality of the response after a certain number of tokens have been generated, and reverts the response if it's below a threshold.
Re: Meta Llama 3
#633https://github.com/meta-llama/llama3/blob/main/LICENSE Llama is not open source. It's corporate freeware with some generous allowances. Open source licenses are a well defined thing. Meta marketing saying otherwise doesn't mean they get to usurp the meaning of a well understood and commonly used understanding of the term "open source." https://opensource.org/license Nothing about Meta's license is open source. It's a…
Models aren’t code, some of the concepts of open source code don’t map 1:1 to freely available models.
In spirit I think this is “open source”, and I think that’s how the majority of people think.
Turning everything into some sort of theological debate takes away a lot of credit that Meta deserves. Google isn’t doing this. OpenAI sure as fuck isn’t.
Re: Meta Llama 3
#634Zuck has an interview out for it as well, https://twitter.com/dwarkesh_sp/status/1780990840179187715
Seems like a year or two of MMA has done way more for his charisma than whatever media training he's done over the years. He's a lot more natural in interviews now.
Re: Meta Llama 3
#635Earlier quoted context omitted.
Agreed. Still not open data though, is it? i.e., we don't have access to the same data they used to train, which is useful for both finetuning and studying the model.
To be fair, this is part of the reason it is so valuable. Meta has access to absolutely stupendous amounts of private training data. If you forced them to make the data available you would have to settle for a tiny training set by comparison. The value of this is exactly that you are getting access to the result of training on data that you couldn't otherwise access at all.
Re: Meta Llama 3
#636I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…
Re: Meta Llama 3
#637Earlier quoted context omitted.
> until your startup reaches 700M+ customers, when the free ride ends No it doesn’t. The licence terms talk about that those who on the release date of llama3 had 700M+ customers need an extra licence to use it. It doesn’t say that you loose access to it if in the future you gain that many users.
You don't lose access, but the free ride ends. It seems that new licence will include payment terms. Zuckerberg discusses this on the Dwarkesh interview.
I don’t care what Zuckerberg says. I care what the licence says. I recommend you to read it. It is shorter and more approachable than the usual rental agreement of a flat.
Re: Meta Llama 3
#638I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…
I don’t really care how much the AI team open sources, the world would be a better place if the entire company ceased to exist.
Re: Meta Llama 3
#639"You’ll also soon be able to test multimodal Meta AI on our Ray-Ban Meta smart glasses." Now this is interesting. I've been thinking for some time now that traditional computer/smartphone interfaces are on the way out for all but a few niche applications. Instead, everyone will have their own AI assistant, which you'll interact with naturally the same way as you interact with other people. Need something visual? Just…
GUIs have an inherent advantage here: discoverability. If you think about it, conversational UIs, even turbo-charged by AI, are not that different from Command Line Interfaces. You need to have an idea that you want something. You lose the serendipity inherent to visual interfaces. We should never underestimate the power of the human visual cortex.
Re: Meta Llama 3
#640Open weight models do more for AI safety than any other measure by far, as the most serious threath is never going to be misuse, but abuse of unequal access.