Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 2

ai.meta.com

Post reply on HN
Print view View original

111–120 of 860 posts

Re: Llama 2

#111

Post by Miraste »

chaxor wrote: post #60
whimsicalism wrote: post #26

Earlier quoted context omitted.

Google's model is not as capable as llama-derived models, so I think they would actually benefit from this. > I wouldn't be surprised if Amazon does as well. I would - they are not a very major player in this space. TikTok also meets this definition and probably doesn't have LLM.

Google has far better models than llama based models. They just simply don't put them facing the public. It is pretty ridiculous that they essentially just set a marketing team with no programming experience to write Bard, but that shouldn't fool anyone into believing they don't have capable models in Google. If Deepmind were to actually provide what they have in some usable form, it would likely be quite good. Despi…

This reminds me of how any day now their self driving cars are going to work right.

Re: Llama 2

#113

Post by imjonse »

moffkalast wrote: post #54
msp26 wrote: post #36

Earlier quoted context omitted.

>The 4k context length is nice, but RoPE makes it irrelevant anyway. Can you elaborate on this?

Here's some more info on it: https://arxiv.org/pdf/2306.15595.pdf https://www.reddit.com/r/LocalLLaMA/comments/14lz7j5/ntkawar... https://www.reddit.com/r/LocalLLaMA/comments/14mrgpr/dynamic... In short, the context is just an array of indexes passed along with the data, which can be changed to floats and encode more sparsely to scale to an arbitrarily small or large context. It does need some tuning of the model to…

It's likely the paper's ideas were still fresh or incompletely validated when LLama 2 had already been training.

Re: Llama 2

#114

Post by barbariangrunge »

_b wrote: post #74

Making advanced LLMs and releasing them for free like this is wonderful for the world. It saves a huge number of folks (companies, universities & individuals) vast amount of money and engineering time. It will enable many teams to do research and make products that they otherwise wouldn't be able to. It is interesting to ponder to what extent this is just a strategic move by Meta to make more money in the end, but wh…

You have to agree to any terms they might think of in the future. Clicking download, they claim you agree to their privacy policy which they claim they can update on a whim

Google's privacy policy, for example, was updated stealthfully to let them claim rights over every piece of IP you post on the internet that their crawlers can get to

Re: Llama 2

#115

Post by tyre »

swyx wrote: post #69
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

its not clear but can we also download the model with this Llama v2 Cog thing? EDIT: Meta is being extremely prompt, just got sent the download instructions https://twitter.com/swyx/status/1681351712718876673 also is it now Llama or LLaMA since the website says Llama? lol

> the rest of us have to wait to download the weights

they're openly torrentable

Re: Llama 2

#116

Post by jahewson »

whimsicalism wrote: post #4

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

Is there a good name for this kind of license? If not I propose “de-FANGed”.

Re: Llama 2

#117

Post by madisonmay »

crop_rotation wrote: post #3

They don't benchmark against the OpenAI models at all for some reason. In my experience so far even GPT-3.5 was so much better than any OSS models I tried. Meta must be missing having a cloud business at this point. AI would have fit perfectly with that. Since they ran Whatsapp for so many years kinda without interfering too much, they could have also tried a somewhat independent cloud unit.

See figure-2

Re: Llama 2

#118

Post by azeirah »

itake wrote: post #102
ezyang wrote: post #44

The llama source code in the original repo has been updated for llama 2: https://github.com/facebookresearch/llama

do you know if llama.cpp will work out of the box or do we need to wait for the code to be updated?

https://github.com/ggerganov/llama.cpp/issues/2262

Likely needs to be updated

Edit: Only the case for the 34B and 70B models. 7B and 13B run as-is.

You can download the GGML model already

https://huggingface.co/TheBloke/Llama-2-7B-GGML

https://huggingface.co/TheBloke/Llama-2-13B-GGML

Re: Llama 2

#119

Post by samwillis »

This being released as free for commercial use is textbook "commoditise your compliment". It's a preemptive attack on Google and OpenAI.

If everyone has free access to good LLMs there is no business to be built on exclusive use. It limits the size hosted privet LLM APIs can become.

As an individual I'm very happy to see them doing it. Roll on local LLMs!

Re: Llama 2

#120

Post by insanitybit »

whimsicalism wrote: post #4

Key detail from release: > If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under thi…

Lots of products will never have anywhere near 700 million monthly active users, or even 1/10,000th of that, and they can still leverage this for free. Any company at 700m active users is likely worth billions and can pay.
Post reply on HN