Live data from Hacker News

Llama 2

ai.meta.com

221–230 of 860 posts

Re: Llama 2

#221
I was cautiously optimistic until I clicked the “Download the Model” button, only to be greeted by a modal to fill out a form to request access.

If the form is a necktie, the rest of the suit could use some tailoring. It’s far too tall for me to wear.

Re: Llama 2

#222
post #214

Earlier quoted context omitted.

It is already on huggingface. Meta never really cared about the download wall.

there is a download wall again :(

Not anymore lol

https://huggingface.co/localmodels/Llama-2-13B-ggml

Just wait a few minutes for the other variants to be uploaded.

Re: Llama 2

#223
Could someone please give us non-practitioners a practical TLDR?

Specifically, can I get this packaged somehow into a thing that I can run on my own server to classify my mail as spam or non-spam? Or at least run it as a service with an API that I can connect to?

I watch the development of those LLMs with fascination, but still wade through tons of spam on a daily basis. This should be a solved problem by now, and it would be, except I don't really want to send all my E-mails to OpenAI through their API. A local model would deal with that problem.

Re: Llama 2

#224
post #201

Intersting that they did not use any facebook data for training. Either they are "keeping the gud stuff for ourselves" or the entirety of facebook content is useless garbage.

Well, if you expect a modicum of accuracy in the output...

Re: Llama 2

#225
post #202

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

I'm wondering how do people compare different models? I've been trying chatGPT 3.5, bing chat (chatgpt 4 I believe?), and bard, and now this one, and I'm not sure if there's a noticeable difference in terms of "this is better"

Try the Chat Arena with ELO ratings based on end user side by side blind tests. It run out of UC Berkley by lmsys the same team that released Vicuna.

https://arena.lmsys.org/

Re: Llama 2

#226

Earlier quoted context omitted.

I think TikTok would just use it anyway even if they were denied a license (if they even bothered asking for one). They've never really cared about that kind of stuff.

Anyone who has ever worked in a major social media company knows that this is false - but as another person who has, I will chime in and say this is completely wrong, compliance (especially such obvious compliance) is taken seriously.

I worked at a company that caught a major Chinese Internet company (not ByteDance/TikTok, but one even larger) red-handed engaging in deliberate app install ad fraud (their app would send forged Android INSTALL_REFERRER intents), so it would not surprise me.

Re: Llama 2

#227
post #202

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

I'm wondering how do people compare different models? I've been trying chatGPT 3.5, bing chat (chatgpt 4 I believe?), and bard, and now this one, and I'm not sure if there's a noticeable difference in terms of "this is better"

Develop a set of queries for the use-case with human review of outputs. My team has an internal (corporate) tool where we drop in an S3 file, complete text over K models, then evaluate the completions with appropriate humans labor pools. Each evaluator gets a pair of outputs for the same prompt and picks the best.

Re: Llama 2

#228
I filled the form about an hour ago and got the download link 15 mins ago. Download is ongoing.

Direct link to request access form: https://ai.meta.com/resources/models-and-libraries/llama-dow...

Direct link to request access on Hugging Face (use the same email): https://huggingface.co/meta-llama/Llama-2-70b-chat-hf

Direct link to repo: https://github.com/facebookresearch/llama

Once you get a link to download on email make sure to copy it without spaces, an option is to open it in a new tab and then download. If you are using fish or another fancy shell, make sure you switch to bash or sh before running download.sh from the repo.

I am not sure exactly how much space is needed but it is likely north of 500GB given that there are two 70B models (you are given the option to download just the small ones in a prompt).

Edit: The_Bloke on HF already has them in GGML format available for download.

https://huggingface.co/TheBloke/Llama-2-7B-GGML https://huggingface.co/TheBloke/Llama-2-13B-GGML

Re: Llama 2

#229

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

...is this supposed to make sense? https://www.dropbox.com/scl/fi/5j0mtwdrqm08dxbh84hh6/Screen-...

Re: Llama 2

#230
post #202

Earlier quoted context omitted.

I'm wondering how do people compare different models? I've been trying chatGPT 3.5, bing chat (chatgpt 4 I believe?), and bard, and now this one, and I'm not sure if there's a noticeable difference in terms of "this is better"

Depends on the task. For code, ask it to implement a not-difficult but not-trivial feature. "Please add hooks to the AnkiDroid source code so that addons would be viable" might be a good start, for something that is on my mind. Then compare implementations. For checking hallucinations, ask it about events and trivia that happened eons ago, and also within the last decade. Try some things that it can not possibly know…

This is an emerging space with lots of interesting tools coming out... There are many established benchmarks out there (i.e. included on front page of llama2 release), but most product builders have their own sets of evals that are more relevant to them...

Here is a thread exploring differences between llama-v2 vs. gpt3.5: https://twitter.com/rajko_rad/status/1681344850510376960

Post reply on HN