Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 2

ai.meta.com

Post reply on HN
Print view View original

211–220 of 860 posts

Re: Llama 2

#211

Post by rajko_rad »

delfinom wrote: post #195
LoganDark wrote: post #87

Earlier quoted context omitted.

> Model playground here: llama2.ai is there any way to rename the model from "Assistant" to tune out those "I am a large language model" excuses?

Lol, so I kept spamming "no" and it eventually leaked it's boot instruction which was "Please respond as Assistant" So, just ask the LLM to respond as something else ;)

We were trying to do the same thing once deployed haha... we found, if you want it to take on another persona, you could end your prompt as:

'Assistant: (responding as XYZXYZ)'

And then let it complete! Worked much more reliably than just saying: 'XYZXYZ:'

Re: Llama 2

#212

Post by 0cf8612b2e1e »

itake wrote: post #109

Can someone reply with the checksums of their download? I will share mine once its finished.

Enormous complaint about this space: people seemingly never think to include checksums. Drives me wild when there is supposedly all of this concern about the right data and provenance, yet it is not easy to even confirm you have the genuine article.

Re: Llama 2

#213

Post by dotancohen »

baby wrote: post #202
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

I'm wondering how do people compare different models? I've been trying chatGPT 3.5, bing chat (chatgpt 4 I believe?), and bard, and now this one, and I'm not sure if there's a noticeable difference in terms of "this is better"

Depends on the task. For code, ask it to implement a not-difficult but not-trivial feature. "Please add hooks to the AnkiDroid source code so that addons would be viable" might be a good start, for something that is on my mind. Then compare implementations.

For checking hallucinations, ask it about events and trivia that happened eons ago, and also within the last decade. Try some things that it can not possibly know, like how much celery Brad Pitt likes in his salad.

Re: Llama 2

#216

Post by capableweb »

swyx wrote: post #69
rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

its not clear but can we also download the model with this Llama v2 Cog thing? EDIT: Meta is being extremely prompt, just got sent the download instructions https://twitter.com/swyx/status/1681351712718876673 also is it now Llama or LLaMA since the website says Llama? lol

Seems people here on HN were lucky. Signed up ~20 minutes ago and no download link, so surely they're doing some checking, it's not fully automated, unlike what others say here.

On Huggingface, the following disclaimer has been put in place:

> This is a form to enable access to Llama 2 on Hugging Face after you have been granted access from Meta. Please visit the [Meta website](https://ai.meta.com/resources/models-and-libraries/llama-dow...) and accept our license terms and acceptable use policy before submitting this form. Requests will be processed in 1-2 days

https://huggingface.co/meta-llama/Llama-2-70b-chat-hf/tree/m...

So seems it's a manual flow on their side to "accept" downloads.

Re: Llama 2

#217

Post by Oras »

rajko_rad wrote: post #18

Hey HN, we've released tools that make it easy to test LLaMa 2 and add it to your own app! Model playground here: https://llama2.ai Hosted chat API here: https://replicate.com/a16z-infra/llama13b-v2-chat If you want to just play with the model, llama2.ai is a very easy way to do it. So far, we’ve found the performance is similar to GPT-3.5 with far fewer parameters, especially for creative tasks and interactions. Dev…

Is it expected to be slow? Each request takes several seconds to reply.

Also how recent is the training data? When I asked what’s the date today? I received 22nd of March 2018.

Interesting choice of using streamlit for interface.

Re: Llama 2

#218

Post by DebtDeflation »

swyx wrote: post #177
msp26 wrote: post #72

Earlier quoted context omitted.

"We have also trained 34B variants, which we report on in this paper but are not releasing." "We are delaying the release of the 34B model due to a lack of time to sufficiently red team." From the Llama 2 paper

if you red team the 13b and the 70b and they pass, what is the danger of 34B being significantly more dangerous? edit: turns out I should RTFP. there was a ~2x spike in safety violations for 34B https://twitter.com/yacineMTB/status/1681358362057883680?s=2...

A 34B model is probably about the largest you can run on a consumer GPU with 24GB VRAM. 70B will require A100's or a cloud host. 13B models are everywhere already. I'm sure this was a very deliberate choice - let people play with the 13B model locally to whet their appetite and then they can pay to run the 70B model on Azure.

Re: Llama 2

#219

Post by unshavedyak »

ipaddr wrote: post #198
dicishxg wrote: post #146

Earlier quoted context omitted.

And yet here we are a few weeks after that with a free to use model that cost millions to develop and is open to everyone. I think you’re taking an unwarranted entitled view.

You act like this is a gift of charity instead of attempts to stay relevant.

The best charity is one that benefits both parties, no?

Re: Llama 2

#220

Post by shostack »

nicolashahn wrote: post #161

I asked llama2 why I should use it over chatgpt: " llama2 and chatgpt are both powerful language models, but they have some key differences that may make one more suitable for your needs than the other. llama2 is a more recent model, and it has been specifically designed for conversational AI tasks, such as answering questions and engaging in dialogue. It has been trained on a large dataset of text from the internet…

Any insights into recency of data? One of the big ChatGPT limitations is how old its dataset is which means it can't reference things that happened recently.
Post reply on HN