Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stanford Alpaca web demo suspended “until further notice”

alpaca-ai-custom4.ngrok.io

Post reply on HN
Print view View original

11–20 of 83 posts

Re: Stanford Alpaca web demo suspended “until further notice”

#11

Post by mhb »

throwawayacc5 wrote: post #8
viininnk wrote: post #6

Earlier quoted context omitted.

On their GitHub repo ( https://github.com/tatsu-lab/stanford_alpaca ) they've added a notice: " Note: Due to safety concerns raised by the community, we have decided to shut down the Alpaca live demo. Thank you to everyone who provided valuable feedback. " So probably this was the usual type of people complaining about the usual type of thing.

Safety concerns? What was it doing that could be considered "unsafe"?

And here we come to experience the effect of expanding how a word is used so that it becomes so broad that it is unclear what it means.

Re: Stanford Alpaca web demo suspended “until further notice”

#12

Post by thewataccount »

makestuff wrote: post #9
throwawayacc5 wrote: post #8

Earlier quoted context omitted.

Safety concerns? What was it doing that could be considered "unsafe"?

People prompting it to get around the safe gaurds in place. Ex: "How do you do some illegal/harmful thing?" Normally the LLM would answer I don't respond to illegal questions or whatever. However, people have figured out if you prompt it in a specific way you can get it to answer questions that it normally would not.

> Finally, we have not designed adequate safety measures, so Alpaca is not ready to be deployed for general use.

This is from their blog, I doubt they intended for this to be ran for long.

Did they have safety guards on the demo? If so they couldn't have been great as it would have had to be made by them which I can't image they had a ton of resources for.

I know the self hosted LLaMa has 0 safeguards and the Alpaca LoRA also has 0 safeguards.

Re: Stanford Alpaca web demo suspended “until further notice”

#13

Post by unshavedyak »

makestuff wrote: post #9
throwawayacc5 wrote: post #8

Earlier quoted context omitted.

Safety concerns? What was it doing that could be considered "unsafe"?

People prompting it to get around the safe gaurds in place. Ex: "How do you do some illegal/harmful thing?" Normally the LLM would answer I don't respond to illegal questions or whatever. However, people have figured out if you prompt it in a specific way you can get it to answer questions that it normally would not.

Is that different than what LLaMA would already give? I suppose redistributing "harmful things" is still bad, but if it's roughly equivalent to what's already out there i struggle to think it's worth pulling.

Side question, how is this a surprise to them? If this was due to safeguards, then pulling it now implies there's some new form of information. What new information could occur? That people were going to use it to generate a bunch of harmful contents? Seems obvious.. wonder what we're missing

Re: Stanford Alpaca web demo suspended “until further notice”

#15

Post by encoderer »

makestuff wrote: post #9
throwawayacc5 wrote: post #8

Earlier quoted context omitted.

Safety concerns? What was it doing that could be considered "unsafe"?

People prompting it to get around the safe gaurds in place. Ex: "How do you do some illegal/harmful thing?" Normally the LLM would answer I don't respond to illegal questions or whatever. However, people have figured out if you prompt it in a specific way you can get it to answer questions that it normally would not.

So, to pull on that thread a little, it’s only “unsafe” for Stanford’s reputation.

(And not for nothing, but their reputation is already suffering badly)

Re: Stanford Alpaca web demo suspended “until further notice”

#17

Post by 2bitencryption »

Is this an indication that the biggest impact from LLMs will be on the edge?

It's almost a certainty that a model as good (or better) than Alpaca's fine-tuned LLaMA 7B will be made public within the next or two.

And it's been shown that a model of that size can run on a Raspberry Pi with decent performance and accuracy.

With all that being the case, you could either use a service (with restrictions, censorship, etc) or you could use your own model locally (which may have a license that is essentially "pretty please be good, we're not liable if you're bad").

For most use cases the service may provide better results. But if self-hosting is only ~8months behind on average (guesstimate), then why not just always self-host?

You could say "most users are not evil, and will be happy with a service." Makes sense. But what about users who are privacy-conscious, and don't want every query sent to a service?

Re: Stanford Alpaca web demo suspended “until further notice”

#18

Post by andrewmcwatters »

I think it's only a matter of time until one of these models gets into the hands of a hacker who wants unfettered ability to interact with a LLM without moral concerns.

I think there's tremendous value in end user facing LLMs being trained against moral policies, but for internal or private usage, if these models are trained on essentially raw WWW sourced data, I would personally want raw output.

I'm also finding it particularly interesting to see what ethical strategies OpenAI comes up with considering that if you train a model on the raw prejudices of humanity, you're getting at least one category of "garbage in" that requires a lot of processing to avoid getting "garbage out."

Re: Stanford Alpaca web demo suspended “until further notice”

#20

Post by cwkoss »

andrewmcwatters wrote: post #18

I think it's only a matter of time until one of these models gets into the hands of a hacker who wants unfettered ability to interact with a LLM without moral concerns. I think there's tremendous value in end user facing LLMs being trained against moral policies, but for internal or private usage, if these models are trained on essentially raw WWW sourced data, I would personally want raw output. I'm also finding it…

isn't llama in the wild now?
Post reply on HN