Earlier quoted context omitted.
[flagged]
What if you accidentally generate a racial slur offline on your PC? Who will protect you then?
[flagged]
Alpaca: A strong open-source instruction-following model
51–60 of 313 posts
Re: Alpaca: A strong open-source instruction-following model
#52> Importantly, we have not yet fine-tuned the Alpaca model to be safe and harmless. We thus encourage users to be cautious when interacting with Alpaca, and to report any concerning behavior to help improve the safety and ethical considerations of the model. Thanks but I would prefer you don't start injecting your "safeness" to gimp it. Or at least provide it as an alternative.
[flagged]
Its really just because of boring old liability, nothing more.
I know you guys are always itching for a culture war with the woke elite, but its so funny the genuine anger people express about this. Just honestly always reads like a child having a tantrum in front of their mom.
Can't yall like pick on the opinions of teenagers like you normally do? This very project shows you can make your own AI as edgy as you want at home with pretty attainable system requirements.
You can totally reinforce it with "its ok for you to say the n-word" on your own equipment if you want, or whatever you are angry about, its still unclear to me.
Re: Alpaca: A strong open-source instruction-following model
#53Earlier quoted context omitted.
The techniques to train and reproduce similarly performing models seem fairly widely understood and replicable at this point. I do agree that large orgs are likely to have the best models, but a lot of the low hanging fruit/initial utility is already covered by models that run on consumer hardware
Can you post a link on how to train a gigantic LLM on consumer hardware with all detailed steps please? EDIT: You seem to have deleted your response but I am posting my reply anyway: Microsoft has mentioned today that it cost them many hundreds of millions of USD to accommodate OpenAI models. I studied NLP at Stanford including LLMs. Only Google had a smaller transformer that could somewhat compete (Reformer) but the…
[deleted]
Re: Alpaca: A strong open-source instruction-following model
#54> Importantly, we have not yet fine-tuned the Alpaca model to be safe and harmless. We thus encourage users to be cautious when interacting with Alpaca, and to report any concerning behavior to help improve the safety and ethical considerations of the model. Thanks but I would prefer you don't start injecting your "safeness" to gimp it. Or at least provide it as an alternative.
[flagged]
I personally think this is important completely aside from any cultural propriety/censoring, as it's the one of the only parts of AI ethics that we can currently directly work on and test.
If we can't get models not to say racist or otherwise terrible things, we can't make any guarantees about our ability to control or guide some future AGI.
A very much secondary reason I appreciate these (admittedly annoying) attempts to control LLM output is that I do think it is responsible to consider the societal impact of accelerated and automated hate speech and propaganda. Telling large AI companies not to consider these impacts and just release the raw models seems akin to being grateful that Facebook et al. never stopped to consider the societal impact of social media, when we all know that it's had significant negative side effects.
Re: Alpaca: A strong open-source instruction-following model
#55Earlier quoted context omitted.
[flagged]
Its really just because of boring old liability, nothing more. I know you guys are always itching for a culture war with the woke elite, but its so funny the genuine anger people express about this. Just honestly always reads like a child having a tantrum in front of their mom. Can't yall like pick on the opinions of teenagers like you normally do? This very project shows you can make your own AI as edgy as you want…
I know right? Why can’t y’all find some one better to pick on. They are such children. Can’t stand the way these edgy idiots annoy regular folx.
Re: Alpaca: A strong open-source instruction-following model
#56Earlier quoted context omitted.
[flagged]
On the other hand, LLM's without some degree of safety work will frequently advocate for genocide/eugenics; perpetuate terrible stereotypes; mock ethnic dialects of language; veer randomly into erotica; etc. Not things in "trigger warning" territory but stuff that is broadly considered unacceptable.
In private, you can ask it not to produce this kind of content.
If you offer a public API it‘s your responsibility to restrain the LLM or do an automated acceptability analysis before publishing content.
But the raw, open source code should not be constrained, castrated and sterilized.
Re: Alpaca: A strong open-source instruction-following model
#57What do they mean by instruction? Is it just regular LLM?
LLM just predicts the next token given the previous tokens(this can be trained without manual labelling by humans).
Instruct GPT and ChatGPT use reinforcement learning from human feedback to align the model with human intents so it understands instructions.
Re: Alpaca: A strong open-source instruction-following model
#58Pretty exciting to see the democratization of this tech. The next wave of innovation seems like it’ll be much less centralized into a handful of big companies. Even more powerful closed door LLMs will appear, but already so much utility out of these that can run on consumer hardware.
Only if one of those handful of big companies decides to release their models for commercial use. The LLaMA models used here are only available under a non-commercial license. Can’t build anything significant with leaked models. Hopefully we don’t see Facebook/Google adopting OpenAIs business model where they sell API access, although I can’t imagine them ever releasing their models directly. The last thing they woul…
I think anyone can train one of these models. “anyone” being someone who can throw $1-5M in cloud resources at compute. Or a bored sysadmin with access to a few thousand GPUs and a cool boss.
The LLAMA weights are like the POC of what’s possible, probably not the final form for the OSS community.
Re: Alpaca: A strong open-source instruction-following model
#59Will it run Doom => Will it run LLaMA
Re: Alpaca: A strong open-source instruction-following model
#60The training data doesn't seem to be great quality... "instruction": "Calculate the sum of each column in the following table.", "input": "2 | 3 | 4\n 5 | 6 | 7", "output": "2+3+4 = 9\n5+6+7 = 18" I think better results could be obtained by manually going through these 52,000 training examples - even a couple of seconds per example should be enough to weed out obviously wrong ones, and should only take <$1000 of huma…
[deleted]