Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Alpaca: A strong open-source instruction-following model

crfm.stanford.edu

Post reply on HN
Print view View original

111–120 of 313 posts

Re: Alpaca: A strong open-source instruction-following model

#111

Post by dang »

beepbooptheory wrote: post #97
nlowell wrote: post #80

Earlier quoted context omitted.

You're missing the point and willfully characterizing others as solely being concerned with making the AI's say slurs. That's not their concern. But you can win any imaginary argument you like.

My favorite kind of comment: allude to a bigger point the op misses, but don't actually say the point. I doubt I'm misrepresenting anybody. If its not slurs it's surely something about "wokeness." You are not yet mature enough for this future if any of this is your concern. The world is going to pass you by while you're just stuck saying "there are only two genders" to all your comrades. Don't let the politicians mob…

Please don't take HN threads further into ideological flamewar. It's not what this site is for, and we have to ban accounts that do it repeatedly.

If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it.

Re: Alpaca: A strong open-source instruction-following model

#112

Post by dang »

Traubenfuchs wrote: post #74
beepbooptheory wrote: post #65

Earlier quoted context omitted.

Its sarcastic but how are you literally not that person right now? Being angry at an invisible evil, not once opening your eyes to any other thought, totally incapable of making any real point except to whine... It's quite a good descriptor actually! I hope you can find a model for yourself that will assure you there are only two genders. Just to save the rest us from this childishness.

That's like telling someone who uses violence in self defense that he is now just as bad as the attackers he defended himself against. Like telling someone who shouts at people to turn down their music that, gotcha, now you were shouting too.

Please don't take HN threads further into ideological flamewar. It's not what this site is for, and we have to ban accounts that do it repeatedly.

If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it.

Re: Alpaca: A strong open-source instruction-following model

#113

Post by Tiberium »

freedmand wrote: post #64
redox99 wrote: post #29

They used OpenAI davinci to generate the dataset for instruction tuning. They mention one of the reasons this model is noncommercial is because OpenAI's terms of use prohibit developing models that compete with OpenAI. They also published the generated dataset. If one were to use this dataset to tune your own commercial model, would this be OK, or illegal? I would guess OpenAIs ToS no longer applies, as this is now A…

The instruction tuning dataset is only 52,000 rows. It shouldn't be too hard to crowdsource high-quality human answers to this many questions and retrain the model, nixing the dependency on OpenAI.

Such a thing already exists and there were some results - https://open-assistant.io

I'm not sure why the authors of Alpaca didn't try to train it on this dataset.

Re: Alpaca: A strong open-source instruction-following model

#114

Post by dang »

beepbooptheory wrote: post #65
Traubenfuchs wrote: post #51

Earlier quoted context omitted.

[flagged]

Its sarcastic but how are you literally not that person right now? Being angry at an invisible evil, not once opening your eyes to any other thought, totally incapable of making any real point except to whine... It's quite a good descriptor actually! I hope you can find a model for yourself that will assure you there are only two genders. Just to save the rest us from this childishness.

You've repeatedly posted flamewar comments in this thread. Please don't do that. It's not what this site is for, and destroys what it is for.

See also https://news.ycombinator.com/item?id=35141682.

Re: Alpaca: A strong open-source instruction-following model

#115

Post by ulnarkressty »

simonw wrote: post #28

This is why I think we're seeing a Stable Diffusion moment for LLMs: https://simonwillison.net/2023/Mar/11/llama/ Look at the timeline: 24th February 2023: LLaMA is announced, starts being shared with academic partners: https://research.facebook.com/publications/llama-open-and-ef... 2nd March: Someone posts a PR with a BitTorrent link to the models: https://github.com/facebookresearch/llama/pull/73 10th March: First…

I'm excited to see what the OpenAssistant crowd does with these models, they seem to have gathered the dataset to finetune them.

Lots of people use these models as talk therapy. We really need 1) standalone options, 2) reproducible weights with crowd sourced datasets to reduce biases (or at least know who you're talking to).

Re: Alpaca: A strong open-source instruction-following model

#116

Post by [deleted] »

Tiberium wrote: post #113
freedmand wrote: post #64

Earlier quoted context omitted.

The instruction tuning dataset is only 52,000 rows. It shouldn't be too hard to crowdsource high-quality human answers to this many questions and retrain the model, nixing the dependency on OpenAI.

Such a thing already exists and there were some results - https://open-assistant.io I'm not sure why the authors of Alpaca didn't try to train it on this dataset.

[deleted]

Re: Alpaca: A strong open-source instruction-following model

#117

Post by beepbooptheory »

dang wrote: post #111
beepbooptheory wrote: post #97

Earlier quoted context omitted.

My favorite kind of comment: allude to a bigger point the op misses, but don't actually say the point. I doubt I'm misrepresenting anybody. If its not slurs it's surely something about "wokeness." You are not yet mature enough for this future if any of this is your concern. The world is going to pass you by while you're just stuck saying "there are only two genders" to all your comrades. Don't let the politicians mob…

Please don't take HN threads further into ideological flamewar. It's not what this site is for, and we have to ban accounts that do it repeatedly. If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it.

Ah! Yes, sorry, this is fair Dang. Happy to die on this hill today, as it were, will do better in future though. cheers.

Re: Alpaca: A strong open-source instruction-following model

#118

Post by RcouF1uZ4gsC »

wkat4242 wrote: post #82
nickthegreek wrote: post #14

>We are waiting for huggingface to officially support the llama models (i.e. this PR to be merged) before we release a stable version of the finetuning code. Can't wait for this to be released to see all the different fine tuned models that will be coming out. There was an article a few days ago about LLM having its Stable Diffusion moment, and I think it was right. We went from LLama release > llama.cpp > Dalai and…

Yeah this whole industry seems to suddenly have moved from the pace of a pebble creek to a waterfall. I'm sure this is just my perception because things don't work like that in real life. Is it really just a ton of slowly developed things happening to mature close together?

> Is it really just a ton of slowly developed things happening to mature close together?

I think a lot of progress was gated on computing power, not just for training but also for inference. Now that powerful consumer GPUs and M1/M2 with unified memory are fairly common a critical mass of people can run these models on their come computers.

Re: Alpaca: A strong open-source instruction-following model

#119

Post by nlowell »

dang wrote: post #110
nlowell wrote: post #80

Earlier quoted context omitted.

You're missing the point and willfully characterizing others as solely being concerned with making the AI's say slurs. That's not their concern. But you can win any imaginary argument you like.

Please don't take HN threads further into ideological flamewar. It's not what this site is for, and we have to ban accounts that do it repeatedly. If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it.

Sorry if I made it worse, I really felt like people's opinions were being treated uncharitably, and I was trying to right it.
Post reply on HN