Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hello Dolly: Democratizing the magic of ChatGPT with open models

databricks.com

Post reply on HN
Print view View original

91–100 of 194 posts

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#91

Post by pwendell »

Mizza wrote: post #3

It's immediately become difficult to untangle the licensing here. Is this safe for production use - I have no idea if I can expect a DMCA from Mark if I step out of bounds with this or other post-Alpaca models, unless I'm missing something important. Meta really botched the Llama release.

Yes it's nuanced, but will be simplified going forward.

This uses a fully open source (liberally licensed) model and we also open sourced (liberally licensed) our own training code. However, the uptraining dataset of ~50,000 samples was generated with OpenAI's text-davinci-003 model, and depending on how one interprets their terms, commercial use of the resulting model may violate the OpenAI terms of use. For that reason we are advising only noncommercial use of this model for now.

The next step here is to create a set of uptraining samples that is 100% open. Stay tuned.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#92

Post by babyyoda »

Mizza wrote: post #3

It's immediately become difficult to untangle the licensing here. Is this safe for production use - I have no idea if I can expect a DMCA from Mark if I step out of bounds with this or other post-Alpaca models, unless I'm missing something important. Meta really botched the Llama release.

Given that Alpaca strictly specified that they released purely for academic use and any commercial use was prohibited given doing so would violate terms of service, I don’t see this as viable for use. Looks like marketing gimmick

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#94

Post by thewataccount »

pwendell wrote: post #88
thewataccount wrote: post #27

I might be having a moment - but I can't find any links to a git repo, huggingface, or anything about the models/weights/checkpoints directly from the article. I just see a zip download that AFAIK also doesn't contain the weights/checkpoints. I find this a bit odd, the contents of the zip (from the gdrive preview) look like they should be in a git repo, and I assume they download the model from somewhere? GDrive usua…

Full source code is up here now: https://github.com/databrickslabs/dolly Sorry it took us a day to get the external repo setup.

Awesome thank you!

Was the Alpaca dataset being licensed as non-commercial only the reason you aren't releasing the weights? Is it possible to just release them under the same license?

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#95

Post by amrb »

dragonwriter wrote: post #76
amrb wrote: post #63

Earlier quoted context omitted.

Are they pulling a Facebook, on model access?

I think they are dodging unclear legal issues surrounding certain steps of the model-building process while being as open as possible with the components given that constraint, allowing downstream users to make their own legal risk vs. effort choices.

Given the hardware/energy need to train it be nice, to have a legal document that said something like this model has no warranty, it may be a break through machine or a hand grenade. Use at you own risk!

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#96

Post by stevenhuang »

feanaro wrote: post #57
computerex wrote: post #52

Earlier quoted context omitted.

We don' have the details, it is true. But empirically and based on their report gpt-4 is notably better than chatgpt.

Better, yes, and for that we have evidence. But is the improvement stemming simply from even more data? That's what I'm questioning.

It's speculated it has same number of parameters, but more compute and is multi modal.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#97

Post by feanaro »

typon wrote: post #56
feanaro wrote: post #47

Earlier quoted context omitted.

Isn't it the case that we literally have no clue how GPT4 and GPT3.5 are different in terms of training, given OpenAI doesn't want to disclose anything at all?

It's not true we know nothing. We know a little bit by using the two models from their API. Given the time per inference and the limit on messages per day for GPT4, I'm willing to bet it's doing around 10x more compute than GPT3.5. If that's because it has 10x more weights, I don't know. But it wouldn't be a terrible guess.

So your estimate is that GPT4 has 1.75 trillion weights?

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#98

Post by dwaltrip »

typon wrote: post #56
feanaro wrote: post #47

Earlier quoted context omitted.

Isn't it the case that we literally have no clue how GPT4 and GPT3.5 are different in terms of training, given OpenAI doesn't want to disclose anything at all?

It's not true we know nothing. We know a little bit by using the two models from their API. Given the time per inference and the limit on messages per day for GPT4, I'm willing to bet it's doing around 10x more compute than GPT3.5. If that's because it has 10x more weights, I don't know. But it wouldn't be a terrible guess.

Is there anything that affects inference compute time besides the number of parameters? Assuming same hardware, etc.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#99

Post by aabajian »

Anyone care to comment on why the output of these models changes so dramatically given so little Q&A training? It's a 6 billion parameter model with only 50 thousand Q&A samples.

It's clear the model already "knows" the format of a Tweet (short length, attention-grabbing, contains hashtags). The model also knows stuff about language models (word2vec, tokenization), and can include entities from the question in its response (Dolly, Databricks). Yet, it just doesn't put these pieces together in the right way without the Q&A training.

Edit: For kicks, I asked GPT-4 this question: https://imgur.com/a/sM4uyBn

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#100

Post by gowld »

theSuda wrote: post #87
rockzom wrote: post #58

Earlier quoted context omitted.

How do you say Khan?

I found this which matches how I say it (as an Indian) https://www.howtopronounce.com/khan/4145893 It's the KH sound that doesn't really exist in English hence many get it wrong.

The KH is one thing, but for "con"-fusion (hah!), it's also about the "higher" "caan" vs "cawn", which is a very subtle difference.
Post reply on HN