21–30 of 194 posts
Earlier quoted context omitted.
AFAIK DALL-E is pronounced as Dalí, as in Salvador Dalí. https://en.wikipedia.org/wiki/Salvador_Dal%C3%AD
I figured it was a reference to the Dalai Lama (which doesn't invalidate your comment, since that's also pronounced like Dalí). LLM -> Llama -> Dalai Lama
Earlier quoted context omitted.
Why? Dolly had nothing to do with Llama or its weights. Besides: How would anyone ever know which model generated the output you are serving? AFAIK there is no fingerprint in any model’s output. And even if there was, it would probably be destroyed by fine tuning “over it”.
> AFAIK there is no fingerprint in any model’s output. It seems like there easily could be. What if some of the data they trained it on didn't exist anywhere else except in the training set, and was put there specifically for this purpose? For instance they could have taught it a few poems that don't exist anywhere else. If you can coax the LLM of unknown origin into reciting those poems back to you, you know where i…
Earlier quoted context omitted.
AFAIK DALL-E is pronounced as Dalí, as in Salvador Dalí. https://en.wikipedia.org/wiki/Salvador_Dal%C3%AD
I figured it was a reference to the Dalai Lama (which doesn't invalidate your comment, since that's also pronounced like Dalí). LLM -> Llama -> Dalai Lama
Earlier quoted context omitted.
I figured it was a reference to the Dalai Lama (which doesn't invalidate your comment, since that's also pronounced like Dalí). LLM -> Llama -> Dalai Lama
I thought "Dalai" pronounced "Dall Eye" rhymes with "Shall I" "Dali" pronounced "Dahl eee" rhymes with "Carly"
This is really great news and something I felt was missing from the market so far. It seems everyone wants to create `moats` or walled-gardens with some aspect of their models etc. Nice job DataBricks, nice numbers too. Looking forward to more improvements.
> Contact us at hello-dolly@databricks.com if you would like to get access to the trained weights.
I just see a zip download that AFAIK also doesn't contain the weights/checkpoints. I find this a bit odd, the contents of the zip (from the gdrive preview) look like they should be in a git repo, and I assume they download the model from somewhere? GDrive usually has rate limits which I'm concerned about.
If anyone from databricks reads this - are there plans to publish this on a git repo somewhere, as well as the weights/checkpoints?
EDIT: Oh I just noticed
> Contact us at hello-dolly@databricks.com if you would like to get access to the trained weights.
This... seems odd for a article titled "Democratizing the magic of ChatGPT with open models"?
Earlier quoted context omitted.
> AFAIK there is no fingerprint in any model’s output. It seems like there easily could be. What if some of the data they trained it on didn't exist anywhere else except in the training set, and was put there specifically for this purpose? For instance they could have taught it a few poems that don't exist anywhere else. If you can coax the LLM of unknown origin into reciting those poems back to you, you know where i…
Even easier have a small set of 8-10 character gibberish tokens it's trained on in a particular contexts (eg a non-existent poem). Then feed it one or several poems and see if a gibberish token pops out.
Interesting. DALL-E, Dalai ( https://cocktailpeanut.github.io/dalai/ ), and now Dolly are all pronounced the same way. It feels like there should be an xkcd for this.
This is like when Khan Academy came out and there was a guy online saying it's a terrible brand because it sounds like Con Academy which it doesn't in my dialect.
Took a while to get it.
This is the real risk to OpenAI's business model. If it turns out that you can get most of the same outcome with drastically smaller and cheaper models, then OpenAI is going to have a hell of a time keeping customers around as it will just be a race to the bottom on price and bigger, more expensive models will lose just from a hardware cost standpoint.
What about the high quality training data that OpenAI has encoded into ChatGPT? Do these other models come close to that?