Live data from Hacker News

Hello Dolly: Democratizing the magic of ChatGPT with open models

databricks.com

31–40 of 194 posts

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#31
post #4

This is really great news and something I felt was missing from the market so far. It seems everyone wants to create `moats` or walled-gardens with some aspect of their models etc. Nice job DataBricks, nice numbers too. Looking forward to more improvements.

Thought the same until I read this: > Contact us at hello-dolly@databricks.com if you would like to get access to the trained weights.

This is not an issue though, they would just be the weights used by DataBricks, there is no reason you can't add your own right ?

Like giving away a website template without the demo content, it's perfectly normal.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#32
post #17
post #12

Earlier quoted context omitted.

So, this is a "dirty" model, in that is was created by data which violated OpenAI ToS. Obviously, this kind of violation is basically fine if you're a massive corporation who the rules don't apply to, but it's a huge risk if you're a small fish.

ToS are not the law. It would be similar to your power company claiming copyright over the code written using "their" electricity. Not going to happen. I wouldn't be too concerned.

Especially when OpenAI explicitly doesn't have a claim to copyright on the model output.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#33

Interesting. DALL-E, Dalai ( https://cocktailpeanut.github.io/dalai/ ), and now Dolly are all pronounced the same way. It feels like there should be an xkcd for this.

AFAIK DALL-E is pronounced as Dalí, as in Salvador Dalí. https://en.wikipedia.org/wiki/Salvador_Dal%C3%AD

Handy also to think off WALL-E. At least that where my assumption came from.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#34
post #15

This is the real risk to OpenAI's business model. If it turns out that you can get most of the same outcome with drastically smaller and cheaper models, then OpenAI is going to have a hell of a time keeping customers around as it will just be a race to the bottom on price and bigger, more expensive models will lose just from a hardware cost standpoint.

On the flip-side, OpenAI is primed to destroy their competitors. Partnership with Microsoft means they can buy Azure compute at-cost if need be. Their current portfolio of models is diverse on the expensive and cheap ends of the spectrum, with thousands of people on Twitter and HN still giving them lip-service. With dozens of clones hitting the market, OpenAI is the only one staying consistently relevant.

The widespread adoption of local AI won't obsolete a well-priced AI API. I feel like we learned that lesson pretty thoroughly in the SaaS era.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#35
I’d like some clarification of terms - when they say it takes 3 hours to train, they’re not saying from scratch are they? There’s already a huge amount of training to get to that point, isn’t that correct? If so, then it’s pretty audacious to claim they’ve democratized an LLM because the original training likely cost an epic amount of money. Then who knows how much guidance their training has incorporated, and it could have a strong undesirable viewpoint bias based on the original training.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#36
post #30
post #16

Earlier quoted context omitted.

What about the high quality training data that OpenAI has encoded into ChatGPT? Do these other models come close to that?

Why couldn't you just use OpenAI's API to feed prompts and then take the outputs and use them to train your own model to exfiltrate the best features of GPT?

Because it would be against their TOS, and things could look ugly, legally.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#38
post #30

Earlier quoted context omitted.

Why couldn't you just use OpenAI's API to feed prompts and then take the outputs and use them to train your own model to exfiltrate the best features of GPT?

Because it would be against their TOS, and things could look ugly, legally.

It's still an open question if any of these models, trained on copyright work, will themselves be eligible for copyright protection.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#39
post #15

This is the real risk to OpenAI's business model. If it turns out that you can get most of the same outcome with drastically smaller and cheaper models, then OpenAI is going to have a hell of a time keeping customers around as it will just be a race to the bottom on price and bigger, more expensive models will lose just from a hardware cost standpoint.

No disrespect to the author intended, but the above comment is muddled.

1. OpenAI, the organization, is not equivalent to its chat offering.

2. Saying "the" real risk isn't persuasive. Let's examine many risks before claiming one is the most significant. Also, "real" is this usage often a throwaway (i.e. unneeded) word, in editor speak.

3. Let's talk about OpenAI's "business model" (though such discussions are tricky).

3A. Originally, OpenAI wasn't trying to "hold onto" AI advancements. It claimed to be a broadly funded way to explore fundamental questions of artificial intelligence in a non-commercial, ethical way.

3B. Of course, the above claim was largely aspirational, because it wasn't baked into their DNA in way that could survive the surrounding temptations for more funding, glory, and resources.

3C. Even with their more commercialized model of the last several years, it seems their business model feels like (a) fundraise in exchange for (b) (claimed) collective good open source, tools and shared research.

3D. OpenAI feels to me more and more like a commercial research lab; there does seem to be a lot of commercial partnering with their funding organizations (e.g. Microsoft).

4. I doubt the leadership there views the current ChatGPT models as unchanging. I expect there is a considerable revenue stream around the space. OpenAI is well positioned to play the game several steps ahead of others.

I would frame the broader question this way: for many years, there has been a hunger for this deeper AI research, due not only to (i) the expertise and resources required, but also (ii) to this hope that there is an organization that can maybe keep it within human or ethical bounds.

Unfortunately, this amorphous hope doesn't seem to be matching the actual organizational incentives nor dynamics. It is also unclear how much demand the public in free market will have for nobler research.

My position on these kinds of things is simple: follow the money. If we want an accountable public interest, AI research laboratory it's going to have to be designed, funded, and overseen very differently.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#40

I might be having a moment - but I can't find any links to a git repo, huggingface, or anything about the models/weights/checkpoints directly from the article. I just see a zip download that AFAIK also doesn't contain the weights/checkpoints. I find this a bit odd, the contents of the zip (from the gdrive preview) look like they should be in a git repo, and I assume they download the model from somewhere? GDrive usua…

Yes, the ZIP on Google Drive owned by one of their engineers is weird considering they have a pretty active GitHub presence of open source projects, though it does use an Apache license like their others.

Perhaps Databricks suspected another big announcement coming soon and wanted to get this announcement out?

Post reply on HN