Live data from Hacker News

Hello Dolly: Democratizing the magic of ChatGPT with open models

databricks.com

141–150 of 194 posts

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#141
post #133

Earlier quoted context omitted.

I think all of the "AI alignment" talk is mostly fearmongering. It's a cunningly smart way to get ignorant people scared enough of AI so they have no choice but to trust the OpenAI overlords when they say they need AI to be closed. Then OpenAI gets a free pass to be the gatekeeper of the model, and people stop questioning the fact that they went from Open to Closed. AI being tuned to be "safe" by an exceedingly small…

I don't know what press releases you've been reading, but the model is closed so they can make money off it, that's pretty obvious.

I think that is a simple take and underestimates the insidious nature of the AI alignment initiatives. Or maybe I'm overestimating it.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#142
post #133

Earlier quoted context omitted.

I think all of the "AI alignment" talk is mostly fearmongering. It's a cunningly smart way to get ignorant people scared enough of AI so they have no choice but to trust the OpenAI overlords when they say they need AI to be closed. Then OpenAI gets a free pass to be the gatekeeper of the model, and people stop questioning the fact that they went from Open to Closed. AI being tuned to be "safe" by an exceedingly small…

I don't know what press releases you've been reading, but the model is closed so they can make money off it, that's pretty obvious.

At this point I'm really not sure what they're up to in terms of grand strategy. I don't even know that making money is their ultimate goal. At a certain level of ambition money is just a tool to get what you really want.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#143
post #105
post #103

Does anyone else find it ironic that all these ChatGPT "clones" are popping up when OpenAi is supposed to be the ones open sourcing and sharing their work? I guess: "You Either Die A Hero, Or You Live Long Enough To See Yourself Become The Villain"?

Sam Altman has turned into a megalomaniac.

Possibly, but it is a bit unusual that he has zero equity in the company. So it might not be for monetary reasons.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#144
post #133

Earlier quoted context omitted.

I don't know what press releases you've been reading, but the model is closed so they can make money off it, that's pretty obvious.

At this point I'm really not sure what they're up to in terms of grand strategy. I don't even know that making money is their ultimate goal. At a certain level of ambition money is just a tool to get what you really want.

It's interesting to note that Altman has no equity in the company. One of the primary motives of being a for-profit company that was espoused was to be competitive with big-tech AFA bringing in top-level research talent.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#146
post #57

Earlier quoted context omitted.

We don' have the details, it is true. But empirically and based on their report gpt-4 is notably better than chatgpt.

Better, yes, and for that we have evidence. But is the improvement stemming simply from even more data? That's what I'm questioning.

This paper is pretty approachable and goes over the "scaling laws" in detail: https://arxiv.org/abs/2206.07682

In short, yes. More data, higher quality data, more epochs on the data. That is the name of the game.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#147

I might be having a moment - but I can't find any links to a git repo, huggingface, or anything about the models/weights/checkpoints directly from the article. I just see a zip download that AFAIK also doesn't contain the weights/checkpoints. I find this a bit odd, the contents of the zip (from the gdrive preview) look like they should be in a git repo, and I assume they download the model from somewhere? GDrive usua…

Databricks is on a roll

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#148

Earlier quoted context omitted.

I think their TOS forbids using the API for this. I don't think it covers the use of the web interface.

However: "You may not [...] except as permitted through the API, use any automated or programmatic method to extract data or output from the Services, including scraping, web harvesting, or web data extraction;"

Can’t be automated, so manual extraction is allowed.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#149

Earlier quoted context omitted.

At this point I'm really not sure what they're up to in terms of grand strategy. I don't even know that making money is their ultimate goal. At a certain level of ambition money is just a tool to get what you really want.

It's interesting to note that Altman has no equity in the company. One of the primary motives of being a for-profit company that was espoused was to be competitive with big-tech AFA bringing in top-level research talent.

I don't think that Altman's lack of equity position in OpenAI means anything at all when it comes to what OpenAI's goals are.

We know what their immediate goals are: to make as much money as possible. The only question is what their longer-term goals are.

Re: Hello Dolly: Democratizing the magic of ChatGPT with open models

#150

I might be having a moment - but I can't find any links to a git repo, huggingface, or anything about the models/weights/checkpoints directly from the article. I just see a zip download that AFAIK also doesn't contain the weights/checkpoints. I find this a bit odd, the contents of the zip (from the gdrive preview) look like they should be in a git repo, and I assume they download the model from somewhere? GDrive usua…

So it’s another classic private only model that they’ll pull as soon as the suckers have trained it up for them
Post reply on HN