Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The genie escapes: Stanford copies the ChatGPT AI for less than $600

newatlas.com

Post reply on HN
Print view View original

61–70 of 173 posts

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#61

Post by DustinBrett »

braingenious wrote: post #30

I have not found alpaca to be comparable to chatgpt, but it could be because of bugs in the version I installed through dalai. I might try reinstalling it because I suspect there might be some sort of file corruption issue or whatever. I gave it the prompt “cats aren’t always fuzzy” and it wrote a lengthy livejournal-esque rambling journal entry about a woman and her husband having money issues. It was funny, but lig…

I also got that text about the married couple and their money issues. Alpaca didn't impress me at all so far.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#62

Post by layer8 »

crooked-v wrote: post #48
layer8 wrote: post #40

Earlier quoted context omitted.

Running isn’t necessarily the issue. The moat is creating a high-quality model like OpenAI has, which (and here the article is mistaken) doesn’t seem to be easily reproducible.

While that's true, it also seems entirely predictable at this point how to do that. It takes a lot of effort and expensive hardware, but there isn't really a "secret sauce" beyond expertise in the field.

Yes, but it takes time (took OpenAI years) and significant effort. Who with enough expertise will do this and not keep the results closed in order to monetize them? It doesn’t seem like something an open source project could accomplish quickly enough to not keep lagging substantially behind the commercial solutions.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#63

Post by jakedata »

AI bootstrapping AI is a sci-fi trope that goes back decades. I first encountered it in The Cybernetic Samurai while in high school. While the details differ, the reality is that AI is a catalyst for more of itself.

I don't remember many books where this ends particularly well. Perhaps the Culture universe could be a survivable outcome. Hopefully we don't get Berzerkers first.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#64

Post by jazzyjackson »

pram wrote: post #58
crooked-v wrote: post #23

Earlier quoted context omitted.

For me the easiest comparison between models is to give it an absurd but entirely possible request, like "Write me a fanfic where the Animorphs battle the truck from Duel, but in the style of Mark Twain". So far nothing else I've tried has done even as well as GPT 3.5 yet, let alone GPT 4.

How exactly do you get it to keep going? Every time I try a prompt like this in the playground it spits out a couple paragraphs and then refuses to generate anything further, even with tokens maxed out.

I never used the OpenAI playground, see if Poe.com will work for you. They give free access to GPT3.5 and Claude, Antrhopic AIs competitor. Paid subscription for GPT4 and Claude+

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#65

Post by sharedfrog »

pram wrote: post #58
crooked-v wrote: post #23

Earlier quoted context omitted.

For me the easiest comparison between models is to give it an absurd but entirely possible request, like "Write me a fanfic where the Animorphs battle the truck from Duel, but in the style of Mark Twain". So far nothing else I've tried has done even as well as GPT 3.5 yet, let alone GPT 4.

How exactly do you get it to keep going? Every time I try a prompt like this in the playground it spits out a couple paragraphs and then refuses to generate anything further, even with tokens maxed out.

Simply telling it "continue" has worked for me.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#66

Post by disgruntledphd2 »

DustinBrett wrote: post #61
braingenious wrote: post #30

I have not found alpaca to be comparable to chatgpt, but it could be because of bugs in the version I installed through dalai. I might try reinstalling it because I suspect there might be some sort of file corruption issue or whatever. I gave it the prompt “cats aren’t always fuzzy” and it wrote a lengthy livejournal-esque rambling journal entry about a woman and her husband having money issues. It was funny, but lig…

I also got that text about the married couple and their money issues. Alpaca didn't impress me at all so far.

Alpaca wasn't great. The 13b and 30b models are much better, but just for sentence completion.

Personally, I think that the RLHF does make a big difference but maybe it's a bug in the quantization code as suggested up thread.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#67

Post by crooked-v »

sharedfrog wrote: post #65
pram wrote: post #58

Earlier quoted context omitted.

How exactly do you get it to keep going? Every time I try a prompt like this in the playground it spits out a couple paragraphs and then refuses to generate anything further, even with tokens maxed out.

Simply telling it "continue" has worked for me.

You can also tell it "Continue, but with (...)" to fine-tune the output further, or "Tell that again, but with (...)" to adjust the previous response.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#68

Post by drowsspa »

layer8 wrote: post #40
crooked-v wrote: post #33

Earlier quoted context omitted.

While that's true, it's basically inevitable now that at some point personal hardware will be powerful enough for enthusiasts to run home bots comparable to GPT-3, and even that by itself would drastically change a lot things.

Running isn’t necessarily the issue. The moat is creating a high-quality model like OpenAI has, which (and here the article is mistaken) doesn’t seem to be easily reproducible.

Sounds like IBM trusting no one would copy their BIOS code.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#69

Post by typon »

sharedfrog wrote: post #65
pram wrote: post #58

Earlier quoted context omitted.

How exactly do you get it to keep going? Every time I try a prompt like this in the playground it spits out a couple paragraphs and then refuses to generate anything further, even with tokens maxed out.

Simply telling it "continue" has worked for me.

I found that "continue exactly where you left off" will continue in a way that you expect it to more often.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#70

Post by gumby »

crooked-v wrote: post #23
superkuh wrote: post #8

Hardly. I've played a lot with the 7,13, and 30B llamas as well as the 7 and 13B alpacas fine tuned by Stanford. They do not have emergent abilities like being able to generate rhymes or, say, represent a movie plot as emoji. Even openai's old text-davinci-003 (gpt3.5, but text completion, not the chat ones) far outperforms them. That said, I have hopes for a 65B 3-bit quantized alpaca-fine tuned. We'll see when some…

For me the easiest comparison between models is to give it an absurd but entirely possible request, like "Write me a fanfic where the Animorphs battle the truck from Duel, but in the style of Mark Twain". So far nothing else I've tried has done even as well as GPT 3.5 yet, let alone GPT 4.

I couldn't do it either as I have no idea what Animorphs or Duel are.
Post reply on HN