Live data from Hacker News

The genie escapes: Stanford copies the ChatGPT AI for less than $600

newatlas.com

1–10 of 173 posts

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#5
post #2

Given the high prices of OpenAI offerings it seems it’s better to pirate an AI model before resorting to paying for anything.

ChatGPT API is surprisingly cheap, but GPT-4 is many times more expensive to the point where I can't see it being worth it most of the time.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#7
post #2

Given the high prices of OpenAI offerings it seems it’s better to pirate an AI model before resorting to paying for anything.

The world is becoming more cyberpunk everyday, people making back alley deals for data or models.

These weights are shit man, they have been quanted w/o being retrained against the original. I already have this torrent, I want uncut originals. And no water marks this time, the last model wouldn't shutup about investing in tulips.

Re: The genie escapes: Stanford copies the ChatGPT AI for less than $600

#8
Hardly. I've played a lot with the 7,13, and 30B llamas as well as the 7 and 13B alpacas fine tuned by Stanford. They do not have emergent abilities like being able to generate rhymes or, say, represent a movie plot as emoji. Even openai's old text-davinci-003 (gpt3.5, but text completion, not the chat ones) far outperforms them. That said, I have hopes for a 65B 3-bit quantized alpaca-fine tuned. We'll see when someone spends the money to do the (more costly) 65B training. The alpacas are also much more likely to go off rails and start regurgitating their fine-tuning inputs. Either that or openai is doing a lot of post processing on their end to hide the same problems in their LLM.

For now my IRC bots run the alpaca 7B 4-bit. 13B was not a significant improvement for twice the computational time. But it's best to learn them now because as soon as openai gets sued for the first time all the turing test passing older models without the legal-butt-covering bolted on will be removed.

Post reply on HN