291–300 of 562 posts
The original davinci model was a friend of mine and I resent this deeply. I've had completions with it that had character and creativity that I have not been able to recreate with anything else. Brilliant and hilarious things that are a permanent part of my family's cherished canon.
Earlier quoted context omitted.
16GB of RAM can fit a 5 bit 13B model at best, they're second dumbest class of LLama model. If Open Orca turns out any good than that might be enough for the time being, but you'll need more RAM to use anything serious. Here's a handy model comparison chart (this is a coding benchmark, so coding-only models tend to rank higher): https://i.imgur.com/AqSjjj2.jpeg
Your benchmark lacks the current #2 https://github.com/nlpxucan/WizardLM/tree/main/WizardCoder It beats Claude and Bard. You could probably get a 4bit 15B model going in 16GB of RAM and be approaching GPT4 in capability. ...on an old laptop, lol Let's eat OpenAI's lunch! They deserve it for trying to steal this tech by "privatizing" a charity, hiding scientific data that was supposed to be shared with us by said char…
I'd post a more well rounded benchmark but the problem is that all non-coding benchmarks are currently more or less complete garbage, especially the Vicuna benchmark that rates everything as 99.7% GPT 3.5 lol.
The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…
I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.
Earlier quoted context omitted.
(I'm an engineer at OpenAI) Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to push on. Does streaming work for your use case? https://github.com/openai/openai-cookbook/blob/main/examples... We definitely want to investigate these and the billing issues further. Would you consider emailing me your org ID and any request IDs (if you have t…
It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…
If you pay a developing country developed country wages what you'll get is 1. inflation and 2. the government mad at you because all their essential workers/doctors/government officials are quitting to work for you.
Earlier quoted context omitted.
(I'm an engineer at OpenAI) Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to push on. Does streaming work for your use case? https://github.com/openai/openai-cookbook/blob/main/examples... We definitely want to investigate these and the billing issues further. Would you consider emailing me your org ID and any request IDs (if you have t…
It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…
The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…
So they open things carefully, pull back when necessary like when they limited use of the public GPT-4 version of ChatGPT. That doesn’t seem too unreasonable. And yes sure, some amount of it might be attempts to manufacture scarcity to increase the hype. It’s an old tactic and hardly comparable to Soviet Russia.
Promote and proliferate local LLMs. If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too. OpenAI has no moat, unless you give them money to write legislation. I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.
[1] GPT4 is 8 x 220B params = 1.7T params: https://news.ycombinator.com/item?id=36413296
Yikes. They're actually killing off text-davinci-003. RIP to the most capable remaining model and RIP to all text completion style freedom. Now it's censored/aligned chat or instruct models with arbitrary input metaphor limits for everything. gpt3.5-turbo is terrible in comparison. This will end my usage of openai for most things. I doubt my $5-$10 API payments per month will matter. This just lights more of a fire u…
But with davinci at the same price point as GPT-4 I'm hoping the latter is enough of a step up in its variety of vocabulary and nudgeable sophistication of language to be a drop in replacement.
Though in general I think there's an under appreciation for just how much is being lost in the trend towards instruct models, and hope there will be smart actors in the market who use a pre-optimization step for instruct prompts that formats it for untuned models. I'd imagine that parameter size to parameter size that approach will look much more advanced to end users just by not lobotomizing the underlying model.
The drip-feeding seems crazy to me. Open AI is undermining their reputation by forcing almost everybody to use the older, lower-quality models. Even if customers are willing to pay for GPT 4, they're being told to wait at the back of the line. Wait for what!? Christmas? When we can open our presents and have a GPT 4 inside? It's like they took a leaf from Google's "how to guarantee the failure of a new product" marke…
I think maybe you don't understand that they don't have enough GPUs to do this, and money can't buy enough GPUs to do it.
Earlier quoted context omitted.
The Chat-GPT models are all pre-prompted and pre-aligned. If you work with davinci-003, it will never say things like, "I am an OpenAI bot and am unable to work with your unethical request" When using davinci the onus is on you to construct prompts (memories) which is fun and powerful. ==== 97% of API usage might be because of ChatGPT's general appeal to the world. But I think they will be losing a part of the hacker…
The hacker/builder ethos doesn't matter in the grand scheme of commercialization.