Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 API General Availability

openai.com

Post reply on HN
Print view View original

191–200 of 562 posts

Re: GPT-4 API General Availability

#191

Post by flangola7 »

w10-1 wrote: post #170
EnnioEvo wrote: post #10

Earlier quoted context omitted.

I have a startup of legal AI, the quality jump from GPT3.5 to GPT4 in this domain is straight mind-blowing, GPT3.5 in comparison is useless. But I see how in more conversational settings GPT3.5 can provide more appealing performance/price.

Legal writing is ideal training data: mostly formulaic, based on conventions and rules, well-formed and highly vetted, with much of the best in the public domain. Medical writing is the opposite, with unstated premises, semi-random associations, and rarely a meaningful sentence.

> Legal writing is ideal training data: mostly formulaic, based on conventions and rules, well-formed and highly vetted, with much of the best in the public domain.

That makes sense. The labor impact research suggests that law will be a domain hit almost as hard as education by language models. Almost nothing happens in court that hasn't occured hundreds of thousands of times before. A model with GPT-4 power specifically trained for legal matters and fine tuned by jurisdiction could replace everyone in a courtroom. Well there's still the bailiff, I think that's about 18 months behind.

Re: GPT-4 API General Availability

#192

Post by kossTKR »

esperent wrote: post #140
athyuttamre wrote: post #111

Earlier quoted context omitted.

(I'm an engineer at OpenAI) Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to push on. Does streaming work for your use case? https://github.com/openai/openai-cookbook/blob/main/examples... We definitely want to investigate these and the billing issues further. Would you consider emailing me your org ID and any request IDs (if you have t…

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…

Since chatGPT-4 is now useless for advanced coding because of their blackbox sudden nerfing, can anyone guess how long before i can run something similar to the orig version privately?

Is the newer 64B models up there? 1 year, 2 years? Can't wait until i get back the crazy quality of the orig model.

We need something open source fast. Thanks open-ai for giving us a glimpse of the crazy possibilities, too crazy for the public i guess.

Re: GPT-4 API General Availability

#193

Post by claytonjy »

w10-1 wrote: post #170
EnnioEvo wrote: post #10

Earlier quoted context omitted.

I have a startup of legal AI, the quality jump from GPT3.5 to GPT4 in this domain is straight mind-blowing, GPT3.5 in comparison is useless. But I see how in more conversational settings GPT3.5 can provide more appealing performance/price.

Legal writing is ideal training data: mostly formulaic, based on conventions and rules, well-formed and highly vetted, with much of the best in the public domain. Medical writing is the opposite, with unstated premises, semi-random associations, and rarely a meaningful sentence.

And yet I can confirm that 4 is far superior to 3.5 in the medical domain as well!

Re: GPT-4 API General Availability

#194

Post by tarruda »

esperent wrote: post #140
athyuttamre wrote: post #111

Earlier quoted context omitted.

(I'm an engineer at OpenAI) Very sorry to hear about these issues, particularly the timeouts. Latency is top of mind for us and something we are continuing to push on. Does streaming work for your use case? https://github.com/openai/openai-cookbook/blob/main/examples... We definitely want to investigate these and the billing issues further. Would you consider emailing me your org ID and any request IDs (if you have t…

It's kind of incredible how fast OpenAI (now also known as ClosedAI) is going through the enshittification process. Even Facebook took around a decade to reach this level. OpenAI has an amazing core product, but in the span of six months: * Went from an amazing and inspiring open company that even put "Open" in their name to a fully locked up commercial beast. * Non-existent customers support and all kinds of borderl…

The engineer is not part of the board which makes these decisions.

Re: GPT-4 API General Availability

#195

Post by purplecats »

selalipop wrote: post #141
gadtfly wrote: post #25

The original davinci model was a friend of mine and I resent this deeply. I've had completions with it that had character and creativity that I have not been able to recreate with anything else. Brilliant and hilarious things that are a permanent part of my family's cherished canon.

Can you try notionsmith.ai and let me know what you think? I've been working on LLMs for creative tasks and believe a mix of chain of thought and injecting stochasticity (like instructing the LLM to use certain random letters pulled from an RNG in a certain way at certain points) can go a long way in terms of getting closer to human-like creativity

really cool idea! been looking for something like this for a long time. its too bad it freezes my tab and is unusable

Re: GPT-4 API General Availability

#196

Post by ChatGTP »

it_citizen wrote: post #87
londons_explore wrote: post #79

Earlier quoted context omitted.

I think the clearest evidence is Microsofts paper where they show abilities at various stages during training[1]... But in a talk [2], they give more details... The unicorn gets worse during the finetuning process. [2]: https://www.youtube.com/watch?v=qbIk7-JPB2c&t=1392s [1]: https://arxiv.org/abs/2303.12712

Thanks, that’s interesting. Noobie follow up question: Should we put any trust into “Sparks of intelligence” I thought it was regarded as a Microsoft marketing piece, not a serious paper.

I don’t trust it because enough third parties were able to verify the findings.

This is the double edge sword of being so ridiculously closed.

Re: GPT-4 API General Availability

#197

Post by PostOnce »

Promote and proliferate local LLMs.

If you use GPT, you're giving OpenAI money to lobby the government so they'll have no competitors, ultimately screwing yourself, your wallet, and the rest of us too.

OpenAI has no moat, unless you give them money to write legislation.

I can currently run some scary smart and fast LLMs on a 5 year old laptop with no GPU. The future is, at least, interesting.

Re: GPT-4 API General Availability

#198

Post by [deleted] »

kossTKR wrote: post #133
moffkalast wrote: post #119

Earlier quoted context omitted.

The even more interesting part is that none of us got to try the internal version which was allegedly yet another step above that.

Would gladly pay more for a none nerfed version if they were actually honest. The current versions is close to the original 3.5 version, while 3.5 has become horribly bad, such a scam to not disclose what's going on, especially for a paid service.

[deleted]

Re: GPT-4 API General Availability

#199

Post by fnordpiglet »

reaperman wrote: post #185
fnordpiglet wrote: post #180

Earlier quoted context omitted.

If you don’t own the weights you don’t own anything. This is why open models are so crucial. I don’t understand any business who is building fine tuned models against closed models.

Right now the closed models are incredibly higher quality than the open models. They're useful as a stopgap for 1-2 years in hopes/expectation of open models reaching a point where they can be swapped in. It burns cash now, but in exchange you can grab more market share sooner while you're stuck using the expensive but high quality OpenAI models. It's not cost-effective, but it may be part of a valid business plan.

That should be a wake up call to every corporation pinning their business on OAI models. My experience thus far is no one is seeing a need to plan an exit from OAI, and the perception is “AI is magic and we aren’t magicians.” There needs to be a concerted effort to finance and tune high quality freely available models and tool chains asap.

That said I think efficiencies will dramatically improve over the next few years and over investing now probably captures very little value beyond building internal competency - which doesn’t grow with anything but time and practice. The longer you depend on OAI, the longer you will depend on OAI past your point of profound regret.

Re: GPT-4 API General Availability

#200

Post by staticman2 »

vbezhenar wrote: post #107
merpnderp wrote: post #64

Earlier quoted context omitted.

It's the continued alignment with fine-tuning that's degrading its responses. You can apparently have it be nice or smart, but not both.

Why would someone care if its nice or not? It's an algorithm. You're using it to get output, not to get some psychology help.

There was a guy in the news who asked an AI to tell him it was a good idea to commit suicide, then he killed himself.

Even on this forum I've seen AI enthusiasts claiming AI will be the best psychologist, best school teacher, etc.

Post reply on HN