Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New models and developer products

openai.com

Post reply on HN
Print view View original

491–500 of 561 posts

Re: New models and developer products

#491

Post by mike_hearn »

w-m wrote: post #284
throw2321 wrote: post #268

Earlier quoted context omitted.

I've been thinking about this for a while now, wrt two points: 1. This will be the end of traditional SWEs and the rise of the age of debuggers, human debuggers who spend their days setting up breakpoints and figuring bugs in a sea of LLM generated code. 2. Hiring will switch from using Leetcode questions to "pull out your debugger and figure out what's wrong with this code".

What makes you think the LLM couldn’t run a debugging session from the content of a JIRA ticket and the whole code base + documentation?

Who can say what's possible but there are very few "debugging transcripts" for neural nets to train on out there. So it'd have to sort of work out how to operate a debugger via functions, understand the codebase (perhaps large parts of it), intuit what's going wrong, be able to modify the codebase, etc. Lots of work to do there.

Re: New models and developer products

#492

Post by mike_hearn »

joegibbs wrote: post #475
leobg wrote: post #435

Earlier quoted context omitted.

OpenAI does not strike me as a company that would be naive about this. Didn’t they just recently manipulate the outputs of an endpoint when they realized people were misusing it? (“CatGPT”) The most sinister interpretation is that the logits are a red herring. People who are tied up in stealing them aren’t free to do actual rival work.

What happened with CatGPT?

Someone was abusing the ChatGPT backend to avoid paying for the API calls. When OpenAI's abuse team noticed this they modified the system prompt used for those requests to tell the AI to pretend it was a cat, and then monitored the Discord channel of the abusers for the lulz.

Re: New models and developer products

#493

Post by jack_riminton »

nmfisher wrote: post #345
jack_riminton wrote: post #253

For all the naysayers in the comments, the elephant in the room that no one quite wants to admit, is that GPT4 is still far better than everything else out there

I cancelled my GPT4 subscription because I found Claude more useful for code and Qwen for Chinese language tasks. It might be better on average but I don’t think it’s better for every task. All the others are only going to get better too.

"All the others are only going to get better too."

Yes, including OpenAI, who were already miles ahead :)

Re: New models and developer products

#495

Post by depr »

ianbicking wrote: post #37
modeless wrote: post #12

Whisper V3 is released! https://github.com/openai/whisper/commit/c5d42560760a05584c1... Looks like it's just a new checkpoint for the large model. It would be nice to have updates for the smaller models too. But it'll be easy to integrate with anything using Whisper V2. I'm excited to add it to my local voice AI ( https://www.microsoft.com/store/apps/9NC624PBFGB7 ) I assume ChatGPT voice has been using Whisper V3 and…

Do you also get those hallucinations just on silence? I kind of wonder if they had a bunch of training data of video with transcripts, but some of the video/audio was truncated and the transcript still said the last speech, and so now it thinks silence is just another way of signing off from a TV program. IMHO the bottleneck on voice now is all the infrastructure around it. How do you detect speech starting and stopp…

>How do you detect speech starting and stopping?

https://github.com/snakers4/silero-vad

Re: New models and developer products

#497

Post by weird-eye-issue »

stavros wrote: post #479
weird-eye-issue wrote: post #416

Earlier quoted context omitted.

The average langchain dev will struggle to even call the API without langchain so I think it's safe

I find the opposite to be true, I use the OpenAI APIs as they are, but really struggle to figure out how the hell LangChain works.

Tiktok AI influencers will be happy to help you

Re: New models and developer products

#498

Post by smcleod »

faeriechangling wrote: post #51
minimaxir wrote: post #4

Most of the products announced (and the price cuts) appear to be more about increasing lock-in to the OpenAI API platform, which is not surprising given increased competition in the space. The GPTs/GPT Agents and Assistants demos in particular showed that they are a black box within a black box within a black box that you can't port anywhere else. I'm mixed on the presentation and will need to read the fine print on…

It's a good strategy. For me, avoiding the moat means either a big drop in quality and just ending up in somebody elses moat, or a big drop in quality and a lot more money spent. I've looked into it and maybe the most practical end-to-end system for owning my own LLM is to run a couple of 3090s on a consumer motherboard at substantial running cost to keep them up 24/7 and that's not powerful enough to cut it and rath…

A good strategy for who? Society? Customers? The future? Or just for making money for the owners?

Re: New models and developer products

#499

Post by msp26 »

mike_hearn wrote: post #492
joegibbs wrote: post #475

Earlier quoted context omitted.

What happened with CatGPT?

Someone was abusing the ChatGPT backend to avoid paying for the API calls. When OpenAI's abuse team noticed this they modified the system prompt used for those requests to tell the AI to pretend it was a cat, and then monitored the Discord channel of the abusers for the lulz.

>When OpenAI's abuse team noticed this they modified the system prompt used for those requests to tell the AI to pretend it was a cat, and then monitored the Discord channel of the abusers for the lulz.

Please I need a source for this it sounds hilarious.

Re: New models and developer products

#500

Post by drubio »

MagicMoonlight wrote: post #239
saliagato wrote: post #105

You can now [1] pay from $2 to $3 million to pretrain custom gpt-n model. This has gone unnoticed but seems really neat. Provided that a start-up has enough money spend on that, it would certainly give competitive advantage. [1] https://openai.com/form/custom-models Edit: forgot to put the link

Well it won’t because they’ll use the model you paid for and take your customers.

I had multiple déjà vus, from the API golden days "build anything you want", social media telling you "build your communities with us", to app stores "we take care of the distribution"...it all works, until it doesn't...if they decide to change terms, pricing or make your product/service redundant because its 'strategic'.

It's their platform, their business, their rules.

Post reply on HN