Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New models and developer products

openai.com

Post reply on HN
Print view View original

301–310 of 561 posts

Re: New models and developer products

#301

Post by somsak2 »

Zaheer wrote: post #15

The playbook OpenAI is following is similar to AWS. Start with the primitives (Text generation, Image generation, etc / EC2, S3, RDS, etc) and build value add services on top of it (Assistants API / all other AWS services). They're miles ahead of AWS and other competitors in this regard.

I don't know if I'd say "miles ahead." AWS had 7 years of basically no other competition -- all of the other big clouds of today had their heads in the sand. OpenAI has a bunch of people competing already. They may not be as good on the leaderboards now, but they're certainly not having to play catch up from years of ignoring the space.

Re: New models and developer products

#302

Post by [deleted] »

simonw wrote: post #241

I just released a new version of my LLM CLI tool with support for the new GPT-4 Turbo model: https://llm.datasette.io/en/stable/changelog.html#v0-12 You can install it like this: pipx install llm Then set an API key: llm keys set openai Then run a prompt through GPT-4 Turbo like this: llm -m gpt-4-turbo "Ten great names for a pet walrus" # Or a shortcut: llm -m 4t "Ten great names for a pet walrus" Here's a one-liner…

[deleted]

Re: New models and developer products

#303

Post by bugglebeetle »

kossTKR wrote: post #273
jack_riminton wrote: post #253

For all the naysayers in the comments, the elephant in the room that no one quite wants to admit, is that GPT4 is still far better than everything else out there

Is there anything promising out there? Is crowd sourced training still unfeasible? I remember how fast the diffusion world moved in the first year but it seems it's stalled somewhat compared to first midjourney then Dall-e 3. Is it the same with text models?

GPT-4 is the best general model and specifically very good at coding, if correctly promoted. Lots of open source stuff is good at various tasks (e.g. NLP stuff), but nothing is near to the same overall level of performance.

Re: New models and developer products

#304

Post by somsak2 »

kridsdale3 wrote: post #202
in3d wrote: post #17

Earlier quoted context omitted.

For GPT-4 Turbo, not GPT-4.

Yes, nowhere in the text today was there any assertion that Turbo produces (eg) source code at the same level of coherence and consistently high quality as GPT4.

Was there an assertion that it doesn't?

Re: New models and developer products

#305

Post by AOsborn »

visarga wrote: post #27
chipgap98 wrote: post #20

The Assistants API and OpenAI Store are really interesting. Those are the types of things that could build a moat for OpenAI

You think it is hard to export an agent? It's a master prompt, a collection of documents and a few generic plugins like function calling and code execution. This will be implemented in open source soon. You can even fine-tune on your bot logs.

That view misses the point for their likely customers.

My company will be all over this.

We 'could' continue to use open-source components we're gluing together ourselves.

But risk-aversion and speed-of-iteration are key for us. We'll throw money at a reliable end-to-end solution with solid infrastructure.

Re: New models and developer products

#306

Post by somsak2 »

doctoboggan wrote: post #57

In the keynote @sama claimed GPT-4-turbo was superior to the older GPT-4. Have any benchmarks or other examples been shown? I am curious to see how much better it is, if it all. I remember when 3.5 got its turbo version there was some controversy on whether it was really better or not.

It seems like the "Turbo" models are more about being faster/cheaper, not so much about being better. Kinda similar to the iPhone "S" models or Intel's "tick-tock"

Re: New models and developer products

#307

Post by eichin »

w-m wrote: post #284
throw2321 wrote: post #268

Earlier quoted context omitted.

I've been thinking about this for a while now, wrt two points: 1. This will be the end of traditional SWEs and the rise of the age of debuggers, human debuggers who spend their days setting up breakpoints and figuring bugs in a sea of LLM generated code. 2. Hiring will switch from using Leetcode questions to "pull out your debugger and figure out what's wrong with this code".

What makes you think the LLM couldn’t run a debugging session from the content of a JIRA ticket and the whole code base + documentation?

Having never seen it, or anything even close to it. (Of course, I'm a little biased by seeing product demos that don't even get "add another item to this list of command line arguments" right; maybe if everyone already believes it works, nobody bothers to actually sell that?)

Re: New models and developer products

#309

Post by ushakov »

somsak2 wrote: post #294
ushakov wrote: post #282

Earlier quoted context omitted.

We are doing this for API-Testing now. You should check out our website https://ai.stepci.com

piece of feedback: it's weird to have a drop-down on "OpenAPI Links" when there are no other options.

Thanks! We will have more examples coming very soon

Re: New models and developer products

#310

Post by aantix »

abound wrote: post #285
aantix wrote: post #111

Can I pay someone to have my ChatGPT transcripts searchable?

Probably not the answer you're looking for, but the web UI has chat history export built-in, and from there you could search it yourself with local tools (plain grep, or more ElasticSearch-like engines), or use the new 128k context to ask questions of your chat history with GPT-4 (though that seems a bit, recursive?)

I've tried that, but a few issues

1) The highlighting from command-f isn't always clear (highlighting a piece of text that is visually truncated)

2) There's pagination in place to support longer histories. So even with command-f, I'm only searching the currently windowed paginated pieces from my history.

Post reply on HN