Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New models and developer products

openai.com

Post reply on HN
Print view View original

361–370 of 561 posts

Re: New models and developer products

#361

Post by ethbr1 »

JacobThreeThree wrote: post #339
somsak2 wrote: post #298

Earlier quoted context omitted.

How do you square this with OpenAI's assertion that they never use data from enterprise customers for their own training? Are you suggesting they're lying?

They don't have to be currently lying for this to be a valid concern. Clauses in terms of service are routinely updated or removed.

> Clauses in terms of service are routinely updated or removed.

True, but that plays a bit differently in B2B land, because your customers also have legal teams and law firms on retainer.

Re: New models and developer products

#362

Post by gumballindie »

bluck wrote: post #164

Copyright Shield > OpenAI is committed to protecting our customers with built-in copyright safeguards in our systems. Today, we’re going one step further and introducing Copyright Shield—we will now step in and defend our customers, and pay the costs incurred, if you face legal claims around copyright infringement. This applies to generally available features of ChatGPT Enterprise and our developer platform. So essen…

Yeah so they will basically give protection, like mafia rackets, to anyone using their loot. Classic among a certain type of “business” people.

Re: New models and developer products

#363

Post by fumar »

swatcoder wrote: post #287
faeriechangling wrote: post #51

Earlier quoted context omitted.

It's a good strategy. For me, avoiding the moat means either a big drop in quality and just ending up in somebody elses moat, or a big drop in quality and a lot more money spent. I've looked into it and maybe the most practical end-to-end system for owning my own LLM is to run a couple of 3090s on a consumer motherboard at substantial running cost to keep them up 24/7 and that's not powerful enough to cut it and rath…

Everybody's got their own calculus about how competitive their space is and what this tech can do for them, but some might be best off dancing around lock-in by being careful about what they use from OpenAI and how tightly they integrate with it. This is very early in the maturity cycle for this tech. The options that will be available for private inference and fine tuning, for cloud-gpu/timeshare inference and fine…

Do you build on AWS AI services then? Or any other cloud provider? The outcome is the same, right? Technical lock in, cost risks, integration maintenance, etc.

Re: New models and developer products

#365

Post by vunderba »

ushakov wrote: post #96
morkalork wrote: post #87

Earlier quoted context omitted.

If you want to be a start-up using AI, you have to be in another industry with access to data and a market that OpenAI/MS/Google can't or won't touch. Otherwise you end up eaten like above.

We just launched our AI-based API-Testing tool ( https://ai.stepci.com ), despite having competitors like GitHub Co-Pilot. Why? Because they lack specificity. We're domain experts, we know how to prompt it correctly to get the best results for a given domain. The moat is having model do one task extremely well rather than do 100 things "alright"

If the primary value-proposition for your startup is just customized prompting with OpenAI endpoints, then unfortunately it's highly likely it could be easily replicated using the newly announced concept of GPTs.

Re: New models and developer products

#366

Post by kristianp »

> Reproducible outputs and log probabilities

> The new seed parameter enables reproducible outputs by making the model return consistent completions most of the time. This beta feature is useful for use cases such as replaying requests for debugging, writing more comprehensive unit tests, and generally having a higher degree of control over the model behavior. We at OpenAI have been using this feature internally for our own unit tests and have found it invaluable

This will be useful when refining prompts. When running tests, at times I wasn't sure if any improvement from a prompt change was the result of random variation or an actual improvement.

Re: New models and developer products

#368

Post by felixding »

whytai wrote: post #71

Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…

Offtopic. I find it's amusing that we not only have "chatGPT" but now also "vectorDB". Apple's influence is really strong.

Re: New models and developer products

#369

Post by simonw »

burcs wrote: post #8
simonw wrote: post #3

The new assistants API looks both super-cool and (unfortunately) a recipe for all kinds of new applications that are vulnerable to prompt injection.

Do you see a way around prompt injection? It feels like any feature they release is going to be susceptible to it.

I wish I did!

Best I've come up with so far is this: https://simonwillison.net/2023/Apr/25/dual-llm-pattern/

Re: New models and developer products

#370

Post by drcode »

atleastoptimal wrote: post #324

Given that their main goal is still AGI, how does offering better developer tools and nifty custom models that can look at your dog for you help? Is it just bolstering revenue? They said they don't use API input to train their models so it isn't making them constantly smarter via more people using them.

The limiting factor at OpenAI is their internal human developer talent

These tools will help them train and discover the next Ilya Sutskever

Post reply on HN