Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT Enterprise

openai.com

Post reply on HN
Print view View original

321–330 of 532 posts

Re: ChatGPT Enterprise

#321

Post by hunter2_ »

dahwolf wrote: post #248
IanCal wrote: post #170

Earlier quoted context omitted.

You probably wouldn't want that, you'd want to integrate with your data for lookups but rarely for training a new model.

Can't believe the pushback I'm getting here. The use case is stunningly obvious. Companies want to dump all their Excels in it and get insights that no human could produce in any reasonable amount of time. Companies want to dump a zillion help desk tickets into and gain meaningful insights from it. Companies want to dump all their Sharepoints and Wikis into it that currently nobody can even find or manage, and finall…

I think those are examples of prompting, not modeling. You'd use the API to develop an app where the end user's question gets prefaced with that stuff. Modeling is more like teaching it how to sensibly use language, which can be centralized instead of each enterprise having experts in that. It would be like having in-house English teachers instead of sending people to school, based on a desire to have a corporate accent -- interesting but probably not useful in most cases.

Re: ChatGPT Enterprise

#322

Post by accrual »

dahwolf wrote: post #248
IanCal wrote: post #170

Earlier quoted context omitted.

You probably wouldn't want that, you'd want to integrate with your data for lookups but rarely for training a new model.

Can't believe the pushback I'm getting here. The use case is stunningly obvious. Companies want to dump all their Excels in it and get insights that no human could produce in any reasonable amount of time. Companies want to dump a zillion help desk tickets into and gain meaningful insights from it. Companies want to dump all their Sharepoints and Wikis into it that currently nobody can even find or manage, and finall…

I wonder if corporations would train it on emails/Exchange as well, since they are often technically company property and could contain valuable information not found in tickets/wikis.

Re: ChatGPT Enterprise

#324

Post by happytiger »

stale2002 wrote: post #124
happytiger wrote: post #105

Has there been some resolution to the copyright issues that I’m no aware of? In my conversations with execs that’s been a serious concern — basically that generated output from AI systems can’t be reliably protected. I refer to the concept that output could be deemed free of copyright because they are not created by a human author, or that derivative works can be potential liabilities because they resemble works that…

The copyright ruling that you are referencing is being significantly misunderstood. The only think that the ruling said is basically that the most low effort version of AI does not have copyright protection. IE, if you just go into midjourney and type in "super cool anime girl!" and thats it, the results are not protected. But there is so much more you can do. For example, you can generate an image, and then change i…

My understanding is that there are many more issues across both the training data and the output.

https://www.theverge.com/23444685/generative-ai-copyright-in...

https://news.bloomberglaw.com/ip-law/openai-facing-another-c...

Etc…

Re: ChatGPT Enterprise

#325

Post by irrational »

ajhai wrote: post #230

Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes. From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting…

My company (Fortune 500 with 80,000 full time employees) has a policy that forbids the use of any AI or LLM tool. The big concern listed in the policy is that we may inadvertently use someone else’s IP from training data. So, our data going into the tool is one concern, but the other is our using something we are not authorized to use because the tool has it already in its data. How do you prove that that could never occur? The only way I can think of is to provide a comprehensive list of everything the tool was trained on.

Re: ChatGPT Enterprise

#326

Post by supriyo-biswas »

justanotheratom wrote: post #132
vidarh wrote: post #15

Earlier quoted context omitted.

They don't train on data when you either use the API or disable chat history, which is inconvenient.

yes, this is terrible. I want chat history, but I don't want them to use my data. Can't have both, even though I am paying $20/month!

Use a third party interface which uses the API directly like YakGPT or the OpenAI playgrounds, and you can save some costs that way along with a local chat history that’s not shared with OpenAI.

Re: ChatGPT Enterprise

#327

Post by bartimus »

ftxbro wrote: post #2

> For all enterprise customers, it offers: > Customer prompts and company data are not used for training OpenAI models. > Unlimited access to advanced data analysis (formerly known as Code Interpreter) > 32k token context windows for 4x longer inputs, files, or follow-ups I'd thought all those had been available for non enterprise customers, but maybe I was wrong, or maybe something changed.

Last I checked:

- GPT-4 (ChatGPT Plus): has max 4K tokens ?

- GPT-4 API: has max 8K tokens (for most users atm)

- GPT-3.5 API: has max 16K tokens

I'd consider the 32K GPT-4 context the most valuable feature. In my opinion OpenAI shouldn't discriminate in favor of large enterprises. It should be equaly available to normal (paying) customers.

Re: ChatGPT Enterprise

#328

Post by irrational »

brabel wrote: post #10
ftxbro wrote: post #2

> For all enterprise customers, it offers: > Customer prompts and company data are not used for training OpenAI models. > Unlimited access to advanced data analysis (formerly known as Code Interpreter) > 32k token context windows for 4x longer inputs, files, or follow-ups I'd thought all those had been available for non enterprise customers, but maybe I was wrong, or maybe something changed.

I think the real feature is this: " We do not train on your business data or conversations, and our models don’t learn from your usage. ChatGPT Enterprise is also SOC 2 compliant and all conversations are encrypted in transit and at rest. "

But, can they provide a comprehensive dump of all data it was trained on that we can examine? Otherwise my company may end up using IP that belongs to someone else.

Re: ChatGPT Enterprise

#329

Post by jmorgan »

jacquesm wrote: post #318
jmorgan wrote: post #317

Earlier quoted context omitted.

There are different levels of quantization available for different models (if that's what you mean :). E.g. here are the versions available for Llama 2: https://ollama.ai/library/llama2/tags which go down to 2-bit quantization (which surprisingly still happens to work reasonably well).

No, what I mean is that it seems as though there is quite a bit of sparseness to the matrix and I was wondering if that can somehow be used to further shrink the model, quantization is another effect (it leaves the shape of the various elements as they are but reduces their bit-depth).

Ah, gotcha! I thought you probably meant something else. I've been wondering this too, and it's something I've been meaning to look at.

On a related note it doesn't seem like many local runners are leveraging techniques like PagedAttention yet (see https://vllm.ai/) which is inspired by operating system memory paging to reduce memory requirements for LLMs.

It's not quite what you mentioned, but it might have a similar effect! Would love to know if you've seen other methods that might help reduce memory requirements.. it's one of the largest resource bottlenecks to running LLMs right now!

Re: ChatGPT Enterprise

#330

Post by adt »

flangola7 wrote: post #123
brigadier132 wrote: post #27

Earlier quoted context omitted.

Microsoft has a stake in OpenAI but they don't have a controlling interest in it. What they got instead was exclusive access to the models on Azure. So they benefit from OpenAIs success but they benefit more from their own success in the space and in a way they are competitors.

Exclusive access? Source?

Might be old (2020), as OpenAI models are now also covered by Quora for Poe.com and others: https://blogs.microsoft.com/blog/2020/09/22/microsoft-teams-...
Post reply on HN