Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT Enterprise

openai.com

Post reply on HN
Print view View original

261–270 of 532 posts

Re: ChatGPT Enterprise

#261

Post by IanCal »

dahwolf wrote: post #248
IanCal wrote: post #170

Earlier quoted context omitted.

You probably wouldn't want that, you'd want to integrate with your data for lookups but rarely for training a new model.

Can't believe the pushback I'm getting here. The use case is stunningly obvious. Companies want to dump all their Excels in it and get insights that no human could produce in any reasonable amount of time. Companies want to dump a zillion help desk tickets into and gain meaningful insights from it. Companies want to dump all their Sharepoints and Wikis into it that currently nobody can even find or manage, and finall…

None of the use cases you are describing require training a new model. You really don't want to train a new model, that's not a good way of getting them to learn reliable facts and do so without losing other knowledge. The fine tuning for GPT 3.5 suggests something like under a hundred examples.

What you want is to get an existing model to search a well built index of your data and use that information to reason about things. That way you also always have entirely up to date data.

People aren't missing the use cases you describe, they're disagreeing as to how to achieve those.

Re: ChatGPT Enterprise

#262

Post by xkqd »

0xcde4c3db wrote: post #260

Any hot takes on what the median application of this looks like at a practical level? What springs to mind for me is replacing the classic "weed-out" tiers of customer service like phone trees, chatbots that are actually crappy FAQ/KB search engines, and human representatives who are only allowed to follow a script. On balance, this might even be a win for everyone involved, given how profoundly terrible the status q…

> On balance, this might even be a win for everyone involved

Well, other than the millions of jobs at stake here. But I’m sure they can just learn to code or become an engineer

Re: ChatGPT Enterprise

#263

Post by sigotirandolas »

slsii wrote: post #210
Racing0461 wrote: post #205

> unlimited higher-speed GPT-4 access aka the nerfed version. high speed means the weights were relaxed leading to faster output but worse reasoning and memory.

What does it mean to “relax” weights and how does that speed up output?

I assume he means quantization (e.g. scaling the weights from 16-bit to 4-bit) and it speeds up the output by reducing the amount of work done.

Re: ChatGPT Enterprise

#264

Post by tspike »

holoduke wrote: post #256

Are there already some profitable businesses using chatgpt i am wondering. To me the tech is really impressive. But what kind of really big commercial product exists at this point? I only know of assistants like copilot or some word assistant. But what else? Isnt this just a temporary bubble?

If you’re asking about consumer facing products, I’m aware of eBay using it to help sellers write product descriptions. But, I think the bigger immediate use case is making daily work easier inside these companies.

I’ve used it extensively to speed up the process of making presentations, drafting emails, naming things, rubber-ducking for coding, etc.

Re: ChatGPT Enterprise

#265

Post by dools »

ajhai wrote: post #230

Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes. From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting…

> we quickly learned how sensitive enterprises are when it comes to sharing their data

"They're huge pussies when it comes to security" - Jan the Man[0]

[0] https://memes.getyarn.io/yarn-clip/b3fc68bb-5b53-456d-aec5-4...

Re: ChatGPT Enterprise

#266

Post by atleastoptimal »

warthog wrote: post #159

Well the message in this video certainly did not age well: https://www.youtube.com/watch?v=smHw9kEwcgM TLDR: This might have just killed a LOT of startups

There's a typical presumed business intuition that any large company will confer business to a host of "satellite companies" who offer some offshoot of the product's value proposition but catered to a niche sector. Most of these are however just "OpenAI API + a prefix prompt + user interface + marketing". The issue is (which has been brought up since the release of the GPT-3 API 3 years ago) that no startup can offer much more value than the API alone offers, and thus it's easier, comparatively, than in analogous cases of this type of startup model with other larger companies in the past, for OpenAI to capitalize on this business

Re: ChatGPT Enterprise

#267

Post by rsiqueira »

ajhai wrote: post #258
mveertu wrote: post #251

Earlier quoted context omitted.

So, how do you plan to commercialize your product? I have noticed tons of chatbot cloud-based app providers built on top of ChatGPT API, Azure API (ask users to provide their API key). Enterprises will still be very wary of putting their data on these multi-tenant platforms. I feel that even if there is encryption that's not going to be enough. This screams for virtual private LLM stacks for enterprises (the only way…

We have a cloud offering at https://trypromptly.com . We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI , run Llama or others and connect to them from their Promptly LLM apps. We also provide support and some premium processors for en…

But, in order to generate the vectors, I understand that it's necessary to use the OpenAI's Embeddings API, which would grant OpenAI access to all client data at the time of vector creation. Is this understanding correct? Or is there a solution for creating high-quality (semantic) embeddings, similar to OpenAI's, but in a private cloud/on premises environment?

Re: ChatGPT Enterprise

#268

Post by eagleinparadise »

justanotheratom wrote: post #132
vidarh wrote: post #15

Earlier quoted context omitted.

They don't train on data when you either use the API or disable chat history, which is inconvenient.

yes, this is terrible. I want chat history, but I don't want them to use my data. Can't have both, even though I am paying $20/month!

Best way of doing this I have found is using separate browser profiles.

So i have one primary profile logged in normally and a separate tab which i turn off chat history.

So now I get best of both worlds

Re: ChatGPT Enterprise

#269

Post by feralderyl »

wunderwuzzi23 wrote: post #89

Wonder if for the Enterprise version they will fix the Image Markdown Data Exfiltration vulnerability that's been known for a while. https://embracethered.com/blog/posts/2023/chatgpt-webpilot-d... Seems like a no-go for companies if an attacker can steal stuff.

can you briefly explain the vulnerability here. I'm having difficulty understanding as all I see is him recalling already previously recorded chat history of his own session. thanks.

Re: ChatGPT Enterprise

#270

Post by ivalm »

rsiqueira wrote: post #267
ajhai wrote: post #258

Earlier quoted context omitted.

We have a cloud offering at https://trypromptly.com . We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI , run Llama or others and connect to them from their Promptly LLM apps. We also provide support and some premium processors for en…

But, in order to generate the vectors, I understand that it's necessary to use the OpenAI's Embeddings API, which would grant OpenAI access to all client data at the time of vector creation. Is this understanding correct? Or is there a solution for creating high-quality (semantic) embeddings, similar to OpenAI's, but in a private cloud/on premises environment?

Sentence-Bert is at least as good as OpenAI embeddings. But I think more importantly Azure OpenAI model api is already soc2 and hipaa compliant.
Post reply on HN