Live data from Hacker News

ChatGPT Enterprise

openai.com

251–260 of 532 posts

Re: ChatGPT Enterprise

#251
post #230

Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes. From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting…

So, how do you plan to commercialize your product? I have noticed tons of chatbot cloud-based app providers built on top of ChatGPT API, Azure API (ask users to provide their API key). Enterprises will still be very wary of putting their data on these multi-tenant platforms. I feel that even if there is encryption that's not going to be enough. This screams for virtual private LLM stacks for enterprises (the only way to fully isolate).

Re: ChatGPT Enterprise

#252

Well the message in this video certainly did not age well: https://www.youtube.com/watch?v=smHw9kEwcgM TLDR: This might have just killed a LOT of startups

Any startup that is using ChatGPT under the hood is just doing market research for OpenAI for free. The same happened when people started experimented with GPT3 for code completion, right before being replaced by Copilot.

If you want to build an AI start-up and need a LLM, you must use Llama or another model than you can control and host yourself, anything else is basically suicide.

Re: ChatGPT Enterprise

#253

I hope no one will be disappointed, who has done a good job as an employee suddenly finding himself replaced by a snippet of code, after the weights have been sufficiently adjusted. It's like slurping the very last capital a worker has out of its mind and soul. Most companies exist to make a profit, not to employ humans. Paired with the pseudo-mocked-tech-bro self-peddling BS this announcement reads like dystopia to…

A common retort to this is that companies also exist to compete (and thus make a profit), so those that use AI to augment their staff rather than replace them will be at an advantage. Honestly, I can see it, but there are definitely SOME jobs at risk, and it will almost certainly reduce hiring in junior positions. I am a manager in a dev team. I have a small team and too many plates spinning, and I’ve been crying out…

I'm all for making us all more efficient, but not at the cost of creating new data monopolies, if possible. The price is very high, even though it's not immediately obvious.

We already have enormous concentration of data in a few places and it's only getting worse. Centralization is efficiency, but the benefits of that get skimmed disproportionally, to the detriment of what allowed these systems to emerge in the first place: our society.

Re: ChatGPT Enterprise

#254
Non-use of enterprise data for training models is table-stakes for enterprise ML products. Google does the same thing, for example.

They'll want to climb the compliance ladder to be considered in more highly-regulated industries. I don't think they're quite HIPAA-compliant yet. The next thing after that is probably in-transit geofencing, so the hardware used by an institution reside in a particular jurisdiction. This stuff seems boring but it's an easy way to scale the addressable market.

Though at this point, they are probably simply supply-limited. Just serving the first wave will keep their capacity at a maximum.

(I do wonder if they'll start offering batch services that can run when the enterprise employees are sleeping...)

Re: ChatGPT Enterprise

#255
post #230

Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes. From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting…

> is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes.

Except many companies deal with data of other companies, and these companies do not allow the sharing of data.

Re: ChatGPT Enterprise

#256
Are there already some profitable businesses using chatgpt i am wondering. To me the tech is really impressive. But what kind of really big commercial product exists at this point? I only know of assistants like copilot or some word assistant. But what else? Isnt this just a temporary bubble?

Re: ChatGPT Enterprise

#257

Earlier quoted context omitted.

But it's a tool like any other. This is like saying "if you're relying on an IDE you're not doing a good job"

an IDE aids you in programming, it doesn't do the programming for you. do you really need this distinction explained to you?

I am sorry, i will start writing on my clay tablet right away.

Re: ChatGPT Enterprise

#258
post #230

Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes. From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting…

So, how do you plan to commercialize your product? I have noticed tons of chatbot cloud-based app providers built on top of ChatGPT API, Azure API (ask users to provide their API key). Enterprises will still be very wary of putting their data on these multi-tenant platforms. I feel that even if there is encryption that's not going to be enough. This screams for virtual private LLM stacks for enterprises (the only way…

We have a cloud offering at https://trypromptly.com. We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI, run Llama or others and connect to them from their Promptly LLM apps.

We also provide support and some premium processors for enterprise on-prem deployments.

Re: ChatGPT Enterprise

#259
post #258

Earlier quoted context omitted.

So, how do you plan to commercialize your product? I have noticed tons of chatbot cloud-based app providers built on top of ChatGPT API, Azure API (ask users to provide their API key). Enterprises will still be very wary of putting their data on these multi-tenant platforms. I feel that even if there is encryption that's not going to be enough. This screams for virtual private LLM stacks for enterprises (the only way…

We have a cloud offering at https://trypromptly.com . We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI , run Llama or others and connect to them from their Promptly LLM apps. We also provide support and some premium processors for en…

Enterprises can bring up https://github.com/go-skynet/LocalAI, run Llama or others and connect to them from their Promptly LLM apps - So spin up GPU instances and host whatever model in their VPC and it connects to your SaaS stack? What are they paying you for in this scenario?

Re: ChatGPT Enterprise

#260
Any hot takes on what the median application of this looks like at a practical level? What springs to mind for me is replacing the classic "weed-out" tiers of customer service like phone trees, chatbots that are actually crappy FAQ/KB search engines, and human representatives who are only allowed to follow a script. On balance, this might even be a win for everyone involved, given how profoundly terrible the status quo is. While it's sort of terrifying at a philosophical level that we might be mollifying the masses with an elaborate illusion, the perception of engaging with an agent that's actually responsive to your words might make the whole process at least incrementally less hellish.
Post reply on HN