Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

github.com

Post reply on HN
Print view View original

31–40 of 349 posts

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#31

Post by FrenchDevRemote »

TuringNYC wrote: post #16

Curious if anyone has done a side-by-side analysis of this offering vs just running LLaMA? I'm currently running a side-by-side comparison/evaluation of MSFT GPT via Cognitive Services vs LLaMA[7B/13B/70B] and intrigued by the possibility of a truly air-gapped offering not limited by external computer power (nor by metered fees racking up.) Any reads on comparisons would be nice to see. (yes, I realize we'll eventual…

chatgpt is obviously a LOT better, llama doesn't even understand some prompts

and since LLMs aren't even that good to begin with, it's obvious you want the SOTA to do anything useful unless maybe you're finetuning

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#32

Post by Buttons840 »

theptip wrote: post #14
Y_Y wrote: post #3

So the public access one isn't private and secure?

The concern is that ChatGPT is training on your chats (by default, you can opt out but you lose chat history last I checked). So in general enterprises cannot allow internal users to paste private code into ChatGPT, for example.

As an example of this. I found that GPT4 wouldn't agree with me that C(A) = C(AA^T) until I explained the proof. A few weeks later it would agree in new chats and would explain using the same proof I did presented the same way.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#33

Post by dijital »

tharwan wrote: post #15
littlestymaar wrote: post #4

“private and secure” from the company that let contractor listen to your private Teams conversation for data labeling purpose, and monitor your activity on your own computer with their OS…

Huh. I missed this one. Got a link?

At a guess it's this story: https://www.vice.com/en/article/xweqbq/microsoft-contractors...

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#36

Post by agildehaus »

semitones wrote: post #28
PaulWaldman wrote: post #22

Since the only users who would likely care about this derive far more value than the $20/month of OpenAI's direct offering. Why doesn't OpenAI market this service, but with chat history, for something like $200/month?

That's a laughable price for an enterprise subscription. And the reason is, it's enough for OpenAI to "say" that they're "not going to use your data" - you need a cloud deployment where you can control network boundaries to _prove_ that your data isn't going anywhere it isn't supposed to.

Unless you're physically controlling the network boundaries, how are you proving that on any cloud service?

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#37

Post by [deleted] »

TuringNYC wrote: post #16

Curious if anyone has done a side-by-side analysis of this offering vs just running LLaMA? I'm currently running a side-by-side comparison/evaluation of MSFT GPT via Cognitive Services vs LLaMA[7B/13B/70B] and intrigued by the possibility of a truly air-gapped offering not limited by external computer power (nor by metered fees racking up.) Any reads on comparisons would be nice to see. (yes, I realize we'll eventual…

[deleted]

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#38

Post by baobabKoodaa »

FrenchDevRemote wrote: post #31
TuringNYC wrote: post #16

Curious if anyone has done a side-by-side analysis of this offering vs just running LLaMA? I'm currently running a side-by-side comparison/evaluation of MSFT GPT via Cognitive Services vs LLaMA[7B/13B/70B] and intrigued by the possibility of a truly air-gapped offering not limited by external computer power (nor by metered fees racking up.) Any reads on comparisons would be nice to see. (yes, I realize we'll eventual…

chatgpt is obviously a LOT better, llama doesn't even understand some prompts and since LLMs aren't even that good to begin with, it's obvious you want the SOTA to do anything useful unless maybe you're finetuning

> and since LLMs aren't even that good to begin with, it's obvious you want the SOTA to do anything useful unless maybe you're finetuning

This is overkill. First of all, ChatGPT isn't even the SOTA, so if you "want SOTA to do anything useful", then this ChatGPT offering would be as useless as LLaMA according to you. Second, there are many individual tasks where even those subpar LLaMA models are useful - even without finetuning.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#39

Post by londons_explore »

FrenchDevRemote wrote: post #31
TuringNYC wrote: post #16

Curious if anyone has done a side-by-side analysis of this offering vs just running LLaMA? I'm currently running a side-by-side comparison/evaluation of MSFT GPT via Cognitive Services vs LLaMA[7B/13B/70B] and intrigued by the possibility of a truly air-gapped offering not limited by external computer power (nor by metered fees racking up.) Any reads on comparisons would be nice to see. (yes, I realize we'll eventual…

chatgpt is obviously a LOT better, llama doesn't even understand some prompts and since LLMs aren't even that good to begin with, it's obvious you want the SOTA to do anything useful unless maybe you're finetuning

openai offers finetuning too. And it's pretty cheap to do considering.
Post reply on HN