Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

github.com

Post reply on HN
Print view View original

41–50 of 349 posts

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#41

Post by tikkun »

TuringNYC wrote: post #16

Curious if anyone has done a side-by-side analysis of this offering vs just running LLaMA? I'm currently running a side-by-side comparison/evaluation of MSFT GPT via Cognitive Services vs LLaMA[7B/13B/70B] and intrigued by the possibility of a truly air-gapped offering not limited by external computer power (nor by metered fees racking up.) Any reads on comparisons would be nice to see. (yes, I realize we'll eventual…

I did one. I took a few dozen prompts from my ChatGPT history and ran them through a few LLMs.

GPT-4, Bard and Claude 2 came out on top.

Llama 2 70b chat scored similarly to GPT-3.5, though GPT-3.5 still seemed to perform a bit better overall.

My personal takeaway is I’m going to continue using GPT-4 for everything where the cost and response time are workable.

Related: A belief I have is that LLM benchmarks are all too research oriented. That made sense when LLMs were in the lab. It doesn't make sense now that LLMs have tens of millions of DAUs — i.e. ChatGPT. The biggest use cases for LLMs so far are chat assistants and programming assistants. We need benchmarks that are based on the way people use LLMs in chatbots and the type of questions that real users use LLM products, not hypothetical benchmarks and random academic tests.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#42

Post by unnouinceput »

PaulWaldman wrote: post #22

Since the only users who would likely care about this derive far more value than the $20/month of OpenAI's direct offering. Why doesn't OpenAI market this service, but with chat history, for something like $200/month?

OenAI IS Microsoft. Don't get tangled in the web of creating different entities when they are all part of the same pyramid. Also GitHub IS Microsoft too!!

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#43

Post by speedgoose »

villgax wrote: post #18
albert_e wrote: post #2

is there away to run this on AWS instead. we were looking to explore Llama2 for internal use

Have your engineers set this up internally https://huggingface.co/spaces/huggingface-projects/llama-2-7...

You can’t really replace ChatGPT 4 with llama2 7B.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#44

Post by nixgeek »

unnouinceput wrote: post #42
PaulWaldman wrote: post #22

Since the only users who would likely care about this derive far more value than the $20/month of OpenAI's direct offering. Why doesn't OpenAI market this service, but with chat history, for something like $200/month?

OenAI IS Microsoft. Don't get tangled in the web of creating different entities when they are all part of the same pyramid. Also GitHub IS Microsoft too!!

GitHub was acquired by Microsoft, and they are no longer legally separate entities.

Microsoft is an investor in OpenAI, but does not own it, and they are legally separate companies. OpenAI is not Microsoft and it is factually incorrect to claim that OpenAI is Microsoft.

[1] https://blogs.microsoft.com/blog/2023/01/23/microsoftandopen...

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#45

Post by wodenokoto »

bouke wrote: post #26

How is this different from the other OpenAI GUI? Why another one by Microsoft? https://github.com/microsoft/sample-app-aoai-chatGPT .

There's at least two more. There's also https://github.com/Azure-Samples/azure-search-openai-demo

And you can deploy a chat bot from within the Azure playground which runs on another codebase.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#46

Post by Ecstatify »

Our company is pushing everyone to use a similar offering. Most of the company is doing low value work … still using excels even though we have a custom ERP. Now seeing people who couldn’t write a coherent email before write 3 page emails. The illusion of being productive by doing more work even though it has zero impact on the bottom line. It’s insane how inefficient organisations are. No doubt we’ll have some KPI soon about using the tool.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#47

Post by behnamoh »

Buttons840 wrote: post #32
theptip wrote: post #14

Earlier quoted context omitted.

The concern is that ChatGPT is training on your chats (by default, you can opt out but you lose chat history last I checked). So in general enterprises cannot allow internal users to paste private code into ChatGPT, for example.

As an example of this. I found that GPT4 wouldn't agree with me that C(A) = C(AA^T) until I explained the proof. A few weeks later it would agree in new chats and would explain using the same proof I did presented the same way.

This is kinda creepy. But at the same time, how do they do that? I thought the training of these models stopped in September 2021/2022. So how do they do these incremental trainings?

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#48

Post by colonwqbang »

bouke wrote: post #26

How is this different from the other OpenAI GUI? Why another one by Microsoft? https://github.com/microsoft/sample-app-aoai-chatGPT .

Bigger companies are cautious about using GPT-style products due to data security concerns. But most big companies trust Microsoft more or less blindly.

Now that Microsoft has an official "enterprise" version out, the floodgates are open. They stand to make a killing.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#49

Post by Scoundreller »

nixgeek wrote: post #44
unnouinceput wrote: post #42

Earlier quoted context omitted.

OenAI IS Microsoft. Don't get tangled in the web of creating different entities when they are all part of the same pyramid. Also GitHub IS Microsoft too!!

GitHub was acquired by Microsoft, and they are no longer legally separate entities. Microsoft is an investor in OpenAI, but does not own it, and they are legally separate companies. OpenAI is not Microsoft and it is factually incorrect to claim that OpenAI is Microsoft. [1] https://blogs.microsoft.com/blog/2023/01/23/microsoftandopen...

But saying they're just an investor isn't quite doing the arrangement the justice it deserves. There seems to be a lot of strings attached to that investment.

It's not just a straight trade of dollars for shares, but many further contractual obligations.

Post reply on HN