Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

github.com

Post reply on HN
Print view View original

311–320 of 349 posts

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#311

Post by BoorishBears »

robga wrote: post #309
BoorishBears wrote: post #276

Earlier quoted context omitted.

Can you expand on this because that's pretty alarming... What kind of volume were you doing and did you use the API for anything other than your listed use case when applying?

6 x 1000 token calls per day, for a news bot (listed use case at application). I think what happened is the azure subscription was converted from a (multi year) promotional subsidy/discount to a full pay as you go subscription. No change to sub id. Payment methods OK. Everything else continued working, but openai gpt-4 access stopped the next day. I’d rather use the Azure version because they promise 12-month sunsets…

You should contact support and if you're up for it document how that goes.

Azure is mostly better for production: the developer experience is awful and the default filtering is more aggressive, but you get dedicated capacity by default which improves latency (something you need to negotiate with OpenAI's sales team for otherwise)

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#312

Post by lsaferite »

tsunamifury wrote: post #306
yowlingcat wrote: post #251

Earlier quoted context omitted.

Is it unfair to consider this some kind of correlate to the Nyquist theorem that makes me skeptical of even the theoretical possibility of AGI claims?

I consider GPT4 AGI, so I'm probably not the one to ask this too. It reasons, it understands sophisticated topics, it can be given a purpose and pursue it, it can communicate with humans, and it can perform a reasonable task considering its modalities. I don't really know what any sort of "big leap" beyond this people are expecting, incremental performance for sure. But what else?

I guess for me it needs to have active self-reflection and the ability to act independently/without directions. I'm sure there are many other criteria if I think about it some more, but those two were missing from your list.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#313

Post by stolsvik »

baobabKoodaa wrote: post #307
stavros wrote: post #109

Earlier quoted context omitted.

The distinction between GPT-4 and ChatGPT is blurry, as ChatGPT is a chat frontend for a GPT model, and you can use GPT-4 with ChatGPT. The parent probably means ChatGPT with GPT-4.

Typically when people say "ChatGPT" without specifying which specific model they refer to, they refer to gpt-3.5-turbo (in case of API - or in case of the web ui, they mean whatever model is its current web ui equivalent). But now OP says they meant GPT-4, so, sure.

Counterpoint: I don’t refer to 3.5 when I say ChatGPT. I pay for ChatGPT, and always use GPT-4. Which I believe every paying customer do.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#314

Post by tcarambat1010 »

Im not surprised Azure would add something like this to the stack. We build AnythingLLM (https://github.com/Mintplex-Labs/anything-llm) back in June due to some enterprise customers wanting something isolated they could run on premises with Azure OpenAI support + any vector DB they want.

With Azure's move to try to internalize any enterprise integration for AI it makes sense to make a chatbot wrapper because its a no-moat move. I think a lot of the "moat" if one can exist in the "chat with your docs" vertical is just integrations into flows and data sources SMB/Enterprises are already using.

For businesses, in my experience, the on-prem thing has been the first decision point - without question. Azure wrapper could be nice to have for those who cannot use chatGPT on the work comp but have access to this instead.

I wonder what kind of hypervisor view it gives to Azure admins for those who use it - it any. Multi-tenant instances was the second highest demand from SMB/Enterprise customers for AnythingLLM.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#315

Post by b33j0r »

Annnd it’s a 404.

Less than a day later. The last article I see linking to it was published this morning.

Not sure what happened here, but “404’s at just-announced permalinks” seems to be on the rise lately.

Don’t turn me into a late-onset pedant. Fine. URIs are permanent forever! For all resources! ;)

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#318

Post by borissk »

dandiep wrote: post #207
jgalt212 wrote: post #176

Earlier quoted context omitted.

OK, fair enough. Please give me an example of a customer facing chatbot that Llama 2 (and unbearable to use) and GPT 4 customer facing chatbot that is a joy to use. I think at the end of the day, you still have customers dreading such interactions.

Using GPT3.5/4 in our language learning app and people seem to enjoy it. [1] Tried Llama2 and it definitely doesn’t even come close for what we’re doing. Would absolutely need fine tuning. Maybe customers don’t enjoy chat bots for customer support, but there are a million other uses for these models. I, for example, LOVE github copilot. 1. https://squidgies.app

Cool app.

Wonder if you can potentially use a combination of Llama2 and GPT - to save costs on using the OpenAI API.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#319

Post by borissk »

byteknight wrote: post #317

And they removed it :) [0] You're welcome. [0] https://github.com/microsoft/azurechatgpt [1] https://web.archive.org/web/20230814080150/https://github.co...

I can imagine how the conversation went with the enterprise customers: "Where does this send the data our employees enter?" "Same place as if they used the free ChatGPT chat bot..."
Post reply on HN