Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

github.com

Post reply on HN
Print view View original

251–260 of 349 posts

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#251

Post by yowlingcat »

tsunamifury wrote: post #246
kuchenbecker wrote: post #120

Earlier quoted context omitted.

I feel like we're describing short vs long term memory.

That’s exactly what it is. It’s just it turns out you need very good generalized or focused simple reasoning to do accurate compression or else the abstraction and movement to long term memory doesn’t include the most important content. Or worse distracting details. I’ve been working on short and long term memory windows at allofus.ai for about 6 months now and it’s way more complex than I had originally thought it w…

Is it unfair to consider this some kind of correlate to the Nyquist theorem that makes me skeptical of even the theoretical possibility of AGI claims?

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#252

Post by kiratp »

Roark66 wrote: post #244

Private and secure? I thought the main issue with privacy and security of (not at all)OpenAI models is that by using their products you agree for them to retain all the data you send and receive from the models forever for whatever they choose to use it for. Or is this just a thing for free use? If you pay, do you get a Ts&Cs that don't contain any wording like this? Still, even if there was no specific "we own every…

> Starting on March 1, 2023, we are making two changes to our data usage and retention policies:

> OpenAI will not use data submitted by customers via our API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data.

> Any data sent through the API will be retained for abuse and misuse monitoring purposes for a maximum of 30 days, after which it will be deleted (unless otherwise required by law).

https://openai.com/policies/api-data-usage-policies

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#253

Post by pietz »

Roark66 wrote: post #244

Private and secure? I thought the main issue with privacy and security of (not at all)OpenAI models is that by using their products you agree for them to retain all the data you send and receive from the models forever for whatever they choose to use it for. Or is this just a thing for free use? If you pay, do you get a Ts&Cs that don't contain any wording like this? Still, even if there was no specific "we own every…

The Azure SLAs state that neither the chats are stored nor used for training in any way. They are private and protected in the same way all the other sensitive data is stored on Azure.

On top, you might argue that Microsoft and Azure are easier to trust than a still rather new AI startup.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#254

Post by CodeCompost »

pyrophane wrote: post #181
jmorgan wrote: post #152

This appears to be a web frontend with authentication for Azure's OpenAI API, which is a great choice if you can't use Chat GPT or its API at work. If you're looking to try the "open" models like Llama 2 (or it's uncensored version Llama 2 Uncensored), check out https://github.com/jmorganca/ollama or some of the lower level runners like llama.cpp (which powers the aforementioned project I'm working on) or Candle, the…

> While I haven't tested it extensively, 70B model is supposed to rival Chat GPT 3.5 in most areas, and there are now some new fine-tuned versions that excel at specific tasks That has been my experience. Having experimented with both (informally), Llama 2 is similar to GPT-3.5 for a lot of general comprehension questions. GPT-4 is still the best amongst the closed-source, cutting edge models in terms of general conv…

Can it handle other languages besides English?

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#255

Post by politelemon »

Roark66 wrote: post #244

Private and secure? I thought the main issue with privacy and security of (not at all)OpenAI models is that by using their products you agree for them to retain all the data you send and receive from the models forever for whatever they choose to use it for. Or is this just a thing for free use? If you pay, do you get a Ts&Cs that don't contain any wording like this? Still, even if there was no specific "we own every…

The models like gpt themselves are inherently private and secure. They make predictions based on input.

It's what happens in the interface, that is your web chat or API call, which is different per implementation. ChatGPT is an implementation that uses that model and its maker OpenAI wants to keep your history for further training.

But what Azure is doing is taking that model and putting it behind an endpoint specific to your Azure account. Businesses have been interested in gpt, so asking for private endpoints. Amazon is doing the same with Bedrock.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#256

Post by AnthonyMouse »

saberience wrote: post #248
llm_thr wrote: post #216

Earlier quoted context omitted.

You seriously underestimate just how much _not_ having to tune your llm for SF sensibilities benefits performance. As an example from the last six months: people on tor are producing better than state of the art stable diffusion because they want porn without limitations. I haven't had the time to look at llm's but the degenerates who enjoy that sort of thing have said they can get the Llama2 model to role play their…

What do you mean by "tune for SF" ?

San Francisco sensibilities. A model trained on a large data set will have the capacity to emit all kinds of controversial opinions and distasteful rants (and pornography). Then they effectively lobotomize it with a rusty hatchet in an attempt to censor it from doing that, which impairs the output quality in general.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#257

Post by ReptileMan »

ttul wrote: post #162
jmorgan wrote: post #152

This appears to be a web frontend with authentication for Azure's OpenAI API, which is a great choice if you can't use Chat GPT or its API at work. If you're looking to try the "open" models like Llama 2 (or it's uncensored version Llama 2 Uncensored), check out https://github.com/jmorganca/ollama or some of the lower level runners like llama.cpp (which powers the aforementioned project I'm working on) or Candle, the…

Llama 2 might by some measures be close to GPT 3.5, but it’s nowhere near GPT 4, nor Anthropic Claude 2 or Cohere’s model. The closed source players have the best researchers - they are being paid millions a year with tons of upside - and it’s hard to keep pace with that. My sense is that the foundation model companies have an edge for now and will probably stay a few steps ahead of the open source realm simply for e…

Linux started in the same position. Sometimes the underdogs win.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#258

Post by actionfromafar »

kiratp wrote: post #252
Roark66 wrote: post #244

Private and secure? I thought the main issue with privacy and security of (not at all)OpenAI models is that by using their products you agree for them to retain all the data you send and receive from the models forever for whatever they choose to use it for. Or is this just a thing for free use? If you pay, do you get a Ts&Cs that don't contain any wording like this? Still, even if there was no specific "we own every…

> Starting on March 1, 2023, we are making two changes to our data usage and retention policies: > OpenAI will not use data submitted by customers via our API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data. > Any data sent through the API will be retained for abuse and misuse monitoring purposes for a maximum of 30 days, after whi…

Unless required by law… I wonder what law.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#259

Post by cosbgn »

scrum-treats wrote: post #224
cosbgn wrote: post #123

Earlier quoted context omitted.

You can use unfetch.com to make API calls via LLMs and build automations. (I'm building it)

Is it possible to not use Google with unfetch.com?

Google is just so easy for login. No need to deal with password forgot, reset, email verification etc. But I'll add login via magic link soon.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#260

Post by kiratp »

devjab wrote: post #249
osigurdson wrote: post #234

I'm a little confused by how the relationship works between OpenAI and Microsoft. It is possible for anyone to register for an OpenAI account and use their APIs. Within Azure the same thing is much more difficult as it is necessary to be a "real" business in order to use it. I maintain an open source OpenAI library and would like to add support for Azure but can't because of this restriction. Why can't I just use my…

Microsoft owns enough of OpenAI that their endgame goal of putting GPT like features into Azure and Office365 for enterprise customers is what we’re likely to see happen. OpenAI will likely target private consumers while Microsoft focuses on enterprise. I can use my own organisation as an example. We’re an investment bank that does green energy within the EU. We would absolutely use GPT if it was legal, but it isn’t,…

OpenAI APIs have pretty much as clear a contract as you can get with a third party.

> Starting on March 1, 2023, we are making two changes to our data usage and retention policies:

> OpenAI will not use data submitted by customers via our API to train or improve our models, unless you explicitly decide to share your data with us for this purpose. You can opt-in to share data.

> Any data sent through the API will be retained for abuse and misuse monitoring purposes for a maximum of 30 days, after which it will be deleted (unless otherwise required by law).

https://openai.com/policies/api-data-usage-policies

Post reply on HN