Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

Post by pseudosavant » Mon, Aug 14, 2023, 2:23 AM UTC

pyrophane wrote: post #181

jmorgan wrote: post #152

This appears to be a web frontend with authentication for Azure's OpenAI API, which is a great choice if you can't use Chat GPT or its API at work. If you're looking to try the "open" models like Llama 2 (or it's uncensored version Llama 2 Uncensored), check out https://github.com/jmorganca/ollama or some of the lower level runners like llama.cpp (which powers the aforementioned project I'm working on) or Candle, the…

> While I haven't tested it extensively, 70B model is supposed to rival Chat GPT 3.5 in most areas, and there are now some new fine-tuned versions that excel at specific tasks That has been my experience. Having experimented with both (informally), Llama 2 is similar to GPT-3.5 for a lot of general comprehension questions. GPT-4 is still the best amongst the closed-source, cutting edge models in terms of general conv…

Post by RockyMcNuts » Mon, Aug 14, 2023, 2:24 AM UTC

jeffschofield wrote: post #146

H8crilA wrote: post #139

What's the practical difference between this and OpenAI API? All I can see is the same product but offered by a larger organization. I.e. they're more likely to get the security details right, and you can potentially win more in a lawsuit should things go bad.

A few months ago my team moved to Azure for capacity reasons. We were constantly dealing with 429 errors and couldn't get in touch with Open AI, while Azure offered more instances. Eventually got more from Open AI so we load balance both. The only difference is the 3.5 turbo model on Azure is outdated.

Post by mycall » Mon, Aug 14, 2023, 2:31 AM UTC

smoldesu wrote: post #185

MuffinFlavored wrote: post #171

Earlier quoted context omitted.

can I fine tune it on like 2,000 repos at a corporation (code based) and have it understand the architecture?

I don't think you can do that with any AI models. It almost feels like a fundamental misrepresentation of how they work. You could fine-tune a conversational AI on your codebase, but without loading said codebase into it's context it is "flying blind" so-to-speak. It doesn't understand the data structure of your code, the relation between files and probably doesn't confidently understand the architecture of your syst…

Post by hooande » Mon, Aug 14, 2023, 2:35 AM UTC

xcdzvyn wrote: post #197

ttul wrote: post #162

Earlier quoted context omitted.

Llama 2 might by some measures be close to GPT 3.5, but it’s nowhere near GPT 4, nor Anthropic Claude 2 or Cohere’s model. The closed source players have the best researchers - they are being paid millions a year with tons of upside - and it’s hard to keep pace with that. My sense is that the foundation model companies have an edge for now and will probably stay a few steps ahead of the open source realm simply for e…

> The closed source players have the best researchers Is that definitely why? GPT 3.5 and GPT 4 are far larger than 70B, right? So if a 70B, local model like LLaMA can even remotely rival them, would that not suggest that LLaMA is fundamentally a better model? For example, would a LLaMA model with even half of GPT 4's parameters be projected to outperform it? Is that how it works? [I'm not super familiar with LLM tec…

Post by hieu229 » Mon, Aug 14, 2023, 2:38 AM UTC