Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

github.com

Post reply on HN
Print view View original

321–330 of 349 posts

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#321

Post by dandiep »

borissk wrote: post #318
dandiep wrote: post #207

Earlier quoted context omitted.

Using GPT3.5/4 in our language learning app and people seem to enjoy it. [1] Tried Llama2 and it definitely doesn’t even come close for what we’re doing. Would absolutely need fine tuning. Maybe customers don’t enjoy chat bots for customer support, but there are a million other uses for these models. I, for example, LOVE github copilot. 1. https://squidgies.app

Cool app. Wonder if you can potentially use a combination of Llama2 and GPT - to save costs on using the OpenAI API.

Costs really aren’t a concern compared to speed of development and quality.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#322

Post by TeMPOraL »

Maxion wrote: post #241
nl wrote: post #218

Earlier quoted context omitted.

If you read the Llama2 paper it is very clear that small amounts of data (thousands of records) make vast difference at the instruction turning stage. From the Llama2 paper: > Quality Is All You Need. > Third-party SFT data is available from many different sources, but we found that many of these have insufficient diversity and quality — in particular for aligning LLMs towards dialogue-style instructions. As a result…

This quote is quite funny taken out of context like this. Top AI researchers find that garbage in === garbage out.

It's somewhat insightful if you consider that, at high level, the major theme of the past decade was, "lots of garbage in === good results out", quantity >> quality.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#323

Post by TeMPOraL »

ReptileMan wrote: post #257
ttul wrote: post #162

Earlier quoted context omitted.

Llama 2 might by some measures be close to GPT 3.5, but it’s nowhere near GPT 4, nor Anthropic Claude 2 or Cohere’s model. The closed source players have the best researchers - they are being paid millions a year with tons of upside - and it’s hard to keep pace with that. My sense is that the foundation model companies have an edge for now and will probably stay a few steps ahead of the open source realm simply for e…

Linux started in the same position. Sometimes the underdogs win.

Linux "won" by playing different game. Yes, it spread out and is now everywhere, underpinning all computing. But the "game" wasn't about that - it was competing with Windows for mind-share and money with users, and by proxy for profitability. In this, it's still losing badly. People are still not using it knowingly (no, Android is not "Linux"), and developers in its ecosystem are not making money selling software.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#324

Post by borissk »

dandiep wrote: post #321
borissk wrote: post #318

Earlier quoted context omitted.

Cool app. Wonder if you can potentially use a combination of Llama2 and GPT - to save costs on using the OpenAI API.

Costs really aren’t a concern compared to speed of development and quality.

A lot of people who were using say Google Maps in their apps thought the same thing, until Google drastically increased the prices...

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#325

Post by tsunamifury »

lsaferite wrote: post #312
tsunamifury wrote: post #306

Earlier quoted context omitted.

I consider GPT4 AGI, so I'm probably not the one to ask this too. It reasons, it understands sophisticated topics, it can be given a purpose and pursue it, it can communicate with humans, and it can perform a reasonable task considering its modalities. I don't really know what any sort of "big leap" beyond this people are expecting, incremental performance for sure. But what else?

I guess for me it needs to have active self-reflection and the ability to act independently/without directions. I'm sure there are many other criteria if I think about it some more, but those two were missing from your list.

This is mostly just that gpt4 API/app have this disabled rather than it’s not capable.

When you enable it, it is pretty shocking. And it’s pretty simple to enable. You just give it a meta instruct to decide when to message you and what to store to introspect on.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#326

Post by coder543 »

moneywoes wrote: post #297
nl wrote: post #218

Earlier quoted context omitted.

If you read the Llama2 paper it is very clear that small amounts of data (thousands of records) make vast difference at the instruction turning stage. From the Llama2 paper: > Quality Is All You Need. > Third-party SFT data is available from many different sources, but we found that many of these have insufficient diversity and quality — in particular for aligning LLMs towards dialogue-style instructions. As a result…

SFT?

Supervised Fine Tuning, I believe.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#327

Post by nl »

dr_dshiv wrote: post #300
nl wrote: post #273

Earlier quoted context omitted.

Llama 2 wasn't trained on ChatGPT/GPT4. I think maybe you are thinking of the Vicuna models? https://lmsys.org/blog/2023-03-30-vicuna/

So it’s true that it would violate the OpenAI terms for Llama to be trained with ChatGPT completions, but how do we know? We don’t know the training data for Llama, we just get weights.

The Llama2 paper describes the training data in some detail.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#329

Post by wodenokoto »

borissk wrote: post #319
byteknight wrote: post #317

And they removed it :) [0] You're welcome. [0] https://github.com/microsoft/azurechatgpt [1] https://web.archive.org/web/20230814080150/https://github.co...

I can imagine how the conversation went with the enterprise customers: "Where does this send the data our employees enter?" "Same place as if they used the free ChatGPT chat bot..."

No it doesn't. It sends it to an LLM hosted inside the Enterprises own Azure Subscription.

Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use

#330

Post by aa-morgan »

byteknight wrote: post #317

And they removed it :) [0] You're welcome. [0] https://github.com/microsoft/azurechatgpt [1] https://web.archive.org/web/20230814080150/https://github.co...

If anyone needs access to the code, you just need to /forks on the web.archive link above and download from there. i.e. https://web.archive.org/web/20230814150922/https://github.co... (the cache ID updates when you change the URL)
Post reply on HN