Link is 404 now. Anyone fork it before it went 404?
quite a few. here's one: https://github.com/imartinez2/azurechatgpt
Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
341–349 of 349 posts
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#342Could anyone explain how this can be constructed as a private solution?
I'm not familiar with Azure platform.
Is the inference processed on private instance ? I can't imagine how it could be feasible given the hardware required to run gpt3.5/4.
So the best case scenario is:
1. A web ui runs on a private instances. So any user input (chat or files) are only seen by these instances 2. Any chat historisation or RAG is also done on these instances too. 3. Embeddings compuation may possibly be done on the private instance 4. The embeddings are then sent to the Microsoft GPU farm for inference.
So at one point my data has to leave my private network.
The problem is that the data can easily be retro-engineered from the embeddings.
How can this be presented as a private LLM ?
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#343This is awesome to see, feels heavily inspired (in a good way) by the version we made at Vercel[1]. Same tech stack: Next.js, NextAuth, Tailwind, Shadcn UI, Vercel AI SDK, etc. I'd expect this trend of managed ChatGPT clones to continue. You can own the stack end to end, and even swap out OpenAI for a different LLM (or your own model trained on internal company data) fairly easily. [1]: https://vercel.com/templates/n…
Really, they use Vercel AI SDK?
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#344This is awesome to see, feels heavily inspired (in a good way) by the version we made at Vercel[1]. Same tech stack: Next.js, NextAuth, Tailwind, Shadcn UI, Vercel AI SDK, etc. I'd expect this trend of managed ChatGPT clones to continue. You can own the stack end to end, and even swap out OpenAI for a different LLM (or your own model trained on internal company data) fairly easily. [1]: https://vercel.com/templates/n…
Really, they use Vercel AI SDK?
Well, they did. The repo appears to have been deleted.
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#345And they removed it :) [0] You're welcome. [0] https://github.com/microsoft/azurechatgpt [1] https://web.archive.org/web/20230814080150/https://github.co...
Does anybody know a fork with the last commit (9116afe)?
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#346Earlier quoted context omitted.
I guess for me it needs to have active self-reflection and the ability to act independently/without directions. I'm sure there are many other criteria if I think about it some more, but those two were missing from your list.
This is mostly just that gpt4 API/app have this disabled rather than it’s not capable. When you enable it, it is pretty shocking. And it’s pretty simple to enable. You just give it a meta instruct to decide when to message you and what to store to introspect on.
As a frequent user of the OpenAI APIs, I don't really know what you are talking about here. Could you point me to some documentation?
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#347Annnd it’s a 404. Less than a day later. The last article I see linking to it was published this morning. Not sure what happened here, but “404’s at just-announced permalinks” seems to be on the rise lately. Don’t turn me into a late-onset pedant. Fine. URIs are permanent forever! For all resources! ;)
It's disappointing. I wonder why they got cold feet. This is one of the reasons why I try to fork projects that I really like. But I didn't get around to this one until it was already made private.
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#348Earlier quoted context omitted.
Does anybody know a fork with the last commit (9116afe)?
or this: https://github.com/dandinu/azurechatgpt
They removed the Azure templates used to deploy as well, so I created an up to date tutorial on how to deploy the whole thing manually: https://tensorthinker.hashnode.dev/privategpt-a-guide-to-usi...
Re: Azure ChatGPT: Private and secure ChatGPT for internal enterprise use
#349Earlier quoted context omitted.
With Louie.ai, there is a lot of work on specialization for the job, and I expect the same for others. We help with data analysis, so connecting enterprise & common data sources & DBs, hooking up data tools (GPU visuals, integrated code interpreter, ...), security controls, and the like, which is different from say a ChatGPT for lawyers or a straight up ChatGPT UI clone. Technically, as soon as the goal is to move be…
I see this as more of a 'Migration problem'. Why is this offered as a SaaS as opposed to a consulting service? The code to organize and vectorize the documentation, endpoints and run it through a variety of models and injection prompting like two shots, etc. are going to be highly customized. The 'Base-code' there, is not exactly trivial, but anyone reading all the llama index docs can do it. Then it's just run of th…
I agree there's room for consulting, but as a new field, there's a lot of software currently missing for each vertical. Today, that's manual labor by consultants, but as the field matures... consultants should be doing things specialized to the specific customer, not what can be amortized across adjacent verticals. Top software engineers investing into software over time deliver substantially more in substantially less time, and consultants should be integrating that, not competing head-on.