Non-use of enterprise data for training models is table-stakes for enterprise ML products. Google does the same thing, for example. They'll want to climb the compliance ladder to be considered in more highly-regulated industries. I don't think they're quite HIPAA-compliant yet. The next thing after that is probably in-transit geofencing, so the hardware used by an institution reside in a particular jurisdiction. This…
Are there already some profitable businesses using chatgpt i am wondering. To me the tech is really impressive. But what kind of really big commercial product exists at this point? I only know of assistants like copilot or some word assistant. But what else? Isnt this just a temporary bubble?
One aspect of working in a big company is figuring out where all the bits of specialized knowledge live, and what the company-specific processes are for getting things done. One use case for an internal chatGPT is essentially a 100% available mentor inside the company.
Explicitly calling out that they are not going to train on enterprise's data and SOC2 compliance is going to put a lot of the enterprises at ease and embrace ChatGPT in their business processes. From our discussions with enterprises (trying to sell our LLM apps platform), we quickly learned how sensitive enterprises are when it comes to sharing their data. In many of these organizations, employees are already pasting…
At the corp I work for Chat GPT (even bing) is blocked at the firewall. Hopefully now we'll be able to use it.
Well the message in this video certainly did not age well: https://www.youtube.com/watch?v=smHw9kEwcgM TLDR: This might have just killed a LOT of startups
If your entire startup was just providing a UI on top of the ChatGPT API, it probably wasn't that valuable to begin with and shutting it down won't be a meaningful loss to the industry overall.
We have a cloud offering at https://trypromptly.com . We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI , run Llama or others and connect to them from their Promptly LLM apps. We also provide support and some premium processors for en…
But, in order to generate the vectors, I understand that it's necessary to use the OpenAI's Embeddings API, which would grant OpenAI access to all client data at the time of vector creation. Is this understanding correct? Or is there a solution for creating high-quality (semantic) embeddings, similar to OpenAI's, but in a private cloud/on premises environment?
Enterprises with Azure contracts are using embeddings endpoint from Azure's OpenAI offering.
It is possible to use llama or bert models to generate embeddings using LocalAI (https://localai.io/features/embeddings/). This is something we are hoping to enable in LLMStack soon.
I hope no one will be disappointed, who has done a good job as an employee suddenly finding himself replaced by a snippet of code, after the weights have been sufficiently adjusted. It's like slurping the very last capital a worker has out of its mind and soul. Most companies exist to make a profit, not to employ humans. Paired with the pseudo-mocked-tech-bro self-peddling BS this announcement reads like dystopia to…
A common retort to this is that companies also exist to compete (and thus make a profit), so those that use AI to augment their staff rather than replace them will be at an advantage. Honestly, I can see it, but there are definitely SOME jobs at risk, and it will almost certainly reduce hiring in junior positions. I am a manager in a dev team. I have a small team and too many plates spinning, and I’ve been crying out…
Few new hires across the board will mean fewer juniors will get their foot in the door and get enough experience to become seniors. All good for those already well up the ladder, but for those below it feels like the ladder has been pulled up out of their reach
I don't know if that's a smart way to bypass pesky hidden information negotiations and suss out other party's upper bound or a really stupid way to do business...
Their decision makes sense, in a weird way. A lot of value in some SaaS apps is in the initial investment it took to build it, not in the cost to host a customer's assets. If the runtime costs of a new customer are negligible, would you rather have 0K or 20K?
Of course, I'd rather have 20K per customer
But an initial quote of 300K would likely lead to many instant rejections rather than engaging in negotiation, right? That's why I say it feels like a stupid practice, even though it could pay off really well if some company accepts outright (With the caveat that I've never been near this kind of business deal, so I'm just going off of common sense)
I don't seem to understand where OpenAI's market segment ends and Azure's begins.
It's helpful to think of OpenAI as Microsoft's R&D lab for AI without the political and regulatory burdens that MSR has to abide by. Through that lens, it's really all just the same thing. There is no endgame for OpenAI that doesn't involve being a part of Microsoft.
IIRC it is impossible for OpenAI to become part of Microsoft since the incorporation documents of the for-profit bit of OpenAI prevent anyone from having a majority of the shares (except the non-profit foundation, of course).
> unlimited higher-speed GPT-4 access aka the nerfed version. high speed means the weights were relaxed leading to faster output but worse reasoning and memory.
Or it means that the compute on the inference nodes is more efficient? Or that it’s tenanted in a way that decreases oversaturation? Or you’re getting programmatic improvements in the inference layer that are being funded by the enterprise spend?
If they had a code improvement that made inference faster without damaging capability they would roll it out everywhere. Compute is money, after all.
Worst case just add a `sleep()` to the non-enterprise version.