Copilot has enterprise controls. Its not open source. This is the easiest integration and large companies are eating it up as the path of least friction, using API cost calls. I call BS.
Corporate America is getting hooked on open-source AI
311–315 of 315 posts
Re: Corporate America is getting hooked on open-source AI
#312Anecdata: I use opensource models at work because my work is too cheap to spring for a $20/mo account for me. Since HuggingFace models can be run on my laptop now (still very slow though), nothing is leaving the 'secure environment' and so I can actually get work done (instead of the 'old' version of coding and writing - google).
You still need the models to be able to perform web searches, don't you? In which case the data goes in and out of your machine and there is risk for prompt injection attacks. I think it's needed at least for documentation purposes.
Oh, I ask for help with code, yes, but the actual data I'm working on doesn't ever leave the environment.
Re: Corporate America is getting hooked on open-source AI
#313Earlier quoted context omitted.
however, you can test the model, by asking it things. What are you concerned is hiding inside of that big block of numbers? Order 66?
this also applies to proprietary black box software. You can still test it, interact with it
the difference is, that a model is literally just numbers.
proprietary software is data and code, and while it's true that code is data, the difference is that some data is intended to be for control flow, while in a model it is all the same stuff.
You can point to any single part of an LLM's model and say "this here is a weight" but if you point to any single part of a binary file you will have no idea what you're looking at.
And yes, you could decompile the binary, but that still doesn't give you the entire picture, and all proprietary software does the shady shit on servers these days anyway so you're not even going to find anything interesting.
Re: Corporate America is getting hooked on open-source AI
#314Earlier quoted context omitted.
this also applies to proprietary black box software. You can still test it, interact with it
the difference is, that a model is literally just numbers. proprietary software is data and code, and while it's true that code is data, the difference is that some data is intended to be for control flow, while in a model it is all the same stuff. You can point to any single part of an LLM's model and say "this here is a weight" but if you point to any single part of a binary file you will have no idea what you're l…
it isn't really just numbers though.
what if i want to change out the middle part of the training, and then still run the rest as before? or if i want to cull a bunch of the initial training set?
a binary is also just numbers, but we know there's other parts to it
Re: Corporate America is getting hooked on open-source AI
#315Earlier quoted context omitted.
Post-IPO I'd trust the American models far far less than the Chinese models. The most insidious advertising in the world is about to be surfaced as people use LLMs to look for product recommendations.
It's wild that people are so lost in the sauce of social media that they have no qualms handing over all their data to an authoritarian ethno state with a single ruler who appointed themselves for life with unrestricted unilateral control over every aspect of the state. And here we are calling for collapse because mom might get recommended Gain instead of Tide.
trump has named himself dictator for life now? when did that happen?