31–40 of 75 posts
Why would gov agencies rely on 3rd party services while they could deploy opensource LLMs locally and privately?
That, and imagine trying to explain the funding request for that to the residents of the crypt... I mean, the current US Congress.
Stuff like this troubles me. I am in defense tech working with LLMs and I am here to tell you the guards and fences are down at the chow truck while commoners are using LLMs.
I don't really understand why people bash so hard on LLMs. In some cases it is a spectacularly bad tool, I get that. But it is only a tool. Imagine if you have a judge giving out sentences based on astrology books. I don't think anyone would argue the problem would be resolved by banning astrology books from our libraries.
Banning books does not ban knowledge. It just makes it a bit more inconvenient. Banning drugs has not stopped people from getting access.
Sounds like a desperate move, now that the insane valuations, GPU capacity projections, and subscription revenue are at risk.
Stuff like this troubles me. I am in defense tech working with LLMs and I am here to tell you the guards and fences are down at the chow truck while commoners are using LLMs.
Earlier quoted context omitted.
> I am here to tell you the guards and fences are down at the chow truck while commoners are using LLMs. I've read this over and over and have no idea what this means.
I hate to be that guy, but here's what ChatGPT says: This expression uses metaphorical language to describe a situation where traditional barriers, hierarchies, or protections have been removed, allowing broader access or disrupting the status quo. Here's a breakdown: 1. "Guards and fences are down" - This implies that the usual controls, restrictions, or gatekeepers are no longer in place. 2. "At the chow truck" - T…
This should be unsurprising- see also govcloud: https://aws.amazon.com/govcloud-us The US government likes its employees and contractors to have their own separate version of cloud products. For instance you would not want OpenAI using prompts about controlled unclassified information as training data. Most of the things government contractors do is CUI- you don't want it spread around, but it's not actually a secret…
Would they have shielded instances from rest of instances processing data for plus/pro/enterprise customers?
I expect as much. Having going through FedRAMP before, the alternative would be to make their regular commercial infrastructure be up to FedRAMP standards, which is incredibly onerous (things like change tracking, DR, US Citizen access only to production systems, etc.)
What if the employees building the thing are not US citizens?
Why would gov agencies rely on 3rd party services while they could deploy opensource LLMs locally and privately?
Earlier quoted context omitted.
> I am here to tell you the guards and fences are down at the chow truck while commoners are using LLMs. I've read this over and over and have no idea what this means.
I hate to be that guy, but here's what ChatGPT says: This expression uses metaphorical language to describe a situation where traditional barriers, hierarchies, or protections have been removed, allowing broader access or disrupting the status quo. Here's a breakdown: 1. "Guards and fences are down" - This implies that the usual controls, restrictions, or gatekeepers are no longer in place. 2. "At the chow truck" - T…
Why would gov agencies rely on 3rd party services while they could deploy opensource LLMs locally and privately?