I'm struggling to think of a federal job in which having ChatGPT would make them more productive. I can think of many ways to generate more bullshit and emails, however. Can someone help me out?
[deleted]
Providing ChatGPT to the U.S. federal workforce
61–70 of 187 posts
Re: Providing ChatGPT to the U.S. federal workforce
#62Earlier quoted context omitted.
I'd rather interact with an AI than federal workers 80% of the time.
Absolutely not. Fed workers are epic. Get out of here with that nonsense.
You're making a very big generalization; just like any organization, there are great and terrible workers and everyone in between.
Re: Providing ChatGPT to the U.S. federal workforce
#63Earlier quoted context omitted.
I don’t think these companies have a lot of power to increase prices due to the very strong competition. I think it’s more likely that they will become profitable by significantly cutting costs and capital expenditures in the long run. Models are becoming more efficient. Lots of capacity is coming online, and will eventually meet the global needs. Hardware is getting better and with more competition, probably will be…
There is no strong competition, there’s probably 4 or 5 companies around the world that have the capacity to actually have data centres big enough to serve traffic at scale. The rest are just wrappers.
Are rack servers and GPUs no longer manufactured?
Re: Providing ChatGPT to the U.S. federal workforce
#64Earlier quoted context omitted.
Do these model releases really matter to cost if the hardware is still so very expensive and Nvidia still has a defacto monopoly? I can't buy x8 H100s to run a model and whatever company I buy AI access from has to pay for them somehow.
I find it unlikely that the margins on inference hardware will remain anywhere near as high as they are right now. Inference at scale can be complex, but the complexity is manageable. You can do fancy batched inference, or you can make a single pass over the relevant weights for each inference step. With more models using MoE, the latter is more tractable, and the actual tensor/FMA units that do the bulk of the math…
Is there a viable non-Nvidia vendor for inference at scale? AMD? Or is in-house hardware like Google and Amazon?
Re: Providing ChatGPT to the U.S. federal workforce
#65Earlier quoted context omitted.
> access to AI is way cheaper than it will be in the next 5-10 years. That evidently won't be the case as you can see with the recent open model announcements...
Do these model releases really matter to cost if the hardware is still so very expensive and Nvidia still has a defacto monopoly? I can't buy x8 H100s to run a model and whatever company I buy AI access from has to pay for them somehow.
Assuming we continue to see real competition at running open source models and there isn’t a supply bottleneck, it will make it hard to sell access at much more than cost. So, prices might go up compared to companies selling service at a loss, but there’s a limit.
Maybe someone knows which providers are selling access roughly at cost and what their prices are?
Re: Providing ChatGPT to the U.S. federal workforce
#66Right now AI is in the grow at all costs phase. So for the most part access to AI is way cheaper than it will be in the next 5-10 years. All these companies will eventually have to turn a profit. Once that happens, they'll be forced to monetize in whatever way they can. Enterprise will obviously have higher subscriptions. But I'm predicting for non-enterprise that eventually ads will be added in some way. What's scar…
> I'm predicting for non-enterprise that eventually ads will be added in some way. Google has been doing this since May. https://www.bloomberg.com/news/articles/2025-04-30/google-pl...
How do you get an AI model to serve ads to the user without risking misalignment, insofar as users typically don’t want ads in responses?
Re: Providing ChatGPT to the U.S. federal workforce
#67I'm struggling to think of a federal job in which having ChatGPT would make them more productive. I can think of many ways to generate more bullshit and emails, however. Can someone help me out?
I'm struggling to think of a federal job in which anything, AI or otherwise, would make them more productive.
Re: Providing ChatGPT to the U.S. federal workforce
#68this is excellent business approach. best way to get away with stealing is to make everyone thief.
Re: Providing ChatGPT to the U.S. federal workforce
#69Right now AI is in the grow at all costs phase. So for the most part access to AI is way cheaper than it will be in the next 5-10 years. All these companies will eventually have to turn a profit. Once that happens, they'll be forced to monetize in whatever way they can. Enterprise will obviously have higher subscriptions. But I'm predicting for non-enterprise that eventually ads will be added in some way. What's scar…
There's nothing wrong w/ turning a profit. It's subsidized now but there's really not much network effects. Nothing leads me to believe that one company who can blow the most amount of money early on will have a moat. There is no moat, especially for something like this.
In fact it's a lot easier to compete since you see the frontier w/ these new models and you can use distillation to help train yours. I see new "frontier" models coming out every week.
Sure there will be some LLMs with ads, but there will be plenty without. And if there aren't there would be a huge market opportunity to create on. I just don't get this doom and gloom.
Re: Providing ChatGPT to the U.S. federal workforce
#70Earlier quoted context omitted.
> I'm predicting for non-enterprise that eventually ads will be added in some way. Google has been doing this since May. https://www.bloomberg.com/news/articles/2025-04-30/google-pl...
How do you get an AI model to serve ads to the user without risking misalignment, insofar as users typically don’t want ads in responses?
Shareholder alignment is the only one that a corporation can value.