Earlier quoted context omitted.
I would not be shocked if another open model eventually shakes out of Facebook (based on Zuckerberg's public remarks).
Which remarks? Could you share a link?
U.S. Department of Energy Launches the Genesis Open Models Initiative
51–60 of 161 posts
Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#52I wonder why it took so long.
Mostly because it's generally a bad idea for government to try to compete with a brand new tech industry with hundreds of billions in private capital developing commercial models. If the American private industry does actually wash out vs Chinese open models there might be talent available for them to put money into, so maybe they are just preparing for that scenario in the meantime.
Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#53Earlier quoted context omitted.
Mostly because it's generally a bad idea for government to try to compete with a brand new tech industry with hundreds of billions in private capital developing commercial models. If the American private industry does actually wash out vs Chinese open models there might be talent available for them to put money into, so maybe they are just preparing for that scenario in the meantime.
The American attitude is generally to let private companies build up a new industry so it can create jobs and pay taxes. However, in the LLM race, the Chinese open weight playbook pretty much killed that. China has basically commoditized LLMs. Chinese models are good enough, so the race has come down to who can offer the cheapest tokens.
What do you mean by "basically"?
Why are Anthropic's and OpenAI's annualized revenue about $50B each?
LLMs need massive amounts of compute to compete, so I wouldn't claim that the great (and leading, and likely to continue to lead) LLMs are commodities end-to-end, even if the non-executing-at-scale LLMs files and IP are commoditized. The execute, the compute, that is what breathes life into the model, which is otherwise weak or dead.
Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#54Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#55Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#56Here's an example[1] of the difference between what a U.S. Department of Energy employee adds to a ticket versus a private industry AI completing instructions as assigned.
This isn't some cherry-picked example, it's just what I happen to be dealing with right at this moment, happened just a couple of moments ago.
Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#57I've had an extremely bad experience working with Department of Energy affiliated programmers in AI. By my invitation, they are part of our workflow and act as humans in the loop, but they have extremely bad habits of gaslighting and accusing people of schizophrenia rather than getting work done. Here's an example[1] of the difference between what a U.S. Department of Energy employee adds to a ticket versus a private…
Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#58Does Europe have an equivalent program?
Re: U.S. Department of Energy Launches the Genesis Open Models Initiative
#59Earlier quoted context omitted.
The American attitude is generally to let private companies build up a new industry so it can create jobs and pay taxes. However, in the LLM race, the Chinese open weight playbook pretty much killed that. China has basically commoditized LLMs. Chinese models are good enough, so the race has come down to who can offer the cheapest tokens.
> China has basically commoditized LLMs What do you mean by "basically"? Why are Anthropic's and OpenAI's annualized revenue about $50B each? LLMs need massive amounts of compute to compete, so I wouldn't claim that the great (and leading, and likely to continue to lead) LLMs are commodities end-to-end , even if the non-executing-at-scale LLMs files and IP are commoditized. The execute, the compute, that is what brea…