Viewing profile — typ

Me neither. But open weights are not open source in the first place. It wouldn't be surprising that the raw intelligence of an LLM model has little to do with the architecture (whi…

Electricity becoming a commodity doesn't necessarily make nuclear reactors become commodities. And as we can see, the publication of open-weight models doesn't really diffuse the k…

There are some benchmarks I personally trust. But the most reliable indicator other than public benchmarks is the quality of products people are working on, and the model they use …

Tokens will surely become commodities, but models don't need to. The point is that electricity becomes a commodity, rather than, say, nuclear reactors or gas turbines also need to …

Abstraction doesn't necessarily lead to a smaller binary. Much of the bloat in modern software is indeed due to (bad) abstractions.

Unlike the belief that frontier AI is expensive due to a high margin, and going to be expensive if there is no competition. My understanding is that, under certain circumstances (w…

I don't understand how knowledge, either public or private, could get damaged. Though the income of the individuals and businesses that rely on the expertise of the knowledge would…

We cannot always want to capture only the (temporary) winners whenever we see a lucrative business and expect to share a free ride. I'd also assume that most of the revenue these A…

Low latency is nice. But it would be more interesting if they could demonstrate the efficiency of energy consumption.

> an open training source model It's always funny to see people tempted to call open-blobs/open-weights, which are literally shareware like WinRAR or Adobe PDF Viewer, open source …

A thousand 90 IQ cannot do what a 145 IQ can do. Similarly, some bosses might believe that they can hire 100 cheap, unmotivated SWEs to replace Linus Torvalds or Fabrice Bellard an…

It takes billions of investments for infrastructure, and a high-paying, top-notch team for R&D and operations. Not just a bunch of torrents of pirated books. Let alone the best mod…

I don't think that learning from textbooks to take an exam and learning from the answers of another student taking the exam are the same. Joking aside, I also don't believe that ma…

6% compared to the post-2000s is mediocre, especially given the low baseline. Not remarkably better than other high-income democratic countries like Japan and West Germany. Even th…

American business leaders have (had?) an obsession with gross margin and tech "advancedness." They thought they would be the winner as long as they occupied the high-tech sectors i…

If that were the true secret sauce of the economic success in China, why had it not taken off before the 2000s? Like, they have been that "aligned" and "want the same thing" and "r…

The silicon shield became a slogan that has only been popularized in recent years. The potential crisis of war has been there for more than half a century (even before semiconducto…

I'd bet, on average, the quality of proprietary code is worse than open-source code. There have been decades of accumulated slop generated by human agents with wildly varied skill …

> reduce energy requirement by 10-50 times This is only relevant to the compute productivity (how much useful work it can produce), but it's irrelevant to the heat dissipation prob…

That should be better than a sphere. Though I imagine there could be some fancier 3D geometry designs. Even for a simple sphere, if we give it different surface roughnesses on the …

Assuming that we place an iron ball (ideal sphere-shaped and thermal conductivity) on the SSO (solar synchronous orbit), how hot can the object be? Given the solar constant 1361 W/…

The radiator area is probably not what they need to worry about that much as we thought. When the energy input comes from solar 100%, they just need to optimize the ratio of the se…

Not sure about the effectiveness of a heat pump in this use case. >Heat radiation works better the higher the temperature? The power output is proportional to T^4 according to the …

It makes sense to target a higher operating temperature, like 375K. At some point, the energy budget would reach an equilibrium. The Earth constantly absorbs solar energy and also …

The label 'open source' has become a reputation reaping and marketing vehicle rather than an informative term since the Hugging Face benchmark race started. With the weights only, …