Viewing profile — boroboro4

For production loads? No one will run DS without expert parallelism so it’s not important for model to fit on one gpu.

The issue is it’s cpu compute which is underutilized in gpu clusters anyway, so practically it’s not really 1/1000.

It's very unclear what's special in Rubin to be optimized for inference? I can see disaggregated bit (with having separate prefill and decoding nodes), but what else?

What does it mean it's better at nvfp4 training? What's different between training and inference to make this true?

It’s crazy something which basically changes the way US government works on a such a deep level is not even on a main page of hackernews.

The core insight there is to separate value semantics (no identity) from reference (itself) semantics (nullability). While this particular change can bring very limited amount of i…

There is obvious proxy to the amount of training data - revenue. And I think anthropic is way ahead of them.

DOJ puts an accusation with clarifying text in semi private document? They don’t do this, they do much worse things (and get, rightly, much worse response). This document isn’t gre…

I somewhat agree that the whole document is sloppy, but I also think this conversation overemphasizes what is wrong with it. It is not as if the document simply accuses the journal…

But this particular one does?..

This is what great reporting looks like: well-written, transparent, and rigorous. It’s sad to see how hatred toward progressives can distort people’s judgment.

It's unclear why the most probable next token given the context "please pick random number" won't be distributed uniformly across all the possible numbers (in the end it's totally …

My bad. However billionaires don’t own tiny part of US wealth, more like 5%-10%. And top 1% (and grandparent was talking about rich people) own 1/3 of US wealth.

Total US wealth is ~170T so obviously it will be enough to cover federal and state government for a year (and more like 20 years). Even considering obvious issue of wealth going do…

While I mostly agree with you, it worth noting modern llms are trained on 10-20-30T of tokens which is quite comparable to their size (especially given how compressible the data is…

This https://github.com/niklas-heer/speed-comparison/blob/master/... and this https://github.com/niklas-heer/speed-comparison/blob/master/... from parent comment

It's not an issue of warmup time, it's an issue of jit compilation. On my server (AMD EPYC 7252): 1) base time of the java program from the repo is 3.23s (which is ~2 worse than th…

This one doesn’t even have warmup for Java, which makes results complete non sense. Those benchmarks should be just forbidden for their misleading nature.

He’s not a king to do whatever he promised as is, he’s bound by laws and constitution (which are passed by congress). Also as you were corrected there is constant goalpost moving i…

You can find stats including pending charges: https://bsky.app/profile/reichlinmelnick.bsky.social/post/3m... the main uptick in recent arrests is mostly people without any crimina…

There might be more than one reason for an ongoing crisis, and different takes on who’s responsible. However Maduro is responsible of huge number of refugees fleeing Venezuela, and…

Obviously the one which sets the law, also the one which has first article dedicated to it.

Language is just a form, what exactly is encoded inside of the model can be very different. And to encode logical reasoning inside of the weights with activation functions is more …

This being said in this setup of 2-4 h100 you’ll be able to generate with batch size of somewhere around 128 ie its 128 humans and not one. And just like that difference in efficie…

Issue with your original statement is that it implies negative correlation between intellect and being good politician. All the issues you describe (both being self serving and pow…