Viewing profile — mratsim

In my case with vLLM on dual RTX Pro 6000 gpt-oss-120b: (unknown prefill), ~175 tok/s generation. I don't remember the prefill speed but it certainly was below 10k Nemotron-3-Super…

Exact instruction challenge https://www.youtube.com/watch?v=cDA3_5982h8

Years ago I started a collection of convolution optimization resources: https://github.com/mratsim/laser/wiki/Convolution-optimisati... Also checked and apparently Nvidia Cutlass n…

The Internet Engineering Task Force, which in particular standardizes TLS, has acknowledge my contributions for my contributions to the very generic and globally useful hashing-to-…

BLS signatures are general purpose, the only Ethereum specific thing is choosing which elliptic curves are used for public keys and which for signatures as well as a prefix before …

Great question, first of all I did extensive research https://github.com/mratsim/constantine/wiki/Constant-time-ar... . Then the library defines its own types SecretBool and Secret…

Author here, adding an accompanying post focused on performance: https://ethresear.ch/t/releasing-constantine-v0-1-0-a-modula...

According to the US, an US citizen just have to open a bank account anywhere in the world and the law applies, regardless of where the bank is hosted.

Reminded me of Bastiat's candlestick maker's petition: http://bastiat.org/en/petition.html

Why is it different? People don't have to comply to GDPR but if they want to serve EU folks then they don't have a choice.

What would be the 7 dimensions?

That was my reasoning for this "restriction".

Author here, Nim supports variadic generic, it's an arbitrary limitation so that shape and stride small vectors that describe a tebsor can be stack-allocated and fit in a cacheline…

They always take two months at the very minimum as well because buyers as to go to many banks or a loan broker. You have notaries involved and right to step away from a sale, no qu…

Overpromise and underdeliver. And lots of funding for then vaporware

idiv is not constant-time on any ISA anyway ;)

Percival cache attacks on Hyperthreading. I go over some examples here: https://github.com/mratsim/constantine/issues/358#issuecomme...

I've written and given a lot of references to attacks, countermeasures, fighting the compilers and even non-cryptographic side-channel attacks to uncover someone's Twitter identity…

Venmo, CashApp, Paypal "Friends or Family" and gift cards (Apple, Google Pay, Steam, ...) are all irreversible.

The same problem as with passwords that has been plagging the security industry for decades. Passwords, credentials and other high-risk high value intangible data are not associate…

Or for some there is a national base price.

It is a French company so maybe they have extra French datasets? I've been quite disappointed by French LLMs on Huggingface when I tried a month ago.

> In a way, I think you're absolutely correct that it's harder to change anything, but not because the method is wrong; it's because it addresses the fundamental issue of tradition…

When there is an emergency to break into a house, the police needs to get a mandate from a judge.

GPU drivers provide an event system: - Cuda: https://github.com/mratsim/weave/issues/133 - OpenCL: https://github.com/mratsim/weave/issues/134