Viewing profile — Tepix

An infinite number of data centers even!

Are you talking about S or XS? S is too large for a 3090 at 118b parameters.

The license is clear. Your post merely adds to the FUD.

That‘s the same price as a Keyboardio Model 100 which is split, wooden and has sculpted RGB backlit keys. Whoah. That said, big fan of that volume button!

Privacy is often a requirement.

Addendum: I was wrong, you‘ll need two of these cards.

Yes. It's called REAP and from what I've seen, results aren't stellar.

For sure if you want to properly utilize the model with several users in parallel and large context you'll want two MI350P.

If you have 2x DGX Spark it will run quite nicely. They cost only $8000 or so and use less power so you may be able to rent them cheaper than the MI300X. I found an offer to rent t…

Unfortunately, the MI300X is an OAM module. The MI350P is the one you want: It's a PCIe card, but it has less memory: 144GB. Luckily, DeepSeek V4 Flash will run in 144GB too becaus…

I share the author's sentiment. But I have another hatred: Monospace fonts in blogs. Monospace makes text harder to read and ugly. It was a necessity. It no longer is. Get over it.…

Latent space is calling the whole subject "inference engineering" in their episode https://www.latent.space/p/inference-eng

Well, INT4 is good enough apparently and it's very fast.

The latest Latent.Space episode https://www.latent.space/p/inference-eng

vLLM tested with Llama-3.3-70B-Instruct, Qwen3-30B-A3B-Instruct-2507, Qwen3-30B-A3B-Thinking-2507, and Qwen3.5-27B. I'm wondering if it needs to be tested with every other model or…

It uses javascript. Still a static file. Lets you play chess

Put it on a boat, navigate to an area with a current away from any land and then slowly release it

Why is there no orange? The entire colour palette is a bit depressing. Also my terminal (Ubuntu in WSL2) had an ugly colour palette defined by default with several identical colour…

I consider less than 4bit to be too poor quality usually. Got any benchmarks to measure quality?

Workaround: reduce font size on iPhone SE

Yes, the Dual DGX Spark looks like the sweet spot for this model for now. Good preprocessing speed. Lots of context. Fast enough for 1-5 devs perhaps. Around 8200€ as of today (use…

DS4Flash has 284B weights. 64GB? No go.

Do they do other things with the data, like selling it?

Why mention it? Just download the weights when they become available.