Viewing profile — jbellis

I'm so old I can remember when ars technica published actual technical content.

Why less workflow friction?

The only scenario is if you have enough work to do batch inference. Using a tiny fraction of GPU capacity to decode a single request at a time just doesn't make sense, as you say.

Yes, look up REAP.

Apparently this is an unpopular opinion on HN, but a job isn't an output that companies produce, it's an agreement to compensate an employee in exchange for services, and just as t…

It's roughly equal on price and intelligence as GLM 5.2 while being ~8x faster.

I guess you didn't read ellie's reply directly underneath that?

It tops benchmarks because it uses them in its training data. https://x.com/eliebakouch/status/2077425801633427919

This just isn't true. On balance, data centers are turning out to be more like the "anchor tenant" of the power grid, financing improvements for everyone. Overview article with lin…

voyage 4 nano is sota at the next size up and if you really want the best teacher models it's probably the voyage commercial APIs

FWIW -- Granite r2 small is a 30M model, still small enough to run on CPU, and a good baseline for fine tunes.

Yes, disappointing given that Chronicle actually does have legit expertise here. (Chronicle Map is not very well-known even in the Java space but it's by far the best larger-than-m…

That's a reasonable option, just be aware that you get about 1/3 as much memory bandwidth with the M5 Pro, or 2/3 with the M5 Max [now you're at $4100 for the lowest-end]. So both …

It's no mystery. https://en.wikipedia.org/wiki/Anders_Hejlsberg

I feel bad that I wasted my time reading this. On the points in the article: 1. Yes, "gain" is a vanity metric but it's harmless, nobody is being "fooled" here. 2. This could be a …

man, Tom Lane has hated query hints for literally decades did he finally come around?

it is hard to understand what the actually meaningful innovations are here / what TileRT is bringing to the table. - dflash: new-ish but February is ancient by the standards of the…

Because you need kv proportional to context length during inference of a single token to avoid quadratic recomputation. So compressing the kv lets you handle longer contexts in the…

> the association with flexibility or set shift did not remain significant after false discovery rate correction this is right there in the abstract, isn't that the entire game?

Because it gets you a minimal amount of abuse prevention for free.

Generically, I would say, just start building it and ask your favorite coding agent for advice when you get stuck. This is the first technology that can teach you how to use it! (B…

As someone who has been writing harnesses for a year: the people at opencode etc aren't stupid, when they decide to break the prefix cache [usually partially] it's always because t…

Developers: stop doing whiteboard interviews, they don't measure anything relevant to the real job Also devs: stop giving us real world problems to solve

https://archive.is/kO6Ph

Yes, but not diffusion based, it's still doing token-at-a-time speculation.