Viewing profile — gpjanik

TLDR: the experiment asks for in-distribution responses and gets those. The right answer here is to ask a LLM to create a scene similar in quality to those, but completely out of d…

I am not expecting it, it's the Qwen team is claimingthey can do much harder tasks than this, like rendering a consistent page of a maths paper, or creating true to fact explainers…

The real performance is nowhere close to what is presented in the marketing materials, which is pretty annoying. Especially text rendering and accuracy. Try asking it for a plot of…

A lot (all?) VCs charge some form of fees (typically capped at 20% of the entire fund, split in various percentages through 4 years investing, 4 divesting period). These fees often…

Other EVs are incomparably better though.

You can, Deel etc. make this pretty easy.

Thanks god we're getting rid of nuclear energy btw.

There have been numerous cases of sanctioning and wealth confisactions (Afrghanistan, Venezuela, Iraq, Iran, Libya), and "_now_ carries confiscation risk" is just factually incorre…

"Pozsar’s argument: the moment Western nations froze Russian foreign exchange reserves, the assumed risk-free nature of these dollar holdings changed fundamentally. What had been v…

If you're adding some computational/problem breakdown/heuristic steps on top/instead of mathematical concepts, then you're doing the opposite of what the author proposes. Scientifi…

"Think in math, write in code" is the possibly worst programming paradigm for most tasks. Math notations, conventions and concepts usually operate under the principles of minimum d…

Agreed, but that's not in the C dimension of a first-layer embedding of a single token though, it's across the whole model and that's what I said in the comment above.

It's... really not what I meant. This requirement does not have to be relaxed, it doesn't exist at all. Semantic similarity in embedding space is a convenient accident, not a desig…

Language models don't "pack concepts" into the C dimension of one layer (I guess that's where the 12k number came from), neither do they have to be orthogonal to be viewed as disti…

I somehow missed the "decode phase" paragraph and hence was confused - it's essentially that separation I meant, you're obviously correct.

"Here's the key insight: each forward pass processes ALL tokens in ALL sequences simultaneously." This sounds incorrect, you only process all tokens once, and later incrementally. …

This is finetuned to the benchmarks and nowhere close to O1-Preview in any other tasks. Not worth looking into unless you specifically want to solve these problems - however, still…

I mean again, even within a single sport, there are role differences, but the degree of fitness that you have to have to build 130kg muscle mass that JJ Watt has, and to run the 38…

Ugh, NFL players need to run on average about half of what a third tier soccer players do. At the extreme, a goalkeeper runs about the same as most running NFL player. For sprintin…

Oh yeah, there are 4 slightly chubby guys in "elite" sports out of 10 000, therefore we got athleticism wrong. Also, sorry to say it so directly, but none of these guys would have …

What is "pirate" about this? A lot of big companies self-host npm to avoid chain of supply attacks.

Where is EU when you need it? Subscriptions are a mess and it's one place in which EU could've forced something, but it won't. I also think they're mentally aligned with the idea o…

Regulation in this space works exclusively in favor of big tech, not against them. Almost all of that regulation was literally written for the benefit and with aid of the big tech.…

Hi from Germany. In case you were wondering, we regulated ourselves to the point where I can't even see the demo of SAM2 until some other service than Meta deploys it. Does anyone …

I understand that all these new models are an attempt to catch up with GPT-4, but frankly speaking, in the current shape and form, they're almost entirely useless. I frantically tr…