Viewing profile — nodja

I'm the same way, I have a very low/sporadic usage of any subscription I've tried. I now just use openrouter with DS4 pro/flash. It also gets rid of usage anxiety where I would try…

The way I think about it is that it's unreasonable for a compute graph with a static number of operations to be able to answer both y=a*10 and something like y=((((x+x)*(x+1))/((2*…

I'm not a heavy user of agentic coding, but still use them quite a bit for some automation here and there. I've been going around shopping all the ~$10 subscriptions and I finally …

Yes, the whole list will always sum to 1 (100%) because there's lots of more sampling parameters. top_p, top_k and temperature are just the ones that affect output the most. Most p…

The posted answers are either behind a paywall or very obtuse so I'll just explain. I'll assume you know what tokens are. A models output is not a single token, but a list with the…

Yup, it's the main reason I don't use LM studio more. I only use it to try out new models/quants, then use llama.cpp directly to host them. LM Studio also doesn't do stuff like aud…

It doesn't matter until it does. If the chinese government decides that open weight model releases are no longer allowed, that's a lot of companies that can't release new models. S…

This hasn't been tested in court. But there's a high chance that model weights are not copyrightable, only the code to generate them is. Cloud models are usually protected by trade…

Yes. Having 4 names are quite common in Portugal, specially in certain areas. The names are usually structured like this: G1 G2 FM FF G1 and G2 are given names. Usually 2 "first na…

> but I don't see any historical analogues. The losers are quickly forgotten. Palm, Blackberry, AOL, MySpace. Yahoo, etc. Software gets replaced all the time too, you even listed o…

Same here, first try I tried asking from the main studio page, and it didn't catch the comment at all despite being the latest comment. When asking specifically from the video, it …

That's only correct for specific models and not what parent was referring to. Stable Diffusion 3, an open weights model, was laughed at at release for not being able to even genera…

Last thing you want a model to do is hallucinate a tool call and it's outputs...

Pipeline parallelism. Instead of splitting layers by row/column. You split at the layer edges. So instead of having this huge bottleneck of bandwidth you only need to transfer abou…

I wonder if this move will backfire on them. All the fabs are focusing on HBM and leaving DDR behind, if one of the big frontier labs folds all the memory fabs will be left holding…

Not OP but if I had a couple RTX 6000 I'd throw them at decompiling bloodborne to play on PC without emulation.

When a cyclist is leading a pack and pushing themselves against the air resistance for half the race, do you expect that cyclist to win, or one of the ones behind that's been takin…

GP here, leading and winning are different things in the race context/metaphor. In foot/cycling races there's often a pack leader, that leader is often not the winner of the race, …

If they got there by tiring themselves out more than the other team, yes.

No, the US is _leading_ the AI race, but the race isn't over. What's the point of leading the race for 90% of it, if they're gonna slip on their own sweat and fall down by the end?…

If I'm understanding this right, this presupposes that the models were pre-trained on unfiltered data like with the "floor" models, so when comparing between the "retail" and uncen…

> speculative decoding which, generally speaking, is not the same quality as serving the model without it. I've never heard of ANY speculative decoding that wasn't lossless. If it …

That will depend on the model, but they'll hit compute limits before a typical GPU in almost all cases. Macs will still benefit a speedup from this, just not one as big as the one …

Same reason why prompt processing is faster than text generation. When you already know the tokens ahead of time you can calculate the probabilities of all tokens batched together,…

Official sites make things worse on purpose after getting any sort of traction because they can't stop chasing profits. I don't watch sports, but my father watches soccer. He reall…