Viewing profile — inkysigma

I know this is a bit cliche but I wonder how much headroom there is in the lower parameter count range. Is there any good reason to believe there is a lot of headroom or there is n…

I'm not the biggest fan of the current age verification schemes, but I don't think the idea kids can lie about their age differs in the threat model posed under either system. Pres…

The final time complexity for Karatsubas does account for the addition via the master theorem and gives you something less than n^2. It’s just in some sense the recursion is domina…

Given more code hosting services, I wonder if we'll also see a corresponding increase in the number of alternative VCS or if git is legitimately very entrenched as a tool. I am jus…

I actually agree to an extent with the idea that there is also some obvious political influence on LLMs on stuff like GLM or DeepSeek. This is reflected in conversations even on HN…

I think I understand your point but the funnier response to this question is that actually sometimes it is: https://futurism.com/grok-looks-up-what-elon-musk-thinks To your narrow …

I think the distinction with the Chinese models (or with any of the other models) is that they aren't particularly vocal and obviously active about their politics. I don't see how …

This is essentially an open research question. ML theory is unfortunately very weak relative to where the empirics are. I think there's a relatively optimistic paper that was poste…

At a high level, the text samples are how the relationships are derived. If we treat text samples as sequences of tokens, then the sequences of tokens describe the joint distributi…

One example along this path as an example is that every function must either terminate or have a side effect. I don't think one has bitten me yet but I could completely see how you…

So I can't tell if the linked commit is an actual attempt or just an experiment but it did always strike me as odd to make a JS runtime in Zig when my impression was there were a l…

I'm curious how this view fits in with BERT or the T5 release which prior to the current LLM craze were the de facto language models for use in pretty much any tasks. Was this a po…

Some of those organizations (Linux and Mozilla) work on open source code for which they are already trained on. For clients like Apple, they almost surely have agreements to not do…

Well it did contain a request to not notify according to that same letter. I suppose that brings up several questions. 1. Does that mean the same thing in the ToS? 2. How valid are…

Depends on how legitimate you consider an administrative warrant and how willingly you think complying with one is. On a more practical level, forcing them to go to court might not…

His anti censorship stance isn't necessarily born out by the data: https://www.washingtonpost.com/technology/2024/09/25/elon-mu...

X under Musk has sustained more government takedown requests. https://www.washingtonpost.com/technology/2024/09/25/elon-mu...

I think in this context, scaffolds are generally the harness that surrounds the actual model. For example, any tools, ways to lay out tasks, or auto-critiquing methods. I think the…

Actually given boot chain protection, this will probably get harder as time goes on but even assuming some kids are able to, this is clearly definable as a user error: the fault li…

Except none of these bills (California or the one in question) as currently written require an ID to actually be verified, merely that the user provide an age. This seems intention…

I think this is the third time this has effectively been posted see: https://news.ycombinator.com/item?id=47362528 https://news.ycombinator.com/item?id=47365597

Some of these are also just like really weak? One of them for example seems to be some random employee at FB donating ~$1k to a politician and calling that a link. The entire "Prov…