Viewing profile — hajile

> Itanium would still have sucked I'm not completely convinced of this. If you ignore VLIW, you just have a very unexciting RISC ISA, but because of the VLIW, you get extra schedul…

How will costs come down? Each generation of model is more expensive to train and run than the last. More efficient hardware? That means throwing out billions of dollars worth of e…

As it stands, the leaked financials prove him correct. Given their losses (not counting restructuring) they are going to need enough funding to buy any of the bottom 300-400 of the…

The real answer is to stop trying to have AI reviewing AI code because it's just the blind leading the blind.

Nvidia already seems to be pivoting to "Local inferencing" with stuff like RTX Spark laptops. The problem is that local inference machines won't allow anywhere close to their curre…

On a $100B AI datacenter, some 60-70% of the center needs to be replaced every 2-6 years. These companies claim the hardware lasts 6 years while simultaneously claiming they are re…

All "interim" AI contributions to OpenJDK can and will be sued to make big money off of Oracle if those court cases don't go a certain way. This is ironic given how Oracle has bet …

The distillation commentary is really crazy coming from a company that stole all it's training material.

You formally verify that your incorrect solution executes without a hitch, but you might just be formally verifying that any user can hit your API and download all your plaintext p…

He sees what is coming. Crowd funding HAS to be dropping off as people choose between feeding their family or their favorite content creators (the creator will be fine as they have…

I might buy this if those languages were actually faster. Instead, implementations of scheme with no commercial backers run circles around scripting languages with huge budgets. Co…

Last I checked, both of these were built on top of Common Lisp/SBCL.

function can do what a macro does, but it must run every single time while the macro can run just one time during the final code generation. Let's say you have some Java-style a + …

Your lisp criticism is orthogonal to the idea of lisp itself. Lisps like Coalton (lambda calculus) or Shen (sequent calculus) are strongly typed. AI is an interesting point too whe…

They might be profitable for the exact two months SpaceX is giving them billions worth of free compute doesn’t seem convincing to me.

This is like when a vacuum doesn’t pick something up after a few tries. The user picks the thing up, looks at it, then puts it back down and tries again until they finally give up …

XML wasn’t the best alternative then either. S-expressions have been around since the 50s and are better than either XML or JSON.

I fear even a lot of bright, motivated people will be so discouraged by AI doomers that they won’t bother trying to learn.

I'm wondering about something different. FPGA seems ideal for an AI chip because you can simply flash the latest model. The downsides are low density and low clockspeed. It seems t…

> These people are professionals that acknowledge IPC is a stupid metric. Even if you think IPC is a stupid metric (it's not), ARM is still wiping the floor in total performance, p…

The government isn't going to be making chip fabs go any faster which is the biggest limitation here. The second big issue is that it takes months to fab chips meaning your hardwar…

There is a reasonable kernel of an idea here, but only if you dial expectations WAY back. The 10 years speculation is just wrong though. Even in 10 years, their 8B param model isn'…

The better solution would be making part of the chip cluster use something like FPGA which can be reprogrammed. Text to speech or diagnostics equipment where the core model is rela…

Taalas HC1 AI uses Llama 3.1 8B, but takes up a massive 53B transistors and 815mm2 on TSMC N6 (nearly at the reticle limit of 858mm2). N2 is a little less than 3x as dense (110MTr/…

If I can run it locally, it is certainly more safe than running on some cloud server somewhere.