Viewing profile — FieryTransition

As ai moves on and becomes better, the only real solution, is to have closed of communities where you get veted to join. That is the sad reality.

In my unscientific experience, yes, but being better at a certain rate is hard to really quantify, unless you just pull some random benchmark numbers.

From my own experience, models are at the tipping point for being useful at prototypes in software, and those are very large frontier models not feasible to get down on wafers unle…

If it's not reprogrammable, it's just expensive glass. If you etch the bits into silicon, you then have to accommodate the bits by physical area, which is the transistor density fo…

If you etch the bits into silicon, you then have to accommodate the bits by physical area, which is the transistor density for whatever modern process they use. This will give you …

Thanks, I learned something, but the original point stands, 5 people is still not a lot and well within the scale where you could manage things within the team yourself without ded…

And Unix was mainly made by two people, it's astounding that as I get older, even tech managers don't know "the mythical man month", and how software production generally scales.

Imagine having a swarm of mushrooms everywhere to run computation on, if mushrooms could be programmed to expand and self arrange. Ah, like a knifes edge, but would be exciting. Co…

Rust is a good candidate, but it lacks some crucial aspects when it comes to what I would consider 'nice to haves' from a modern language in this territory. While rust has traits, …

I'm looking forward to the day where an ml/functional inspired language can be used for real time rendering and game engines, how far are we from that? Realistically, one could arg…

I love this concept/principle, one similar example I often bring up when I talk about machine learning, is comparing how a human would analyse night footage from a camera, and how …

Turns out tuning LLMs on human preferences leads to sycophantic behavior, they even wrote about it themselves, guess they wanted to push the model out too fast.

There's a reason why less is called less, and not more.

I'm fine with ai slop if it provides value, the value here being questionable, because now I don't know if the values in the comparison are fact checked or hallucinations.

Agreed, it's a pretty obvious solution to the problems once you are immersed in the problem space. I think it's much harder to setup an efficient training pipeline for this which d…

Plenty studies show that these models are better at catching and diagnosing than even a board of doctors are. Doctors are good at other things, and I hope the future will allow doc…

See my answer to the sibling comment, it's not meant as an ill'will comment, otherwise I would add, if people completely abandoned Firefox due to a lack of safeguards and trust, th…

No, the idea isn't to bleed them dry, but to disincentivize decisions in direct opposition to what they promised to donors, and make them legally hard to do or with actual conseque…

Is there a way to litigate Firefox, to pay back the money, based on the false premise they gave? And that the damages extend well beyond a few individuals? Say, the threat of an ac…

Thanks a lot for the detailed reply, it was better than I had hoped for :) So knowledge transfer is something incredibly specific and much more narrow than what I thought. They don…

Is nebula actually good to use now? Do they route announcements over the network? Can I just setup two machines and expect them to just work by finding each other? Does it support …

But if you have a large set of problems to which you already know the answer, then using that in reinforcement learning, then wouldn't the expertise transfer later to problems with…

I was wondering about this too, it's not viable to have a coating which necessitates changing equipment periodically. It will add logistical problems and waste. I think you are rig…

I use a mix of using llamacpp directly via my own python bindings and using it via llamacpp-python for function calling and full control over parameters and loading, but otherwise …

Because the way they are quantized takes time to get bug-free when new architectures are released. If a model was quantized with a known bug in the quantizer, then it effectively m…