Earlier quoted context omitted.
Hammer is not a perfect analogy because of how simple it is, but sure let's go with it. Imagine that occasionally when getting in contact with the nail it shatters to bits, or goes through the nail as it were liquid, or blows up, or does something else completely unexpected. Wouldn't you want to fix it? And sure, it might require deep understanding of the nature of the materials and forces involved. That's what I'd d…
A better analogy might be something like medicine. There are many drugs prescribed that are known to help with certain conditions, but their mechanism of action is not known. While there may be research trying to uncover those mechanisms, that doesn't stop or slow down rolling out of the medicine for use. Research goes at its own pace, and very often cannot be sped up by throwing money at it, while the market dictate…
Problems the AI industry is not addressing adequately
241–243 of 243 posts
Re: Problems the AI industry is not addressing adequately
#242Earlier quoted context omitted.
Ok, so take the example of RF communications: You need to send data, but only 50% at random comes through. You could move things closer together, send at higher power, improve the signal modulation to give you higher snr. All of these things are done, this is improving the base system. But at the end of the day rf is in the real world, and the real world sucks. Random shit happens to make your signal not come through…
Except that a corrupt packet can easily be detected when compared to a valid packet (is the checksum valid?). There is an algorithm to execute that can tell you, with high confidence, whether a given packet is corrupt or not. In an LLM a token is a token. There are no semantics to anything in there. In order to answer the question "is this a good answer or not?" you would need a model that somehow doesn't hallucinate…
We are in the equivalent time period for llms and ML in general, we can hack things together that kinda work.
We only understand a sliver of fundamentals of how these things behave as complex systems. But that does not mean we should or need to wait 20 years for the research and science to keep up.
These are useful today, hallucinations and all, and building things that get the right hallucinations for your use case, even if not 100% reliable is possible.
Re: Problems the AI industry is not addressing adequately
#243Earlier quoted context omitted.
Incredibly bizarre take. You can build more capacity without frying the planet. Many ai companies are directly investing in nuclear plants for this reason, for example.
Several companies investing in AI Have made commitments to renewable and clean energy. However at most half of this increased energy demand is expected to come from renewables through 2030 and fossil fuels will continue to be heavily utilized for the massive data center build outs occurring beyond that, according to the International Energy Agency’s April 2025 report. Nuclear energy has long build outs of 10+ years.…