71–80 of 661 posts
The failure that is llama4 needs to be studied. Meta was kicking ass with llama3.x and then something happened, something really went wrong. what happened between that time and llama4? I think it happened after llama3.1, llama3.2 was nothing to write home about. We need the gossips, maybe a book
i bet he wants some calculative shit
The modern trend is to think intelligence is generative “like compression” or “predicting next in sequence” rather than iteratively reducing uncertainty, like those fault tolerant humans.
i bet he wants some calculative shit
Or some fuzzy yet inevitably reliable shit. The modern trend is to think intelligence is generative “like compression” or “predicting next in sequence” rather than iteratively reducing uncertainty, like those fault tolerant humans.
No one ever in comp sci says artificial intelligence is "like compression", they correctly state that "artificial intelligence IS compression". It's absolutely known and accepted that artificial intelligence (defined as predicting outcomes with a measure of certainty and taking chosen actions towards goals using those predictions) has equivalence to compression in a very hard science way. The hardest part of artificial intelligence is compression and the remaining part, the choice of actions based on predictions is just a tree search to a goal.
I think what everyone underestimated was the absolute bonkers amount of compute it will take and how that compute must scale in order to keep up with larger and larger models.