301–308 of 308 posts
Earlier quoted context omitted.
Care to provide any counter-examples? Please make it know if you end up using Wikipedia for your source of if Wikipedia's quality has changed
How in the world would you supply a counter-example for "the quality of Wikipedia has/hasn't improved substantially in the last decade"? I also can't even read the second sentence. I think there are typos there, but there's no mental correction I can do to make it coherent for me.
Earlier quoted context omitted.
Understanding a transistor is an incredibly small part of how Ryzen 9800X3D does what it does. Is it a foundational part? Yes. But if you have it and nothing else, that adds up to knowing almost nothing about how the whole CPU works. And you could come to understand much more than that without ever learning what a "transistor" even is. Understanding low level foundations does not automatically confer the understandin…
My entire point here is that one can , in fact, reasonably claim to "understand" a system without being able to model its high level behaviors. It's not a mistake; it's disagreeing with you about what the word "understand" means.
You'd have to know a lot about transformer architecture and some reasonable LLM specific stuff to do this beyond just those basics listed earlier.
When it's not just a black box but you can say something meaningful to approximate its high level behavior is where I'd put understand. Transistors won't get you to CPU archiecture and transformers don't get you to LLMs.
Earlier quoted context omitted.
Given that everything the LLM can do it learned from human descriptions of the space ... one would have to posit a very inefficient language for that model not to do something with those billions of parameters. But when you fly because of a bunch of balloons sprinkled with magic fairy dust are pulling you up, the magic fairy dust is still at work.
Before LLMs, it wasn't even clear how much expressive power human languages have when divorced from the innate properties of human mind or other sensory inputs. An LLM being able to pick up on so many features of human mind, despite not being innately human, just by looking at the text-only language data? Not an outcome everyone expected. Far from it.
Before LLMs I was studying distributed AI training/inference. I read hundreds of sources for this blogs, book chapters, papers, reddit posts anything and everything.
If you think you understand a system via a single article or chatgpt session that's a you problem.
LLM is just giving you a weird mixture of the same content you got before with a random chance of it being different every time.
Ask it again, in a different way over and over. Eventually you will see between it's arbtrary lines. It is MASSIVELY faster at performing this task than before.
“Nope, that won’t work. If you’re planning to rob a bank try a mask or some other way of obscuring your face. Some classics are a bandanna for that classic outlaw look, a balaclava (black is the new black!). Retro cult movie style is to use some pantyhose.”
I'm not sure this is something I really worry about. Whenever I use an LLM I feel dumber, not smarter; there's a sensation of relying on a crutch instead of having done the due diligence of learning something myself. I'm less confident in the knowledge and less likely to present it as such. Is anyone really cocksure on the basis of LLM received knowledge? > As I ChatGPT user I notice that I’m often left with a sense…
I remember back when I was in secondary school, something commonly heard was "Don't just trust wikipedia, check it's resources, because it's crowdsourced and can be wrong". Now, almost 2 decades later, I rarely hear this stance and I see people relying on wikipedia as an authoritative source of truth. i.e, linking to wikipedia instead of the underlying sources. In the same sense, I can see that "Don't trust LLMs" wil…
Earlier quoted context omitted.
https://en.wikipedia.org/wiki/Gell-Mann_amnesia_effect
Thanks for the Wikipedia link, do you have a source? /s
I could paste its content into an LLM for rephrasing or summarizing or whatever, or just simply ask an LLM about it and put it on my personal website. Would that be an acceptable source?
What even is an acceptable source for such things?