961–970 of 1001 posts
Earlier quoted context omitted.
Drawn from Karpathy killing a bunch of people by knowingly delivering defective autonomous driving software instead of applying basic engineering ethics and refusing to deploy the dangerous product he was in charge of.
In Texas, it's a $5K a day fine to call yourself an engineer, even in a job title on LinkedIn, and actually not be a certified engineer.
Earlier quoted context omitted.
Humans evolved to think the night sky is beautiful. That's also training. If humans were zapped by lightning every time they went outside at night, they would not think that a night sky is beautiful.
Interestingly this is a question I've had for a while. Night brings potentially deadly cold, predators, a drastic limit in vision so why do we find the sunset and night sky beautiful. Why do we stop and watch the sun set - something that happens every day - rather than prepare for the food and warmth we need to survive the night?
That said, I'm discovering from living very close to a lake for the last year that mosquitos are a right pain around sunset…
Earlier quoted context omitted.
Humans evolved to think the night sky is beautiful. That's also training. If humans were zapped by lightning every time they went outside at night, they would not think that a night sky is beautiful.
Being struck by lighting may affect your desire to go outside, but it has zero correlation with the sky’s beauty. Outer space is beautiful, poison dart frogs are beautiful, lava is beautiful. All of them can kill or maim you if you don’t wear protection, but that doesn’t take away from their beauty. Conversely, boring safe things aren’t automatically beautiful. I see no reasonable reason to believe that finding beaut…
Earlier quoted context omitted.
Sure but everything is semantics. LLMs have no internal secret model, they are the model. And the model is of how different lexemes relate to each other in the source material the model was built from. Some might choose to call that the world. If you believe your internal model of the world is no different from a statistical model of the words you have seen, then by all means do that. But I believe a lot of humans se…
I mean by definition CATS CANNOT TALK. Their vocabulary is probably on the order of 5 different types of meows
Meows are their attempt to communicate with humans. They try different meows and use the results to attempt to reach their goals.
Earlier quoted context omitted.
They = Waymo
Karpathy talked about Waymo, and he said they aren't there yet. They still have humans in the loop via telemetry and there are parts of cities they won't go to.
Earlier quoted context omitted.
Zvi made this point the other day, and then this counterpoint which I agree with more - if you think AGI is soon but you need to keep up the exponential datacenter growth for 2-3 years (or whatever “around the corner” means for the company in question) then a land-grab on consumer ARR is a faster way to short-term revenue (and therefore higher valuations at your next round). OAI is also doing F100 and USG work; it ta…
Well if they think AGI is soon with no evidence then that's not worth a whole lot If they think AGI is soon AND they can back it up, why can't they convince investors and have them make up the difference for the next 2-3 years? Seems like a much better strategy than the pornbots and a weaker position with regulators I mean if anything this makes it seem like they're not confident they'll get to AGI that soon.. they'r…
Moar money == moar GPUs.
Earlier quoted context omitted.
This is 100% unrelated to the original article but I feel like there's an underreported additional first half. As a bigger runner who still loves to run, the first two or three miles before I have enough endorphins to get into the zen state that makes me love running is the first half, then it's 17 miles of this amazing meditative mindset. Then the last 10k sucks.
Just, ftr, endorphins cannot pass the blood brain barrier http://hopkinsmedicine.org/health/wellness-and-prevention/th...
Earlier quoted context omitted.
Photons hit a human eye and then the human came up with language to describe that and then encoded the language into the LLM. The LLM can capture some of this relationship, but the LLM is not sensing actual photons, nor experiencing actual light cone stimulation, nor generating thoughts. Its "world model" is several degrees removed from the real world. So whatever fragment of a model it gains through learning to comp…
I agree with this. A metaphor I like is that the reason why humans say the night sky is beautiful is because they see that it is, whereas an LLM says it because it’s been said enough times in its training data.
True, but we could engineer AI to see that too, just as evolution has engineered us to see it.
Our innate emotional responses to things has been honed by evolution to be adaptive, to serve a purpose, but the things that trigger these various responses are not going to be super specific. e.g. We may derive pleasure from eating a nice juicy peach, but that doesn't mean that is encoded in our DNA - it's going to be primarily the reaction to sugar/sweetness, a good source of energy, that we are reacting to.
Similarly, we may have an emotional reaction to certain pieces of modern art or artistic expression, but clearly evolution has not selected for those specifically, but rather it is the artist triggering innate responses that evolved for reasons other than appreciation of art.
It's hard to guess what innate responses, that were actually selected for, are being triggered by our response to the night sky, and I'm also not sure how much of our response is purely visual (beauty) as opposed to wonder or awe. Maybe it's an attraction to the unknown, or sense of size and opportunity, with these being the universals that are actually adaptive.
In any case, if we figured out the specifics of our hard wired emotional reactions, that evolution as given us, then we could choose to engineer emotional AI that had those same reactions, in just as genuine a way as we do, if we chose to.
Earlier quoted context omitted.
To play devil’s advocate, you have never seen the night sky. Photoreceptors in your eye have been excited in the presence of photons. Those photoreceptors have relayed this information across a nerve to neurons in your brain which receive this encoded information and splay it out to an array of other neurons. Each cell in this chain can rightfully claim to be a living organism in and of itself. “You” haven’t directly…
If the definition of "seen" isn't exactly the process you've described, the word is meaningless. You've never actually posted a comment on hacker news, your neurons just fired in such a way that produced movement in your fingers which happened to correlate with words that represent concepts understood by other groups of cells that share similar genetics.
Earlier quoted context omitted.
Infinitely big little numbers Academia has rediscovered itself Signal attenuation, a byproduct of entropy, due to generational churn means there's little guarantee. Occam's Razor; Karpathy knows the future or he is self selecting biology trying to avoid manual labor? His statements have more in common with Nostradamus. It's the toxic positivity form of "the end is nigh". It's "Heaven exists you just have to do this w…
>> Heaven exists you just have to do this work to get there. Or perhaps Karpathy has a higher level understanding and can see a bigger picture? You've said something about heaven. Are you able to understand this statement, for example: "Heaven is a memeplex, it exists." ?
He's vague on the paths being explored to resolve them. His "higher level" view is probably awareness the solutions to software problems are hardware based fixes, but he cannot say that to software developers. Which has been the back and forth of tech since I was a kid in the 80s writing Basic; new state management unlocked by old software logic being embedded into new hardware.
Two main problems to solve for: too many people bought in to a status quo. And much simpler, the actual engineering of new hardware. One is only resolved by generational churn without resorting to all out police state action. So tech jobs as we know them will fade away slowly to not upset too many, and younger generations will not care as they will never experience anything else.