We must not be using the same opus 5, because if I tried to generate this it would refuse based on copyright grounds.
Karpathy works for Anthropic so he obviously has full access to everything, and doesn’t have to pay for token burn either.
Karpathy’s Pelican
111–120 of 461 posts
Re: Karpathy’s Pelican
#112Regarding the argument about LLMs having difficulties auditing their work: I wonder whether we are entering the era of throwaway software. Just like cheap plastics and improved processes has enabled us to rapidly manufacture anything we want for a very low price, maybe LLMs give us the same for software. Produce it cheaply and if it breaks throws it away and reproduce it.
> Just like cheap plastics and improved processes has enabled us to rapidly manufacture anything we want for a very low price
Have they? Most of the world production is tied down to expensive factories and machines. Yes, we have more products, but that the result of the global trade, which is a very complex system.
> Produce it cheaply and if it breaks throws it away and reproduce it.
I don't know why everyone would ever wants this. It's been parroted since forever, but the true usefulness of software is to be able to build it once and runs it indefinitely. If some edge case occurs, I fix it. Which is way cheaper than rebuilding the whole thing. The goal is to have something like OpenBSD's ed[0] or dmesg[1], which you only touch every few years or so
[0] https://github.com/openbsd/src/commits/master/bin/ed
[1] https://github.com/openbsd/src/commits/master/sbin/dmesg/dme...
Re: Karpathy’s Pelican
#113[dead]
Re: Karpathy’s Pelican
#114I really dislike this AI programming thing of “Mr LLM, go slam your face into the problem until there’s no problem left, then call me back”. (Not sure if it’s a recent trend or a fundamental nature.) It always brings to my mind some words from Rich Hickey: I think we’re in this world I’d like to call “guardrail programming”. It’s really sad: we’re like, “I can make change because I have tests!”. Who does that? Who dr…
Like hitting pinball bumpers, except the high score in the end is the bill you pay the token provider.
Re: Karpathy’s Pelican
#115> I also like this kind of examples because no one in their right mind would ever spend the time to write something this custom
This is an odd take, given that Karpathy is certainly aware that the LotR films absolutely did create Bag End in digital format; that their creation was outstandingly high quality; and that Claude’s output here very obviously “leans heavily” on their prior art.
Re: Karpathy’s Pelican
#116Reading the title, I was thinking "Karpathy? I don't know this chess player."
(The Pelikan is a well known chess opening, and famous chess players often have book titles like "X's Y" where X is the player, and Y is the opening)
Re: Karpathy’s Pelican
#117Earlier quoted context omitted.
Affirmation?
Well, in that case - if it is just a "hear, hear" - I do not see why the utterance from that actor would be of note. Maybe nozzlegear wanted to suggest some importance on Musk remaining a bet-ter on the general tech, regardless of the competition?
This gets me thinking (although there is not much to divine from three letters). Maybe it's a Jennifer Lawrence GIF-inspired "Yeah, right" then? Downplaying the significance?
Re: Karpathy’s Pelican
#118Earlier quoted context omitted.
LLMs are bad at creative work and I don’t see them improving any time soon. Try asking an agent to write a story about raccoons. It will almost certainly involve either stealing food or raiding trash with a 50% chance of having a character named Pip. If a location is mentioned, it’ll be Elm Street. I guess this is the average story and, similarly, the average game is boring and predictable
Ironically, they're getting worse at creative work because all the RL is collapsing their distributions.
Worse in a very specific, bland, uninteresting way, too.
Early generative AI at least had the virtue of relentless, unsettling weirdness, in the same way that generative art from the late 90s and early 2000s did. A handful of people made creative use of that spooky weirdness.
Now it turns out "Airspace" art.
Re: Karpathy’s Pelican
#119I'm pretty tired of the "Y made this game in Z tokens" all over the internet last week. They look impressive, and it's cool that it's even possible, but they're useless as games. None of them are any fun. They're like the most boring variant of basic controllers you can imagine. None have any cool mechanics. None have any tweaks made from hours and hours of testing. All have the same cel-shader.
Right, but the new phenomena is that we've lost a signal.
Used to be if a game looked that good it probably had time spent on the game part too.
Re: Karpathy’s Pelican
#120I'm pretty tired of the "Y made this game in Z tokens" all over the internet last week. They look impressive, and it's cool that it's even possible, but they're useless as games. None of them are any fun. They're like the most boring variant of basic controllers you can imagine. None have any cool mechanics. None have any tweaks made from hours and hours of testing. All have the same cel-shader.
I’ll never not be amazed that we can type some words and get those results back out. However I do agree that the results are much worse when you try to use them. They look great in screenshots and video clips which makes them perfect for content farmers. All of the LLM generated games I’ve played have been really bad to play, though. I even tried my hand at a simple game, thinking I could iterate on it with prompts t…
I think it’s interesting to watch that we all have to sort of fine tune our own expectations and build the mental model for how impressive this is.
On the one hand I think most of us are incredibly impressed because we know, that quick demo would have taken us months of work to build in the before times.
On the other hand the promise is a cure for cancer and the end of all work.
So when everyone is telling you “skill issue is why you can’t one shot WoW”. It’s hard to know how you’re supposed to feel about Karpathy advertising one shot custom virtual worlds but giving you slop. Incredibly impressive slop when compared to how long it would take to create it just 3 years ago, not so much compared to Elon saying - “by the end of this year, grok will create a version of the odyssey that competes with Nolan’s”