I'm a little surprised at how negative he is towards textual interfaces and text for representing information.
Andrej Karpathy: Software in the era of AI [video]
481–490 of 827 posts
Re: Andrej Karpathy: Software in the era of AI [video]
#482Earlier quoted context omitted.
I watched the entire talk, quite carefully. He explicitly states how excited he was about his tweet mentioning English. The disclaimer you mention was indeed mentioned, although it's "in one ear, out the other" with most of his audience. If I give you a glazed donut with a brief asterisk about how sugar can cause diabetes will it stop you from eating the donut? You also expect deterministic outcomes when making analo…
Either way, I am not sure it is a requirement on HN to read/view the source. Particularly not a 40min video. Maybe it is tongue-in-cheek, maybe I am serious. I am not sure myself. But sometimes the interesting discussions comes from what is on top of the posters mind when viewing the title. Is that bad?
It's odd! The guidelines don't say anything about having to read or watch what the posts linked to, all they say is it's inappropriate to accuse someone you're responding to of not having done so.
There is a community expectation that people will know what they're talking about before posting, and in most cases that means having read the article. At the same time, I suspect that in many cases a lot of people commenting have not actually read the thing they're nominally commenting on, and they get away with it because the people upvoting them haven't either.
However, I think it's a good idea to do so, at least to make a top-level comment on an article. If you're just responding to someone else's comment, I don't think it's as necessary. But to stand up and make a statement about something you know nothing about seems buffoonish and would not, in general, elevate the level of discussion.
Re: Andrej Karpathy: Software in the era of AI [video]
#48395% terrible expression of the landscape, 5% neatly dumbed down analogies. English is a terrible language for deterministic outcomes in complex/complicated systems. Vibe coders won't understand this until they are 2 years into building the thing. LLMs have their merits and he sometimes aludes to them, although it almost feels accidental. Also, you don't spend years studying computer science to learn the language/synt…
> English is a terrible language for deterministic outcomes in complex/complicated systems.
Someone here shared this ancient article by Dijkstra about this exact thing a few weeks ago: https://www.cs.utexas.edu/~EWD/transcriptions/EWD06xx/EWD667...
Re: Andrej Karpathy: Software in the era of AI [video]
#484Earlier quoted context omitted.
This is most definitely not toys for rich people. Now perhaps depending on your country it may be considered rich but I would comfortably say that for most of the developed world, the costs for these tools are absolutely attainable, there is a reason ChatGPT has such a large subscriber base. Also the disconnect for me here is I think back on the cost of electronics, prices for the level of compute have generally gone…
[flagged]
[flagged]
Re: Andrej Karpathy: Software in the era of AI [video]
#48595% terrible expression of the landscape, 5% neatly dumbed down analogies. English is a terrible language for deterministic outcomes in complex/complicated systems. Vibe coders won't understand this until they are 2 years into building the thing. LLMs have their merits and he sometimes aludes to them, although it almost feels accidental. Also, you don't spend years studying computer science to learn the language/synt…
I am not sure I got your point about English. I thought Karpathy was talking about English being the language of prompts, not output. Outputs can be English but if the goal is to compute using the output, then we need structured output (JSON, snippets of code, etc.), not English.
Re: Andrej Karpathy: Software in the era of AI [video]
#486Re: Andrej Karpathy: Software in the era of AI [video]
#487okay I’m practicing my new spiel: this focus on coding is the wrong level of abstraction coding is no longer the problem. the problem is getting the right context to the coding agent. this is much, much harder “vibe coding” is the new “horseless carriage” the job of the human engineer is “context wrangling”
> coding is no longer the problem. "Coding" - The art of literally using your fingers to type weird characters into a computer, was never a problem developers had. The problem has always been understanding and communication, and neither of those have been solved at this moment. If anything, they have gotten even more important, as usually humans can infer things or pick up stuff by experience, but LLMs cannot, and yo…
I’d take it a step further honestly. You need to be precise and exact but you also have to have enough domain knowledge to know when the LLM is making a huge mistake.
Re: Andrej Karpathy: Software in the era of AI [video]
#48895% terrible expression of the landscape, 5% neatly dumbed down analogies. English is a terrible language for deterministic outcomes in complex/complicated systems. Vibe coders won't understand this until they are 2 years into building the thing. LLMs have their merits and he sometimes aludes to them, although it almost feels accidental. Also, you don't spend years studying computer science to learn the language/synt…
> English is a terrible language for deterministic outcomes in complex/complicated systems. Someone here shared this ancient article by Dijkstra about this exact thing a few weeks ago: https://www.cs.utexas.edu/~EWD/transcriptions/EWD06xx/EWD667...
TIL. Thanks for sharing
Re: Andrej Karpathy: Software in the era of AI [video]
#489It's interesting how researchers are ahead on some insights and introducing them, and it feels like some are new to them but it might already exist and they're helping present them to the world.
A positive video all around, have got to learn a lot from Andrej's Youtube account.
LLMs are really strange, I don't know if I've seen a technology where the technology class that applies it (or can verify applicability) has been so separate or unengaged compared to the non-technical people looking to solve problems.
Re: Andrej Karpathy: Software in the era of AI [video]
#490Earlier quoted context omitted.
AI is all about context window. If you figured out the context problem, you will see that all these "AI is bullshit, it doesn't work and can't produce working code" goes away. Same for everything else.
Working code or not is irelevant. Heck, even human-in-loop (Tony-in-the-Iron-Man) is not actively the point. If we're going into "it's all about" territory then it's all about: - training data - approximation of the desired outcome Neither support a good direction for the complexity of some of the system around us, most of which require dedicated language. Imagine doing calculus or quantum physics in English. Novels…
Tony is iron man, not in him