Live data from Hacker News

Andrej Karpathy: Software in the era of AI [video]

youtube.com

661–670 of 827 posts

Re: Andrej Karpathy: Software in the era of AI [video]

#661
I'm not sure about the 1.0/2.0/3.0 classification, but it did lead me to think about LLMs as a programming paradigm: we've had imperative & declarative, procedural & functional languages, maybe we'll come to view deterministic vs. probabilistic (LLMs) similarly.

    def __main__:
        You are a calculator. Given an input expression, you compute the result and print it to stdout, exiting 0.
        Should you be unable to do this, you print an explanation to stderr and exit 1.
(and then, perhaps, a bunch of 'DO NOT express amusement when the result is 5318008', etc.)

Re: Andrej Karpathy: Software in the era of AI [video]

#662

Earlier quoted context omitted.

The versioning makes sense to me. Software has a cycle where a new tool is created to solve a problem, and the problem winds up being meaty enough, and the tool effective enough, that the exploration of the problem space the tool unlocks is essentially a new category/skill/whatever. computers -> assembly -> HLL -> web -> cloud -> AI Nothing on that list has disappeared, but the work has changed enough to warrant a fe…

For me it's even simpler: V1.0: describing solutions to specific problems directly, precisely, for machines to execute. V2.0: giving machine examples of good and bad answers to specific problems we don't know how to describe precisely, for machine to generalize from and solve such indirectly specified problem. V3.0: telling machine what to do in plain language, for it to figure out and solve. V2 was coded in V1 style…

What are some predictions people are anticipating for V4?

My Hail Mary is it’s going to be groups of machines gathering real world data, creating their own protocols or forms of language isolated to their own systems in order to optimize that particular system’s workflow and data storage.

Re: Andrej Karpathy: Software in the era of AI [video]

#663

Earlier quoted context omitted.

>> A recurring theme presented, however, is that LLM's are somehow not controlled by the corporations which expose them as a service. The presenter made certain to identify three interested actors (governments, corporations, "regular people") and how LLM offerings are not controlled by governments. This is a bit disingenuous. > I don't think that's what he said, he was identifying the first customers and uses. The po…

Yeah that's explicitly about first customers and first uses, not about who controls it. I don't see how it minimizes the control corporations have to note this. Especially since he's quite clear about how everything is currently centralized / time share model, and obviously hopeful we can enter an era that's more analogous to the PC era, even explicitly telling the audience maybe some of them will work on making that…

I took away from this a different message than what I think you did. I respect your perspective of same and that we respectfully disagree.

Re: Andrej Karpathy: Software in the era of AI [video]

#664

Earlier quoted context omitted.

I am not sure I got your point about English. I thought Karpathy was talking about English being the language of prompts, not output. Outputs can be English but if the goal is to compute using the output, then we need structured output (JSON, snippets of code, etc.), not English.

Entertain me in an exercise: First, instruct a friend/colleague of how to multiply two 2 digit numbers in plain English. Secondly (ideally with a different friend, to not contaminate tests), explain the same but using only maths formulas. Where does the prompting process start and where does it end? Is it a one-off? Is the prompt clear enough? Do all the parties involved communicate within same domain objects? Hopefu…

Yes the prompts are clear enough but it depends on the capacity of the people involved. People have to internalize the math (or any other) concepts from language into some rules, syntax, etc.

This is what an agent can do with an LLM. LLMs can help take English and generate some sort of an algorithm. The agent stores algorithm not the prompt. I do not know what current commercially available agents do but this was always clear to me.

Re: Andrej Karpathy: Software in the era of AI [video]

#665

Earlier quoted context omitted.

> This thread perfectly captures what Karpathy was getting at. We're witnessing a fundamental shift where the interface to computing is changing from formal syntax to natural language. Yes, telling a subordinate with natural language what you need is called being a product manager. Problem is, the subordinate has encyclopedic knowledge but it's also extremely dumb in many aspects. I guess this is good for people that…

I think the only places where the entry-level coder is being killed are corps that never cared about the junior to senior pipeline. Some of them love off-shoring too so I'm not sure much has changed.

“Wait… junior engineers don’t have short-term positive ROI?”

“Never did.”

Re: Andrej Karpathy: Software in the era of AI [video]

#666
post #661

I'm not sure about the 1.0/2.0/3.0 classification, but it did lead me to think about LLMs as a programming paradigm: we've had imperative & declarative, procedural & functional languages, maybe we'll come to view deterministic vs. probabilistic (LLMs) similarly. def __main__: You are a calculator. Given an input expression, you compute the result and print it to stdout, exiting 0. Should you be unable to do this, you…

Why does this remind me of COBOL.

Re: Andrej Karpathy: Software in the era of AI [video]

#667
post #656
post #573

Earlier quoted context omitted.

Maybe so, but please don't post unsubstantive comments to Hacker News. (Thoughtful criticism that we can learn from is welcome, of course. This is in the site guidelines: https://news.ycombinator.com/newsguidelines.html .)

I'd argue that expressing contrarian sentiment can be substantive. Otherwise this would be an echo-chamber of agreement.

For sure, expressing contrarian sentiment can be substantive, but you'd need to do it substantively.

Re: Andrej Karpathy: Software in the era of AI [video]

#668
post #639
post #565

Earlier quoted context omitted.

> You think of economics like a 6 years old. If you continue to break the site guidelines, we'll end up having to ban you. If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it.

He already had replies in his other multiple comments that stated the same thing.

Sorry, but I'm not following you here.

Re: Andrej Karpathy: Software in the era of AI [video]

#669
post #50

Great talk, thanks for putting it online so quickly. I liked the idea of making the generation / verification loop go brrr, and one way to do this is to make verification not just a human task, but a machine task, where possible. Yes, I am talking about formal verification, of course! That also goes nicely together with "keeping the AI on a tight leash". It seems to clash though with "English is the new programming l…

Not gonna lie, after skimming the website and a couple preprints for 10 minutes my crank detector is off the charts. Your very vague comments adds to it. But maybe I just don't understand.

Yes, you just don't understand :-)

I am working on making it simpler to understand, and particularly, simpler to use.

PS: People keep browsing the older papers although they are really outdated. I've updated http://abstractionlogic.com to point to the newest information instead.

Post reply on HN