Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 Designed a Programming Language

lukebechtel.com

Post reply on HN
Print view View original

81–90 of 338 posts

Re: GPT-4 Designed a Programming Language

#81

Post by visarga »

apatil wrote: post #67
moonchrome wrote: post #50

Earlier quoted context omitted.

If you get access to singularity level AGI you would have no incentive to cooperate with other people and a strong incentive in preventing others accessing it. Society is a result of cooperation outperforming individuals. With AGI others are just a risk factor. "Open"AI is already beginning to exhibit this.

Say you get access to a singularity-level AGI, meaning you have the power to render the entire human economy completely irrelevant. Given any task, no matter how big, small, novel, complex, simple or mundane, it's vastly more cost-effective to have your AGI to do it than to pay humans. Do you really want to accumulate incomprehensible material wealth for yourself, whatever "wealth" means in this scenario where money…

> "please create a utopia in which all humans are fully actualized"

That doesn't work well in reality because we do relative comparisons not absolute, so not all humans can be better than average.

And without competition we stagnate, there must be incentives to compete and take risks, and thus not everyone can be equally actualised, our level depends on our previous decisions.

Re: GPT-4 Designed a Programming Language

#83

Post by galfarragem »

HervalFreire wrote: post #11

quotation from the link: "LLMs in the GPT family have read every programming language in the world, billions of times. It's been known for some time that these agents can write small snippets of code with some limited success. However, to my knowledge, none of these agents have ever been asked to make their own programming language. This type of task is a bit more complex, and requires a bit more creativity and fores…

> people who claimed chatGPT was a stochastic parrot

I still think that. Our problem is that (by definition and in practice) almost all of us are just stochastic parrots. Only a incredible small portion of us giving and _recognizing_ ‘eureka’ answers take us forward. Will GPT ever be capable of recognizing these answers?

Re: GPT-4 Designed a Programming Language

#84

Post by pythonvisa »

This stuff makes me sick to my stomach. I hate this future. How can I continue my career when it is for progressing this monstrosity, watching it claw in another component of my humanity piece by piece? All I want to do is stroke oil paintings, hand written notes, products of the heart and the ernest mind. I feel dread that my life is over.

These headlines are killing me inside. I wish I could more easily discriminate between the hyperbole and the legitimate. Maybe after some time this will be saner to me.

Please stop the headlines.

Re: GPT-4 Designed a Programming Language

#85

Post by thrashh »

apatil wrote: post #38

It's looking increasingly possible that, at some point in the not-too-far future machines will be so good at creating software that humans won't be competitive in any way, and won't be in the loop at all. I happen to think that once machines reach this point humans won't be competitive in the labor market at all for long. It doesn't seem plausible that automatic driving would still be decades off, or that the trades…

If humans are completely out of the loop, I assume the AI could just write machine code.

Re: GPT-4 Designed a Programming Language

#86

Post by Jensson »

HervalFreire wrote: post #70
Jensson wrote: post #35

Earlier quoted context omitted.

> Because some of the things it gets right can not be attributed to anything else other than the concept of "understanding". Or just large dataset. The new thing we got was parsing natural languages, then we did a markov chain based on that so that it outputs semantic correct follow-ups based on what people on the internet would likely do/say in similar situations, and you get this result. It is very easy to see that…

>Edit: Also generating next state based on previous state is literally what the model does and is the definition of a Markov chain, Markov chains is a statistical concept and not just a word chain. There's research (as in actual scientific papers) that shows that in LLMs, while the markov chain is the low level representation of what's going on, at a higher macro level there are other structures at play here. Emergen…

> at a higher macro level there are other structures at play here. Emergent structures.

Yes, this is a neural net model, that is what such models do and have done for decades already. I'm not sure why this is relevant. Do you argue that stable diffusion is intelligent since it has emergent structures? Or an image recognition system is intelligent since it has emergent structures? Those are the same things.

> Even in a giant dataset it's easy to identify output that is impossible to exist in the training data.

Markov chains veer in different directions, they don't reproduce the data.

Re: GPT-4 Designed a Programming Language

#87

Post by fendy3002 »

apatil wrote: post #38

It's looking increasingly possible that, at some point in the not-too-far future machines will be so good at creating software that humans won't be competitive in any way, and won't be in the loop at all. I happen to think that once machines reach this point humans won't be competitive in the labor market at all for long. It doesn't seem plausible that automatic driving would still be decades off, or that the trades…

I think at the start they'll develop programming languages that focus on lower level operations, then from that it will branches out to hyper-specialized higher-level programming languages.

Storage managements will be tied to low or middle-level languages without additional abstraction, since they can develop and iterate so fast, it'll makes optimization easier IMO. There'll be multiple specialized storage types suitable for different cases.

They'll also design the API to be as pure / stateless as possible, since they can easily repeat tests that way.

I think it'll be interesting to see what kind data-interchange format they'll come with to communicate between programming languages / apps, since they can ignore human readability altogether. It should be very compact but fast to compress/decompress.

Lastly they'll deploy their own OS since they'll find the one that human develop is insuffucient for their use case

Re: GPT-4 Designed a Programming Language

#88

Post by galaxyLogic »

marviel wrote: post #16
raincole wrote: post #15

Earlier quoted context omitted.

I'm not so sure. The first sample is: > Indentation-based scoping, similar to Python. Then... > class Person { To me, it's very clear it doesn't really understand what "indentation-based scoping" means. For a human programmer, using both intentation-based and bracket-based scoping is a very unusual design choice, and is begging for further explanation. It talked pages of abstraction, modularity, etc, but not this ? I…

Author here -- I think it is a stochastic parrot, don't get me wrong. But my argument is that humans are also , at some level, sufficiently advanced stochastic parrots. At least, as it pertains to many creative endeavors. You're always building on the back of something that comes before. We're all just remixing ideas we've heard before. I mean even this comment -- none of the words I'm saying are new, and many of the…

> The ideas I'm expressing have merit -- but are they wholly original?

I think the difference is that your intention is to write sentences which you think and believe are correct and which can help other people understand the subject. Chatbot has no intentions of its own, it only imitates texts it has read from the internet. As far as it is concerned they might be totally wrong. You on the other hand have the ability -- and the desire -- to reason about what you are saying and think whether it is actually true or not.

Re: GPT-4 Designed a Programming Language

#89

Post by grogenaut »

moonchrome wrote: post #50
behnamoh wrote: post #43

Earlier quoted context omitted.

It's 1am and all I have to say is this: I look forward to seeing that future, but I'm both excited and scared af. I think humans will reduce to curators of AI-generated content and AI training dataset because no matter how good AI gets at becoming human-like, its purpose is ultimately to serve human goals, and those are shifting (e.g., by political movements).

If you get access to singularity level AGI you would have no incentive to cooperate with other people and a strong incentive in preventing others accessing it. Society is a result of cooperation outperforming individuals. With AGI others are just a risk factor. "Open"AI is already beginning to exhibit this.

Have you noticed how fast everyone else was able to copy open ai. And that's just what we saw or someone leaked. History is full of parallel inventions... how long after the US had nukes did russia?

Re: GPT-4 Designed a Programming Language

#90

Post by visarga »

HervalFreire wrote: post #11

quotation from the link: "LLMs in the GPT family have read every programming language in the world, billions of times. It's been known for some time that these agents can write small snippets of code with some limited success. However, to my knowledge, none of these agents have ever been asked to make their own programming language. This type of task is a bit more complex, and requires a bit more creativity and fores…

> I think the people who claimed chatGPT was a stochastic parrot are now realizing that they were the ones that were part of a giant parade of parrots regurgitating the same old tired trope of LLMs being nothing but simple word generators.

Muhahaha that was delicious. I hate that parrot meme. Authors lost their respect from me right from the title of that paper.

Post reply on HN