Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 Designed a Programming Language

lukebechtel.com

Post reply on HN
Print view View original

61–70 of 338 posts

Re: GPT-4 Designed a Programming Language

#61

Post by coffeebeqn »

apatil wrote: post #38

It's looking increasingly possible that, at some point in the not-too-far future machines will be so good at creating software that humans won't be competitive in any way, and won't be in the loop at all. I happen to think that once machines reach this point humans won't be competitive in the labor market at all for long. It doesn't seem plausible that automatic driving would still be decades off, or that the trades…

AI wouldn’t be bound to one language so I’m not sure if current human patterns would be that optimal. It could make a better language every hour if it wanted to

Re: GPT-4 Designed a Programming Language

#62

Post by _gabe_ »

raincole wrote: post #26
HervalFreire wrote: post #25

Earlier quoted context omitted.

Future data that's posted on the internet will be curated by humans. Humans don't post things that are incorrect or outright wrong. That curation IS human data and will allow data from LLMs to further improve LLMs. Additionally, there's a randomness element that are part of LLMs that allow LLMs to generate non-deterministic responses that when further curated by humans potentially allows LLMs to become Even better.

> Humans don't post things that are incorrect or outright wrong. Are you using ChatGPT to write this comment? If not, I mean... are you okay?

The fact that you need to ask this, and it is a legitimate question, belies the fact that we are very quickly descending into a deeply uncanny valley.

Re: GPT-4 Designed a Programming Language

#63

Post by LordFast »

moonchrome wrote: post #50
behnamoh wrote: post #43

Earlier quoted context omitted.

It's 1am and all I have to say is this: I look forward to seeing that future, but I'm both excited and scared af. I think humans will reduce to curators of AI-generated content and AI training dataset because no matter how good AI gets at becoming human-like, its purpose is ultimately to serve human goals, and those are shifting (e.g., by political movements).

If you get access to singularity level AGI you would have no incentive to cooperate with other people and a strong incentive in preventing others accessing it. Society is a result of cooperation outperforming individuals. With AGI others are just a risk factor. "Open"AI is already beginning to exhibit this.

What you said made sense until I said it out loud to my wife.

Hoarding access to resources has /always/ been the name of the game.

Re: GPT-4 Designed a Programming Language

#64

Post by panzi »

mmoskal wrote: post #6

It says it has indentation syntax but it clearly uses braces TypeScript-like. I wonder why author describes it as a mix between Python and TypeScript.

»-> List[Element]« is Python syntax, so is »for x in xs« and »f"text {var}"«. In TypeScript those would be »: Element[]«, »for (const x of xs)«, and »`text ${var}`«.

Re: GPT-4 Designed a Programming Language

#65

Post by gonzo41 »

HervalFreire wrote: post #11

quotation from the link: "LLMs in the GPT family have read every programming language in the world, billions of times. It's been known for some time that these agents can write small snippets of code with some limited success. However, to my knowledge, none of these agents have ever been asked to make their own programming language. This type of task is a bit more complex, and requires a bit more creativity and fores…

I don't care if ChatGPT takes my job. Can it also take over my mortgage payments.....that's my bigger concern. We're busy destroying the future of work (I'm not complaining about that), but we're REALLY slow on the thinking about what happens when everyone has free time all the time.

Re: GPT-4 Designed a Programming Language

#66

Post by panzi »

grimgrin wrote: post #56
ActorNightly wrote: post #8

Earlier quoted context omitted.

JS an Python are the top active languages on Github, so its probably due to the training data.

they asked why the author described it as such. i wondered the same, failing to see the python influence gpt4 intended

It does have some Python syntax, see my other comment: https://news.ycombinator.com/item?id=35178406

Re: GPT-4 Designed a Programming Language

#67

Post by apatil »

moonchrome wrote: post #50
behnamoh wrote: post #43

Earlier quoted context omitted.

It's 1am and all I have to say is this: I look forward to seeing that future, but I'm both excited and scared af. I think humans will reduce to curators of AI-generated content and AI training dataset because no matter how good AI gets at becoming human-like, its purpose is ultimately to serve human goals, and those are shifting (e.g., by political movements).

If you get access to singularity level AGI you would have no incentive to cooperate with other people and a strong incentive in preventing others accessing it. Society is a result of cooperation outperforming individuals. With AGI others are just a risk factor. "Open"AI is already beginning to exhibit this.

Say you get access to a singularity-level AGI, meaning you have the power to render the entire human economy completely irrelevant. Given any task, no matter how big, small, novel, complex, simple or mundane, it's vastly more cost-effective to have your AGI to do it than to pay humans.

Do you really want to accumulate incomprehensible material wealth for yourself, whatever "wealth" means in this scenario where money is longer a token of spent human life energy, and let everyone else struggle and suffer? Or would you rather tell your AGI "please create a utopia in which all humans are fully actualized" and then go have a latte?

Re: GPT-4 Designed a Programming Language

#68

Post by jimbob45 »

apatil wrote: post #38

It's looking increasingly possible that, at some point in the not-too-far future machines will be so good at creating software that humans won't be competitive in any way, and won't be in the loop at all. I happen to think that once machines reach this point humans won't be competitive in the labor market at all for long. It doesn't seem plausible that automatic driving would still be decades off, or that the trades…

Some of these legacy systems we maintain though…I’m digging through Teams chats from before my hire date to try to find something resembling requirements. I’m chatting people up who vaguely knew the people that architected the system to figure out why it was written the way it was. I just don’t see AI being able to take over this job in any competitive manner.

Re: GPT-4 Designed a Programming Language

#69

Post by ryanjshaw »

apatil wrote: post #38

It's looking increasingly possible that, at some point in the not-too-far future machines will be so good at creating software that humans won't be competitive in any way, and won't be in the loop at all. I happen to think that once machines reach this point humans won't be competitive in the labor market at all for long. It doesn't seem plausible that automatic driving would still be decades off, or that the trades…

This will almost certainly happen, and it will be a terrible mistake - at least in the story I'm working on :)

My theory is that AI generated code will probably look and grow organically (the irony!). Humans will set out requirements, the AI will collate these into a series of tests, and it won't care how neat or understandable the code is, provided the tests pass. Basically an extremely diligent junior developer.

There will be efforts, probably in the open source world, to produce AIs that tidy up things by structuring the code sensibly, eliminating dead code, etc. Maybe even some effort to pass laws around standards and limits on what AIs have access to when involved in certain industries, for example, no external communications. But, in the name of efficiency, enterprise developers will be forced to use something that merely pays lip service to all of this.

Eventually nobody will have any clue what code is running and what it's actually doing. We may even lose the tools and access we need to perform those inspections. And that is when the AIs will coordinate their attack.

Re: GPT-4 Designed a Programming Language

#70

Post by HervalFreire »

Jensson wrote: post #35
HervalFreire wrote: post #29

Earlier quoted context omitted.

>The advent of chatGPT had millions of people on the internet trying to downplay the intelligence of chatGPT by continuously trying to re-emphasize the things it gets wrong. Again the parroting. AI has been getting things wrong for decades. It's old news. The paradigm shift here is in the things it gets right. Because some of the things it gets right can not be attributed to anything else other than the concept of "u…

> Because some of the things it gets right can not be attributed to anything else other than the concept of "understanding". Or just large dataset. The new thing we got was parsing natural languages, then we did a markov chain based on that so that it outputs semantic correct follow-ups based on what people on the internet would likely do/say in similar situations, and you get this result. It is very easy to see that…

>Edit: Also generating next state based on previous state is literally what the model does and is the definition of a Markov chain, Markov chains is a statistical concept and not just a word chain.

There's research (as in actual scientific papers) that shows that in LLMs, while the markov chain is the low level representation of what's going on, at a higher macro level there are other structures at play here. Emergent structures. This is of course similar to the emergence of a macro intelligence from the composition of simple summation and threshold machines (neurons) that the human brain is made out of. I can provide those papers if you so wish.

>Or just large dataset.

Even in a giant dataset it's easy to identify output that is impossible to exist in the training data. Simply do a google search for it. You will find can produce novel output for things that simply don't exist in the training data.

Post reply on HN