GPT-4 Designed a Programming Language • Hacker News Board

Re: GPT-4 Designed a Programming Language

#51

Post by wruza » Thu, Mar 16, 2023, 5:14 AM UTC

HervalFreire wrote: post #11

quotation from the link: "LLMs in the GPT family have read every programming language in the world, billions of times. It's been known for some time that these agents can write small snippets of code with some limited success. However, to my knowledge, none of these agents have ever been asked to make their own programming language. This type of task is a bit more complex, and requires a bit more creativity and fores…

How good they are at what exactly? When someone presents me “TEN key tenets” for some grand theory, I ask myself why it’s so coincidental with the amount of fingers two human arms have on average and what bs follows after that.

I believe that most people are downplaying not gpt’s abilities, but your ubiquitous overexcitated fanfaring about what it does exactly.

Re: GPT-4 Designed a Programming Language

#52

Post by not-chatgpt » Thu, Mar 16, 2023, 5:15 AM UTC

HervalFreire wrote: post #11

quotation from the link: "LLMs in the GPT family have read every programming language in the world, billions of times. It's been known for some time that these agents can write small snippets of code with some limited success. However, to my knowledge, none of these agents have ever been asked to make their own programming language. This type of task is a bit more complex, and requires a bit more creativity and fores…

Found the PM from OpenAI

Re: GPT-4 Designed a Programming Language

#53

Post by pmoriarty » Thu, Mar 16, 2023, 5:17 AM UTC

doctoboggan wrote: post #24

Recently I've been wondering about a somewhat related idea - a programming language designed specifically for a LLM to write in. I wonder how different (if at all) it would be from our current crop of language designed for humans to use. I am a little less impressed by the example given in the post. It seems GPT4 still falls in the trap of being overly dependent on previous responses.

Sometime back there was some news about two AIs spontaneously developing a language to communicate with each other.[1]

This was also the theme of art least one scifi book or movie a long time ago.

[1] - https://towardsdatascience.com/the-truth-behind-facebook-ai-...

Re: GPT-4 Designed a Programming Language

#54

Post by not-chatgpt » Thu, Mar 16, 2023, 5:17 AM UTC

These articles are way more hype than substance. The review process is barely sufficient to even give credit for the AI to actually have come up with the language, not that its training data was contaminated in some way.

Better to wait for a thorough review on GPT-4's zero shot abilities from an academic paper.

Re: GPT-4 Designed a Programming Language

#55

Post by gpt5 » Thu, Mar 16, 2023, 5:17 AM UTC

apatil wrote: post #38

It's looking increasingly possible that, at some point in the not-too-far future machines will be so good at creating software that humans won't be competitive in any way, and won't be in the loop at all. I happen to think that once machines reach this point humans won't be competitive in the labor market at all for long. It doesn't seem plausible that automatic driving would still be decades off, or that the trades…

As our ancestors who lived with gods, we too shall share their presence

Re: GPT-4 Designed a Programming Language

#56

Post by grimgrin » Thu, Mar 16, 2023, 5:17 AM UTC

ActorNightly wrote: post #8

mmoskal wrote: post #6

It says it has indentation syntax but it clearly uses braces TypeScript-like. I wonder why author describes it as a mix between Python and TypeScript.

JS an Python are the top active languages on Github, so its probably due to the training data.

they asked why the author described it as such. i wondered the same, failing to see the python influence gpt4 intended

Re: GPT-4 Designed a Programming Language

#57

Post by Jensson » Thu, Mar 16, 2023, 5:18 AM UTC

random_cynic wrote: post #45

Jensson wrote: post #35

Earlier quoted context omitted.

> Because some of the things it gets right can not be attributed to anything else other than the concept of "understanding". Or just large dataset. The new thing we got was parsing natural languages, then we did a markov chain based on that so that it outputs semantic correct follow-ups based on what people on the internet would likely do/say in similar situations, and you get this result. It is very easy to see that…

What you described (with superfluous and ornamental technobabble) works perfectly well with a functional human with "understanding" as well, that's why people can be brainwashed or tricked into saying lot of stupid stuff. None of these proves that there is no understanding.

> (with superfluous and ornamental technobabble)

I know how the model works, there was no technobabble there. People who don't understand how it works might view it as magic, like how they view all technology they don't understand as magic, but that doesn't mean it is magic, we shouldn't listen to such crackpots.

Re: GPT-4 Designed a Programming Language

#58

Post by spaceman_2020 » Thu, Mar 16, 2023, 5:18 AM UTC

how much will hundreds of millions of people typing in billions of questions everyday into these LLMs speed up their learning capabilities?

To me, it feels like we’re at the start of an exponential growth curve

Re: GPT-4 Designed a Programming Language

#59

Post by worrycue » Thu, Mar 16, 2023, 5:18 AM UTC

Jensson wrote: post #35

HervalFreire wrote: post #29

Earlier quoted context omitted.

>The advent of chatGPT had millions of people on the internet trying to downplay the intelligence of chatGPT by continuously trying to re-emphasize the things it gets wrong. Again the parroting. AI has been getting things wrong for decades. It's old news. The paradigm shift here is in the things it gets right. Because some of the things it gets right can not be attributed to anything else other than the concept of "u…

> Because some of the things it gets right can not be attributed to anything else other than the concept of "understanding". Or just large dataset. The new thing we got was parsing natural languages, then we did a markov chain based on that so that it outputs semantic correct follow-ups based on what people on the internet would likely do/say in similar situations, and you get this result. It is very easy to see that…

Arguing with AI (especially LLM) proponents is beginning to feel like arguing with a religious person ... it's almost easier to just let them believe in their god.

Pointing out the failures of their favorite LLM to prove to them that it's not doing what they think it's doing just falls on deaf ears as they go digging for more "proof" that ChatGPT actually understands what it's saying.

Re: GPT-4 Designed a Programming Language

#60

Post by mkaic » Thu, Mar 16, 2023, 5:19 AM UTC

aledalgrande wrote: post #19

My experience with it programming has been atrocius. It keeps making the same mistakes, writing NPEs everywhere and still doing it after I tell it many times how it was wrong (short memory?). Copilot is backed by it too now and I had a better autocomplete of constants with Sorbet than Copilot. Again, in my experience it's not usable if not for the super mainstream and simplest tasks. The biggest issue is that it writ…

> Copilot is backed by it too now

Do you have a source for this? I've been wondering when they'd switch CoPilot over to GPT-4. I didn't expect it would happen so soon, so I'm surprised.