Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI solves Advent of Code 2022

note89.github.io

Post reply on HN
Print view View original

51–60 of 82 posts

Re: AI solves Advent of Code 2022

#51

Post by MatthiasPortzel »

FiberBundle wrote: post #7

I think it must have seen the solution somewhere already on the web. I find it extremely hard to believe that such a general purpose chatbot would just be able to solve programming problems. Deepmind had a paper [1] on solving programming problems a couple of months ago and they had to apply quite specialized heuristics in order to solve these problems. Obviously ChatGPT does nothing of the sorts and it just seems ex…

The top leaderboard spots for AoC day 2 were taken by people who passed the response directly into GTP3. https://twitter.com/max_sixty/status/1598924237947154433

The AoC challenges this early aren't difficult, but they have several steps and are significantly more challenging than something you would be able to find as a Stackoverflow answer.

Re: AI solves Advent of Code 2022

#52

Post by [deleted] »

lgrapenthin wrote: post #23

This day I asked it not too fundamental questions about Clojure and it was able to provide impressive, accurate answers and provide correct code examples. However if you continue the dialogue and ask it to do more advanced stuff, it will just make up stuff out of thin air. For instance it will use functions that don't exist and claim that they can be imported from packages that don't exist or don't have them. Once yo…

[deleted]

Re: AI solves Advent of Code 2022

#53

Post by pedrosorio »

jcims wrote: post #49
frontman1988 wrote: post #15

Earlier quoted context omitted.

Yeah it can't solve novel questions. The AI couldn't do much to solve this one for example: https://codeforces.com/contest/1672/problem/D ChatGPT is just a very good copy/paste, not a logical problem solver(yet).

Have you tried describing the algorithm? https://imgur.com/a/7da1vFj I used 'z' instead of 'a' to avoid any possible issues with the article 'a'. I think I messed up the assignment of z[l] at z[r] being after its updated, not sure. But it created the input format, described it and the program ran the first time once i fixed the indents (code formatting is broken for some reason). If I run against the input at the con…

Isn't the expected output YES YES NO YES NO?

Re: AI solves Advent of Code 2022

#54

Post by pedrosorio »

arcturus17 wrote: post #26

I'm actually bullish on code-gen, AI-assisted coding, etc. but I find the title to be sensationalist wank. Challenge 2 of Day 2 has taken hours, over 30 prompts, and more time than coding it manually by the author's own admission. Also AoC isn't even done yet.

On the other hand, someone automated submitting code and got 1st place on the first part of day 3, in 10 seconds.

https://twitter.com/ostwilkens/status/1599026699999404033

Re: AI solves Advent of Code 2022

#55

Post by aew4ytasghe5 »

klohto wrote: post #33
aew4ytasghe5 wrote: post #31

Title is mildly misleading, to say the least. The blog attempts to solve 3 of 24 (thats 12.5 %) of advent of code 2022, and if you read along you'll see OP only had success on the first task of day 1, which would make a more correct title as "AI solves 2% of Avent of Code 2022" (assuming 2 tasks each day). Do note that AoC tends to start with hello-world style tasks and increase in difficulty.

I mean, take it with my best intentions, "No shit Sherlock"? Audience of AoC knows that Aoc 2022 just started.

> Audience of AoC knows that Aoc 2022 just started.

I did not try to make a point of the time of month, but of the claim in the title.

OP only solved the very first task of day 1, and the title suggest all was solved.

If you only can understand a part of what was written, then perhaps you should not comment on it and pretend like you understood the rest too.

Re: AI solves Advent of Code 2022

#56

Post by [deleted] »

neilk wrote: post #36
lgrapenthin wrote: post #23

This day I asked it not too fundamental questions about Clojure and it was able to provide impressive, accurate answers and provide correct code examples. However if you continue the dialogue and ask it to do more advanced stuff, it will just make up stuff out of thin air. For instance it will use functions that don't exist and claim that they can be imported from packages that don't exist or don't have them. Once yo…

That’s what I’m seeing too. I had a problem with some Hashicorp Packer scripts and posed it to ChatGPT. It did have an idea of the shape of the problem. To solve it the bot just hallucinated syntax. It spoke with great authority that this was the solution and provided a beautifully syntax-colored excerpt of something that wouldn’t have even compiled. This was perhaps a very hard problem for an LLM, as the Packer tool…

[deleted]

Re: AI solves Advent of Code 2022

#57

Post by Waterluvian »

tartoran wrote: post #46
Waterluvian wrote: post #12

Earlier quoted context omitted.

I’ve had this skepticism until I started asking the bot to do things like “create a limerick using some words that have never existed before and then explain the definition of those words.” I don’t believe the AI is generalized by any means. But I think it’s more than a Eliza-style parlour trick. It does really well with facts but misses subjectivity and nuance. Like I ask it to write stories for Seinfeld or Raymond…

Though it may look amazing it is not really thinking. It is simply capable of using a placeholder word. For HN’s sake AI does not understand anything, it’s just leveraging patterns, patterns that are sometimes complicated for us and that does make a great tool. But it’s just a tool for now.

We are all philosophical zombies. Let’s not single out the software. ;)

Re: AI solves Advent of Code 2022

#58

Post by theptip »

lgrapenthin wrote: post #23

This day I asked it not too fundamental questions about Clojure and it was able to provide impressive, accurate answers and provide correct code examples. However if you continue the dialogue and ask it to do more advanced stuff, it will just make up stuff out of thin air. For instance it will use functions that don't exist and claim that they can be imported from packages that don't exist or don't have them. Once yo…

Would be interesting to see if meaningful refinement training could be done by hooking the model up to a language interpreter/compiler. So the model can learn for itself what is valid output.

Re: AI solves Advent of Code 2022

#59

Post by jcims »

pedrosorio wrote: post #53
jcims wrote: post #49

Earlier quoted context omitted.

Have you tried describing the algorithm? https://imgur.com/a/7da1vFj I used 'z' instead of 'a' to avoid any possible issues with the article 'a'. I think I messed up the assignment of z[l] at z[r] being after its updated, not sure. But it created the input format, described it and the program ran the first time once i fixed the indents (code formatting is broken for some reason). If I run against the input at the con…

Isn't the expected output YES YES NO YES NO?

Yes according to the puzzle, but the operation as described isn’t clear (to me anyway) about which value should be used for the final assignment. It just says to use the value from the first element, but it’s unclear if it’s before or after that first element is replaced by the first operation.

Re: AI solves Advent of Code 2022

#60

Post by swid »

pps wrote: post #48
FiberBundle wrote: post #7

I think it must have seen the solution somewhere already on the web. I find it extremely hard to believe that such a general purpose chatbot would just be able to solve programming problems. Deepmind had a paper [1] on solving programming problems a couple of months ago and they had to apply quite specialized heuristics in order to solve these problems. Obviously ChatGPT does nothing of the sorts and it just seems ex…

Does it have access to the web? For one of my questions it answered: "Unfortunately, I am unable to provide a detailed description of the education system in Poland and its changes over the last 30 years because I have limited access to information and cannot browse the internet." but I have no idea if it's not lying :)

Some posts yesterday showed that network is usually disabled, but with the right prompt, you can enable network and someone got it to like a Twitter post.
Post reply on HN