Live data from Hacker News

Show HN: GPT crushes my high score in 2048.io

github.com

11–20 of 40 posts

Re: Show HN: GPT crushes my high score in 2048.io

#12
post #4

The prompt contains rules of the game and a few examples. Does anyone know if GPT really learns 2048 only from this prompt or most of its knowledge came training data?

The theory that gpt has merely learned the acceptable commands needs to be considered more likely, given the other comments pointing out that random input will do as well as gpt apparently does.

Re: Show HN: GPT crushes my high score in 2048.io

#13

I just played 2 games randomly pressing all arrow keys with closed eyes and got a score of ~1100 in the first game and 1468 in the second game. OP's AI agent scored 1348

What would be a good benchmark score for an AI? I just got 4500~ without any strategy.

Just make the same Javscript that provides random moves, make it play 100 games and take the average score.

Then do the same using GPT and compare the scores.

Anything else is just cherry-picking

Re: Show HN: GPT crushes my high score in 2048.io

#14

GPT4 just told me that a billion golf balls take up 40 billion cc, and since packing efficiency of spheres is as high as 74%, they take up 26 billion cc. No, you have to divide by 0.74, not multiply. In shit that GPT4 is not trained on (like code code code and more code), it can get really goofy. Earlier in the same chat about golf balls, it claimed that if brain cells were the size of golf balls (an imaginary thread…

Yet according to many HNers we're scarce months from AGI that can replace programmers or synthesise 6-season TV series. :)

Re: Show HN: GPT crushes my high score in 2048.io

#15
post #14

GPT4 just told me that a billion golf balls take up 40 billion cc, and since packing efficiency of spheres is as high as 74%, they take up 26 billion cc. No, you have to divide by 0.74, not multiply. In shit that GPT4 is not trained on (like code code code and more code), it can get really goofy. Earlier in the same chat about golf balls, it claimed that if brain cells were the size of golf balls (an imaginary thread…

Yet according to many HNers we're scarce months from AGI that can replace programmers or synthesise 6-season TV series. :)

Can you link to someone actually saying this? The whole debate seems like people are simply talking past each other, with one side saying "this is a useful tool" and one side saying "this tool is not going to turn into skynet in the next two weeks, so who cares?"

Re: Show HN: GPT crushes my high score in 2048.io

#17

I can't think of a particularly polite way of putting this, so I apologise, but did you take some liberties with that title, or are you just not very good at 2048? Random inputs may get you a higher score than that. I looked at the code to see the prompt, and I think it's a very limited way of having GPT play, the context has no board history or information on how and where the game inserts piece, the AI won't be abl…

There shouldn't need to be any board history, just like you don't need to know the board history to know the next move in checkers.

Re: Show HN: GPT crushes my high score in 2048.io

#18
You can get much great results at playing games with ChatGPT by adding “memory” as shown here - https://youtu.be/4oQUsiPsbOQ and here - https://youtu.be/lXFeq2yUy58

Prompting it to remember the game state and feeding it back in or offloading that job to a plugin can get some very Interesting results.

Re: Show HN: GPT crushes my high score in 2048.io

#19
post #17

I can't think of a particularly polite way of putting this, so I apologise, but did you take some liberties with that title, or are you just not very good at 2048? Random inputs may get you a higher score than that. I looked at the code to see the prompt, and I think it's a very limited way of having GPT play, the context has no board history or information on how and where the game inserts piece, the AI won't be abl…

There shouldn't need to be any board history, just like you don't need to know the board history to know the next move in checkers.

2048 spawns new numbers randomly on the board. A human player uses that information to determine the best move.

Re: Show HN: GPT crushes my high score in 2048.io

#20
post #14

Earlier quoted context omitted.

Yet according to many HNers we're scarce months from AGI that can replace programmers or synthesise 6-season TV series. :)

Can you link to someone actually saying this? The whole debate seems like people are simply talking past each other, with one side saying "this is a useful tool" and one side saying "this tool is not going to turn into skynet in the next two weeks, so who cares?"

Mostly it's tech jounalists. "We are doomed! Along with artists and programmers!"
Post reply on HN