My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
41–50 of 415 posts
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#42Most likely its training data included countless Space Invaders in various programming languages.
and probably some synthetic data are generated copy of the games already on the dataset? i have this feeling with LLM's generated react frontend, they all look the same
Models don't emit something they don't know. They remix and rewrite what they know. There's no invention, just recall...
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#43Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#44Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#45Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#46Most likely its training data included countless Space Invaders in various programming languages.
This comment is ~3 years late. Every model since gpt3 has had the entirety of available code in their training data. That's not a gotcha anymore. We went from chatgpt's "oh, look, it looks like python code but everything is wrong" to "here's a full stack boilerplate app that does what you asked and works in 0-shot" inside 2 years. That's the kicker. And the sauce isn't just in the training set, models now do post-tra…
It's kind of funny, because sometimes these tools are magical and incredible, and sometimes they are extremely stupid in obvious ways.
Yes, these are impressive, and especially so for local models that you can run yourself, but there is a gap between "absolutely magical" and "pretty cool, but needs heavy guiding" depending on how heavily the ground you're treading has been walked upon.
For a heavily explored space, it's like being impressed that you're 2.5 year old M2 with 64 GB RAM can extract some source code from a zip file. It's worth being impressed and excited about the space and the pace of improvement, but it's also worth stepping back and thinking rationally about the specific benchmark at hand.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#47Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#48Most likely its training data included countless Space Invaders in various programming languages.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#49Is probably more correct to say - my 2.5 year laptop can RETELL space invaders. Pretty sure it cannot write a game it has never seen, so you can even say - my old laptop can now do this fancy extraction of data from a smart probabilistic blob, where the original things are retold in new colours and forms :)
The impressive thing about these models is their ability to write working code, not their ability to come up with unique ideas. These LLMs actually can come up with unique ideas as well, though I think it’s more exciting that they can help people execute human ideas instead.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#50Alas, my 3 year old Mac has only 16 GB RAM, and can barely run a browser without running out of memory. It's a work-issued Mac, and we only get upgrades every 4/5 years. I must be content with 8B parameters models from Ollama (some of which are quite good, like llama3.1:8b).
Reasoning models like qwen3 are even better, and they have more options, for example you can choose the 14B model (at the usual 4KM quantization) instead of the 8B model.