Alas, my 3 year old Mac has only 16 GB RAM, and can barely run a browser without running out of memory. It's a work-issued Mac, and we only get upgrades every 4/5 years. I must be content with 8B parameters models from Ollama (some of which are quite good, like llama3.1:8b).
My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
11–20 of 415 posts
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#12"2.5 year old laptop" is potentially the most useless way of describing a 64GB M2, as it could be confused with virtually any other configuration of laptop.
I think the point is just that it doesn't require absolute cutting edge nor server hardware.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#13Most likely its training data included countless Space Invaders in various programming languages.
and probably some synthetic data are generated copy of the games already on the dataset?
i have this feeling with LLM's generated react frontend, they all look the same
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#14Alas, my 3 year old Mac has only 16 GB RAM, and can barely run a browser without running out of memory. It's a work-issued Mac, and we only get upgrades every 4/5 years. I must be content with 8B parameters models from Ollama (some of which are quite good, like llama3.1:8b).
Just download more ram!
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#15I bet the training data included enough space invader cloned in JS
I also wouldn't be surprised if labs were starting to mix in a few pelican SVGs into their training data.
SVG benchmarking is a thing since GPT-4, so probably all major labs are overfitting on some dataset ov svg images for sure
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#16> Two years ago when I first tried LLaMA I never dreamed that the same laptop I was using then would one day be able to run models with capabilities as strong as what I’m seeing from GLM 4.5 Air—and Mistral 3.2 Small, and Gemma 3, and Qwen 3, and a host of other high quality models that have emerged over the past six months. Yes, the open-models have surpassed my expectations in both quality and speed of release. For…
is GLM 4.5 better than Qwen3 coder??
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#17I bet the training data included enough space invader cloned in JS
I also wouldn't be surprised if labs were starting to mix in a few pelican SVGs into their training data.
Even "accidentally" it makes sense that "SVGs of pelicans riding bikes" are now included into datasets used for training as it has spread as a wildfire on the internet, making it less useful as a simple benchmark.
This is why I keep all my benchmarks private and don't share anything about them publicly, as soon as you write about them anywhere publicly they'll stop being useful in some months.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#18Alas, my 3 year old Mac has only 16 GB RAM, and can barely run a browser without running out of memory. It's a work-issued Mac, and we only get upgrades every 4/5 years. I must be content with 8B parameters models from Ollama (some of which are quite good, like llama3.1:8b).
Reasoning models like qwen3 are even better, and they have more options, for example you can choose the 14B model (at the usual 4KM quantization) instead of the 8B model.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#19"2.5 year old laptop" is potentially the most useless way of describing a 64GB M2, as it could be confused with virtually any other configuration of laptop.
I think the point is just that it doesn't require absolute cutting edge nor server hardware.
No but 64 GB of unified memory provides almost as much GPU RAM capacity as two RTX 5090s (only less due to the unified nature) - top of the range GPUs - so it's a truly exceptional laptop in this regard.
Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
#20Most likely its training data included countless Space Invaders in various programming languages.
This comment is ~3 years late. Every model since gpt3 has had the entirety of available code in their training data. That's not a gotcha anymore.
We went from chatgpt's "oh, look, it looks like python code but everything is wrong" to "here's a full stack boilerplate app that does what you asked and works in 0-shot" inside 2 years. That's the kicker. And the sauce isn't just in the training set, models now do post-training and RL and a bunch of other stuff to get to where we are. Not to mention the insane abilities with extended context (first models were 2/4k max), agentic stuff, and so on.
These kinds of comments are really missing the point.