Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

simonwillison.net

Post reply on HN
Print view View original

111–120 of 415 posts

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#111

Post by dingnuts »

simonw wrote: post #91
devmor wrote: post #89

Earlier quoted context omitted.

The subjects in the study you are referencing also believed that they were more productive with it. What metrics do you have to convince yourself you aren't under the same illusionary bias they were?

Yesterday I used ffmpeg to extract the frame at the 13 second mark of a video out as a JPEG. If I didn't have an LLM to figure that out for me I wouldn't have done it at all.

It is nice to use LLMs to generate ffmpeg commands, because those can be pretty tricky, but really, you wouldn't have just used the man page before?

That explains a lot about Django that the author is allergic to man pages lol

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#112

Post by simonw »

devmor wrote: post #108
simonw wrote: post #99

Earlier quoted context omitted.

"I would like to see it direct me to the original sources it would use to build those tokens" Sadly that's not feasible with transformer-based LLMs: those original sources are long gone by the time you actually get to use the model, scrambled a billion times into a trained set of weights. One thing that helped me understand this is understanding that every single token output by an LLM is the result of a calculation…

I am aware, and that's exactly why I don't think they're anywhere near as useful for this type of work as the people pushing them want them to be. I tried to push for this type of model when an org I worked with over a decade ago was first exploring using the first generation of Tensorflow to drive customer service chatbots and was sadly ignored.

I don't understand. For code, why would I want to remix existing code snippets?

I totally get the value of RAG style patterns for information retrieval against factual information - for those I don't want the LLM to answer my question directly, I want it to run a search and show me a citation and directly quote a credible source as part of answering.

For code I just want code that works - I can test it myself to make sure it does what it's supposed to.

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#114

Post by ben_w »

bayindirh wrote: post #61
FeepingCreature wrote: post #55

Earlier quoted context omitted.

True where trivial; where nontrivial, false. Trivially, humans don't emit something they don't know either. You don't spontaneously figure out Javascript from first principles, you put together your existing knowledge into new shapes. Nontrivially, LLMs can absolutely produce code for entirely new requirements. I've seen them do it many times. Will it be put together from smaller fragments? Yes, this is called "exper…

Humans can observe ants and invent any colony optimization. AIs can’t. Humans can explore what they don’t know. AIs can’t.

> Humans can observe ants and invent any colony optimization. AIs can’t.

Surely this is exactly what current AI do? Observe stuff and apply that observation? Isn't this the exact criticism, that they aren't inventing ant colonies from first principles without ever seeing one?

> Humans can explore what they don’t know. AIs can’t.

We only learned to decode Egyptian hieroglyphs because of the Rosetta Stone. There's no translation for North Sentinelese, the Voynich manuscript, or Linear A.

We're not magic.

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#115

Post by simonw »

dingnuts wrote: post #111
simonw wrote: post #91

Earlier quoted context omitted.

Yesterday I used ffmpeg to extract the frame at the 13 second mark of a video out as a JPEG. If I didn't have an LLM to figure that out for me I wouldn't have done it at all.

It is nice to use LLMs to generate ffmpeg commands, because those can be pretty tricky, but really, you wouldn't have just used the man page before? That explains a lot about Django that the author is allergic to man pages lol

I just took a look, and the man page DOES explain how to do that!

... on line 3,218: https://gist.github.com/simonw/6fc05ea7392c5fb8a5621d65e0ed0...

(I am very confident I am not the only person who has been deterred by ffmpeg's legendarily complex command-line interface. I feel no shame about this at all.)

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#116

Post by [deleted] »

tshaddox wrote: post #103
quantumHazer wrote: post #13

Earlier quoted context omitted.

and probably some synthetic data are generated copy of the games already on the dataset? i have this feeling with LLM's generated react frontend, they all look the same

To be fair, the human-generated user interfaces all look the same too.

[deleted]

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#117

Post by phkahler »

simonw wrote: post #85
phkahler wrote: post #83

Earlier quoted context omitted.

>> Other than copy-pasting existing code (which is not what an LLM does) I'd like to see someone try to prove this. How many space invaders projects exist on the internet? I'd be hard to compare model "generated" code to everything out there looking for plagiarism, but I bet there are lots of snippets pulled in. These things are NOT smart, they are huge and articulate information repositories.

Go for it. https://www.google.com/search?client=firefox-b-1-d&q=github+... has a bunch of results. Here's the source code GLM-4.5 Air spat out for me on my laptop: https://github.com/simonw/tools/blob/main/space-invaders-GLM... Based on my mental model of how these things work I'll be genuinely surprised if you can find even a few lines of code duplicated from one of those projects into the code that GLM-4.5 wrote fo…

So I scanned the beginning of the generated code, picked line 83:

  animation: glow 2s ease-in-out infinite;
stuffed it verbatim into google and found a stack overflow discussion that contained this:

      animation: glow .5s infinite alternate;
in under one minute. Then I found this page of CSS effects:

https://alvarotrigo.com/blog/animated-backgrounds-css/

Another page has examples and contains:

  animation: float 15s infinite ease-in-out;
There is just too much internet to scan for an exact match or a match of larger size.

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#118

Post by gblargg »

AlexeyBrin wrote: post #5

Most likely its training data included countless Space Invaders in various programming languages.

The real test is if you can have it tweak things. Have the ship shoot down. Have the space invaders come from the left and right. Add two player simultaneous mode with two ships.

Re: My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

#119

Post by notpublic »

genewitch wrote: post #96
NitpickLawyer wrote: post #6

> Two years ago when I first tried LLaMA I never dreamed that the same laptop I was using then would one day be able to run models with capabilities as strong as what I’m seeing from GLM 4.5 Air—and Mistral 3.2 Small, and Gemma 3, and Qwen 3, and a host of other high quality models that have emerged over the past six months. Yes, the open-models have surpassed my expectations in both quality and speed of release. For…

I'll bite. How do i train/make and/or use LoRA, or, separately, how do i fine-tune? I've been asking this for months, and no one has a decent answer. websearch on my end is seo/geo-spam, with no real instructions. I know how to make an SD LoRA, and use it. I've known how to do that for 2 years. So what's the big secret about LLM LoRA?

https://github.com/unslothai/unsloth

I'm not sure if it contains exactly what you're looking for, but it includes several resources and notebooks related to fine-tuning LLMs (including LoRA) that I found useful.

Post reply on HN