Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
1–10 of 48 posts
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#2Eliza called, and asked if we saw her grand kids...
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#3i hate ai, and i love the c64, but i'll allow it.
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#4> 25K parameters is about 70 million times smaller than GPT-4. It will produce broken sentences. That's the point - the architecture works at this scale.
Since it seems to just produce broken and nonsensical sentences (at least based on the one example given) I'm not sure if it does work at this scale.
Anyway, as written this passage doesn't really make a whole lot of sense (the point is that it produces broken sentences?), and given that it was almost certainly written by an AI, it demonstrates that the architecture doesn't work especially well at any scale (I kid, I kid).
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#5> 25K parameters is about 70 million times smaller than GPT-4. It will produce broken sentences. That's the point - the architecture works at this scale. Since it seems to just produce broken and nonsensical sentences (at least based on the one example given) I'm not sure if it does work at this scale. Anyway, as written this passage doesn't really make a whole lot of sense (the point is that it produces broken sente…
How does it compare to a Markov chain generator I wonder.
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#6Eliza called, and asked if we saw her grand kids...
What makes you say that? This is about you, not me.
(Came here to say an update to Eliza could really mess with the last person still talking to her.)
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#7Ok now we need 1541 flash attention.
I'm not sure what the venn diagram of knowledge to understand what that sentence is suggesting looks like, it's probably more crowded in the intersection than one might think.
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#8If you're running this in VICE, run it under the SuperCPU with warp mode on.
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#9but can you make mac keyboards feel like a c64c?
Re: Soul Player C64 – A real transformer running on a 1 MHz Commodore 64
#10If you're running this in VICE, run it under the SuperCPU with warp mode on.
That's a good idea because, although I love this, 1 minute per token is absolutely savage. Whereas if you can juice the performance you're into semi-credible Jar Jar Binks simulator territory.
It does also make me wonder what you could do with somewhat more powerful retro hardware. I'd love to see what a transformer running on a PSX or an N64 could do.