Don't be surprised if you're paid a visit by the SCP Foundation: https://scp-wiki.wikidot.com/scp-079
(edit: change url)
Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
71–80 of 126 posts
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#72Earlier quoted context omitted.
Super intrigued but annoyingly I can’t view imgur here
Indeed, part of me wants to not use imgur because we can't access it, but a bigger part of me fully supports imgur's decision to give the middle finger to the UK after our government's censorship overreach.
It was a really clever move on Imgur's part. Their blocking the UK has nothing to do with the Online Safety Act: it's a response to potential prosecution under the Data Protection Act, for Imgur's (alleged) unlawful use of children's personal data. By blocking the UK and not clearly stating why, people assume they're taking a principled stand about a different issue entirely, so what should be a scandal is transmuted into positive press.
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#73Earlier quoted context omitted.
My Pentium 3 in 2005 could do chat and video calls and play chess and send silly emotes. There is no conceivable user-facing reason why in 20 years the same functionality takes 30× as many resources, only developer-facing reasons. But those are not valid reasons for a professional. If a bridge engineer claims he now needs 30× as much concrete to build the same bridge as he did 20 years ago, and the reason is his/her…
> If a bridge engineer claims he now needs 30× as much concrete to build the same bridge as he did 20 years ago, and the reason is his/her own conveinence, that would not fly. By itself, I would agree. However, in this metaphor, concrete got 15x cheaper in the same timeframe. Not enough to fully compensate for the difference, but enough that a whole generation are now used to much larger edifices.
So it means you could save your client 93% of their money in concrete, but you choose to make it 2× more expensive! That only makes my metaphor stronger ahaha.
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#74This is impressive, those are some very restrictive requirements. I wonder what we are able to run on more powerful hardware such as ESP32 or RP2040, has anyone tried this?
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#75So if it's not using attention and it processes the entire input into an embedding to process in one go, I guess this is neither a Transformer nor a RNN but just a MLP?
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#76This couldn't be more perfectly timed .. I have an Unreal Engine game with both VT100 terminals (for running coding agents) and Z80 emulators, and a serial bridge that allows coding agents to program the CP/M machines: https://i.imgur.com/6TRe1NE.png Thank you for posting! It's unbelievable how someone sometimes just drops something that fits right into what you're doing. However bizarre it seems.
Oh dear, it seems we've... somehow been psychically linked... I developed a browser-based CP/M emulator & IDE: https://lockboot.github.io/desktop/ I was going to post that instead, but wanted a 'cool demo' instead, and fell down the rabbit hole.
That is beautiful.
I wrote a console-based emulator, and a simple CP/M text-adventure game somewhat recently
https://github.com/skx/cpmulator/
At some point I should rework my examples/samples to become a decent test-suite for CP/M emulators. There are so many subtle differences out there.
It seems I could even upload a zipfile of my game, but the escape-codes for clearing the screen don't work, sadly:
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#77[dead]
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#78This is something I've been wondering about myself. What's the "Minimally Viable LLM" that can have simple conversations. Then my next question is, how much can we push it so it can learn from looking up data externally, can we build a tiny model with an insanely larger context window? I have to assume I'm not the only one who has asked or thought of these things.
Ultimately, if you can build an ultra tiny model that can talk and learn on the fly, you've just fully localized a personal assistant like Siri.
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#79Earlier quoted context omitted.
> If a bridge engineer claims he now needs 30× as much concrete to build the same bridge as he did 20 years ago, and the reason is his/her own conveinence, that would not fly. By itself, I would agree. However, in this metaphor, concrete got 15x cheaper in the same timeframe. Not enough to fully compensate for the difference, but enough that a whole generation are now used to much larger edifices.
So it means you could save your client 93% of their money in concrete, but you choose to make it 2× more expensive! That only makes my metaphor stronger ahaha.
But also, there is more traffic on the bridge.
The word processors of 30 years ago often had limits like “50k chapters” and required “master documents” for anything larger. Lotus 123 had much fewer columns or rows than modern excel.
Not an excuse, of course, but the older tools are not usable anymore if you have modern expectations.
Re: Show HN: Z80-μLM, a 'Conversational AI' That Fits in 40KB
#80Awesome! Anyone for a port to the MSX?
A web version would also be cool.