Coool!!!
Show HN: Getting GLM 5.2 running on my slow computer
161–170 of 269 posts
Re: Show HN: Getting GLM 5.2 running on my slow computer
#162> slow computer > 25 GB of RAM What?
For long time my daily driver was T480s with 24GB. I still have it, but don't use it anymore because it is slow for my needs now.
Re: Show HN: Getting GLM 5.2 running on my slow computer
#163Well under 1tps, but the fact it runs at all on a 16gb system is incredibly impressive!
Re: Show HN: Getting GLM 5.2 running on my slow computer
#164[deleted]
Re: Show HN: Getting GLM 5.2 running on my slow computer
#165My main question is whether when put into practical use, this can be measured in tokens/second, or more like 1 token per minute... I have seen locally hosted LLM that are as slow as 1 tok/second still be very useful if you give it a project to do something overnight and metaphorically walk away from it, check back with what it has done in 6 or 8 hours. 0.05 to 0.1 tok/s on the other hand, as reported in the URL for t…
The funny thing is Claude Cowork has taught me to be patient with response timelines. I’m now figuring I’ll be running locally no later than 2028. (I want to spend no more than $10k. And I want to run a model comparable to today’s SOTA.)
> (I want to spend no more than $10k. And I want to run a model comparable to today’s SOTA.)
The question is, will you want to run a model comparable to today's (meaning 2026) SOTA in 2028? Humans always want the latest shiny LLM model.
Re: Show HN: Getting GLM 5.2 running on my slow computer
#166Earlier quoted context omitted.
Which CPU gen are you suggesting, is there any writeup on such setup where In my experience with rig half that cost, entire exercise of running coding models locally has been a huge disappointment. Cost/Value when compared to cloud services is just not there, but I see the merit for those who value privacy over quality of output and want a backup of huge condensed corpus of data within their control. Kudos to OP thou…
I think there is a good sized population of people who absolutely don't want to submit everything they do to an off site service, or let their content be used for unknown training purposes, and will tolerate slowness at 1 to 10 tok/s as a tradeoff. Or people who want or need to run an uncensored (abliterated) gguf file to deal with controversial topics that a paid LLM service will refuse to work with or ban you for.
Not just controversial but also regulated areas. Virtually every law firm would be interested on locally-hosted AI at a reasonable price. So too ever medical research lab. Every CGI firm doing work for film/TV. And all the video game developers.
Re: Show HN: Getting GLM 5.2 running on my slow computer
#167[dead]
Re: Show HN: Getting GLM 5.2 running on my slow computer
#168I just learned about Gemma4.pas at the beginning of this week. Now this. This make me wonder how can inference engines could be built that easy. I'm not knowledgeable in this, but I thought it would take very deep Mathematic and system level knowledge, ... and a lot of patience.
No way! It is a while since I have seen that extension here on HN, I couldn't be mistaken. With AI? Is Pascal still alive?
Re: Show HN: Getting GLM 5.2 running on my slow computer
#169Looking at the progress with DS4 project from Antirez and Colibri, are we probably going in the direction of having a stripe RAID of SSDs instead of RAM to get decent performance without losing a kidney to the RAM mafia? I really hope so.
Re: Show HN: Getting GLM 5.2 running on my slow computer
#170[flagged]