Viewing profile — roger_

Seeing a lot of these “run 1TB models with 1GB RAM” projects recently. Most seem vibe coded and probably won’t be maintained. Hoping a winner emerges with some real momentum behind…

I’m familiar with curve tracers but hadn’t heard about source measure units. Don’t see any on eBay for dirt cheap, wonder what author paid (he said a fraction of retail).

Getting (further) into this myself so good timing. Running Qwen 3.6 27B at decent speed on some old cards but going to branch out. I bough an Octominer for ~$150 which has power an…

That’s cool but 7 - 12 tps is frustrating for anything interactive.

Does this support Qwen 3.6 (e.g. 27B) and the myriad of llama.cpp options (batch sizes, quantization, etc.)? I'd love to see some performance data.

Funny you mention that because the OMP GitHub issues ( https://github.com/can1357/oh-my-pi/issues ) is almost exclusively attended to by a very efficient bot. I routinely submit is…

Currently using Oh My Pi ( https://github.com/can1357/oh-my-pi ) and appreciate the batteries included approach. From my limited time using pure Pi, I found quite a few of the plug…

Yeah I don’t think I could ever commit to a project like this and of this scale. Might be different if it was something truly useful or novel vs a nerd snipe. Very impressive that …

Definitely going to play around with this, thanks for posting. I know MCMC isn’t your goal, but seems like this could be used for ABC-MCMC (as is?) Would also be nice to have an op…

To monitor and instruct agents.

If there was a mobile app or at least some kind of agent agnostic telegram integration then I'd be more interested.

Hmm… how does one even pick between multiple vibe coded options? I like to vet my options before committing to new software but who knows if the authors are gonna support these in …

This guy is behind the awesome Oh My Pi agent, so I’d give him a chance.

Anyone have experience switching from Docker to Podman? I have a lot of compose files in my homelab/automation setup and those are what I’m most concerned about.

Has anyone tried this for LLMs and how does it compare to Vulkan?

How about Qwen3.6? What sort of prefill/decode rates? Edit: 3.6 not 3.7!

Any chance of HN getting angry about this, à la Reddit?

Cool idea but not very mobile friendly it seems.

M5 Max 128GB for $1k?

Would putting this between a small model and an agent like Hermes improve performance?

Ha! I spent time also hacking together Armbian on an old A20 TV box. Claude was definitely helpful the second time around to help with the DTS.

Looking forward to testing this! Is full 3D acceleration eventually possible and how's battery live?

I love how easy AI makes it to hack devices that otherwise wouldn't be worth the time.

Have they published?

So this is PCA in kernel space?