Viewing profile — mv4

Technically, this can happen. Politically, this won't be allowed to happen - just like digital media ownership never happened.

The frontier labs will do their best to prevent this from happening. Their financial model won't work if people start running open-weight models on their local hardware. This is wh…

This is giving me Backrooms vibes!

My personal definition is if you can't resell it, you don't own it.

I've been using MiniMax M2.7 with vllm on my dual Nvidia Spark cluster. Slow (<20 tps) but functional for most of my use cases.

Translation: now I can FIRE.

What the hell did I just read.

Intel has already tried this (CPU+GPU+NPU) in partnership with Asus [1]. Big announcement at CES back in January. Not seeing much traction. Let's see how this one is received. [1] …

I am sure it can. It will still generate a lot of heat when under load. Are you telling me I should go for it? :) I do have a dual DGX Spark cluster running MiniMax M2.7 already so…

I have an old 192GB DDR4 Dell Precision with dual Intel Xeon Gold 6130 that I've considered spinning up. What's giving me pause is 250W at idle.

You just described the absolute nightmare scenario for the newly minted trillion-dollar companies whose only hope is for enterprises and SMB to move all their business processes to…

Minimax M2.7.

I configured a dual DGX Spark cluster, and it's certainly "good enough" for my agentic and coding needs.

If people figure out how to run agents on-prem (already becoming feasible for both agentic tasks and coding on consumer hardware like Mac Studio 128GB+ or DGX Spark with some model…

Only took 19 years!

Can someone recommend an IDE that can be used with a self-hosted model (via OpenAI or similar)?

I mentioned the same thing and it's getting downvoted lol

Looking at the comments here, it appears people are trying to do too much, too soon, which inevitably backfires. The key is to put OC in a sandbox (don't give access to your real a…

#2 also provides an opinion on why a certain development is significant and how it relates so something else I am working on for that client. The process is definitely more pleasan…

No recurring expense, just the hardware upfront cost. My next step is run the models locally as well. I used to work at FAANG (incl. compliance) and I would never use a cloud-based…

It is buggy. It's also good at self-diagnostics and I was able to either fix things or find working workarounds by collaborating with it.

Operations: mostly tasks and reminders, I often think of something while on the road and send a voice message (like I would to a real PA). I use Kokoro-based TTS for local text-to-…

That's a fair assessment if you look at LinkedIn posts. Personally though, I am finding it incredibly useful and I use it daily to assist with operations, strategy, sales.

I have it installed on a dedicated M4 16GB Mac Mini with Telegram, email, and Google Docs integration (the agent has its own accounts). I can chat with it, incl. sending voice mess…

Wondering how Spotify is handling this issue https://newsroom.spotify.com/2025-09-24/spotify-terms-creato...