Viewing profile — markab21

We use it at a moderate scale, self-hosted on B300 hardware. It's great :D QA analysis of voice transcriptions. Napkin math: we operate at 2-5% of the cost of running on Equiv Fron…

Yes - THIS! I can't even believe how exhausting it is to read. I'm not sure why or what changed in Fable. Did they do this writing-style output to give it more token compression du…

I'm mildly surprised that more people aren't using Nemo models for this reason. We've moved most of our processing to a combination of Nemo Ultra and Super, with some support for m…

I'll pipe in here as someone working on an agentic harness project using mastra as the harness. Nemotron3-super is, without question, my favorite model now for my agentic use cases…

I think the entire premise that the prompting is the surface area for optimizing the application is fundamentally the wrong framing, in the same way that in 1998 better cpam will s…

You just articulated why I struggle to personally connect with Gemini. It feels so unrelatable and exhausting to read its output. I prefer to read Opus/Deepseek/GLM over Gemini, Qw…

And I think you basically just described the OpenAI approach to building models and serving them.

Shaking fist at clouds!!

It's getting a lot easier to do this using sub-agents with tools in Claude. I have a fleet of Mastra agents (TypeScript). I use those agents inside my project as CLI tools to do re…

Basically looking for emergent behavior.

I love where you're going with this. In my experience it's not about a different persona, it's about constantly considering context that triggers, different activations enhance a d…

The skepticism is understandable given the trajectory of GPTs and custom instructions, but there's a meaningful technical difference here: the Apps SDK is built on the Model Contex…

It looks like it was built jointly with nvidia: https://huggingface.co/nvidia/Mistral-NeMo-12B-Instruct

I bet you have been waiting years to pull that one out of your pocket. Well played sir! Nice shot man! :D

I've found myself more and more using local models rather than ChatGPT; it was pretty trivial to set up Ollama+Ollama-WebUI, which is shockingly good. I'm so tired of arguing with …

For Llama-based progress - Reddit - /r/LocalLlama has been my top source of info, although it's been getting a little more noisy lately. I also hang out on a few Discord servers: -…

[flagged]

Yeah, slow news day.

Linux distributions, including Debian, offer a variety of desktop environments, each with its own design philosophy and user experience. If one environment doesn't suit your prefer…

Debian and Ubuntu have similarities, but keep in mind - Ubuntu is derived from Debian, not the other way around. However, they differ in areas like release cycles, package manageme…

I used it as a consultant on a development project to help me organize some of the milestones and design goals in some documentation. It wasn't that I didn't know the stuff, I do, …

I'd be surprised if they don't have async mechanisms.

Assume anything sent over a cellular network carrier via normal SMS can not only be retrieved, but intercepted.

Why anyone would use Oracle for anything other than supporting legacy systems is beyond me.

The claim is dead-right. I own a Tesla Model 3, my wife drives a BMW i3, my daughter has a leaf. The ONLY car we can effectively travel outside of the greater Tampa area without ma…