Viewing profile — fzysingularity

I think we all ought to look at the ZDR fine-print here. I get that in principle that there's no retention, but these are powerful models that can comprehend, paraphrase and summar…

The ICP question was more around the model itself. Are they looking to license it to robotics companies? Do they imagine that devs at robotics companies would be willing to deploy …

It’s unclear to me what their desired outcome for a blog post like this. If you’ve ever worked in a robotics setting, 80% implies that 20% of your autonomous actions are incorrect.…

Frontier labs are realizing that software/models themselves don’t have real moats and move to embodied ai. SOTA 80% means a practically useless robot. What are they really imaginin…

It's live now, https://github.com/vlm-run/mm .

We were planning to open-source this soon, but jumped the gun and posted about the video encoders here since it seemed relevant. In either case, here you go, it's public now: https…

Exactly! We experimented with a whole bunch of video encoding techniques for LLMs here: https://vlm-run.github.io/mm/encoders/#video

Pretty terribly expensive way to watch a video with Claude. Use Gemini or some local VLM to do this way more efficiently. We spent quite a bit of time on video understanding, and C…

This is neat. I'd love to figure out a sequence of emojis that triggers the LLM in ways that puzzles a human.

That’s a pretty large binary for simply loading images. In all honesty, opencv has stood the test of time and I’m certain newer LLMs will likely not attempt to rewrite it from scra…

I can’t help but think that there are so many astroturfed comments in here. Seems like a concerted and distributed effort from the entire Anthropic team every time to get this on t…

Kind of crazy how many bespoke python sandbox implementations have popped up in the past few months. I’d love to see if we can get GPU access within these runtimes, that’d be aweso…

What’s your experience with Monty? Been looking at it for one of our environments and it seems very promising.

VLM Run ( https://vlm.run ) | 1x Product + 1x ML Staff Engineer | Santa Clara, CA (HQ) We're building the inference and orchestration layer for production Vision-Language Models. W…

The recent claude code leak also revealed that they're poisoning their competitors via anti-distillation policies baked in claude code CLI (fake tool calls, adding noise etc).

VLM Run ( https://vlm.run ) | 1x Infrastructure Engineer + 2x AI/ML Engineer | Santa Clara, CA (HQ) VLM Run is building infrastructure for production Vision-Language Model (VLM) sy…

Real-time or continuous learning is great on paper, but to get this to work without extremely expensive regression testing and catastrophic forgetting is a real challenge. Credit t…

What do you think actually happened here in the past week? They used Kimi, failed to acknowledge it in the original Composer announcement. Kimi team probably reached out and asked …

VLM Run ( https://vlm.run ) | 1x Infrastructure Engineer + 2x AI/ML Engineer | Santa Clara, CA (HQ) VLM Run is building infrastructure for production Vision-Language Model (VLM) sy…

AI allows you to accelerate the initial build process, but I think engineering is all about craftsmanship. Today most LLMs have poor taste and chipping away the cruft matters more …

uvx probably is the way to go here (fully self-contained environment for each skill), and use stdout as the I/O bridge between skills.

The cold-boot time on this model can hardly be called “serverless”

ELO scores for OCR don't really make much sense - it's trying to reduce accuracy to a single voting score without any real quality-control on the reviewer/judge. I think a more acc…