Viewing profile — dangoodmanUT

I'm seeing opus 59.2, Qwen 58.4?

If it was 200ms, then it had already charged the card...

The major labs don’t allow assistant prefill, so you have to “summarize”

> The models we reached for first, Claude Opus and Fable, refused a large part of that work: their safety guardrails treated reverse-engineering an exploit the same as launching on…

This is really cool, and really glad they shared it! It's clearly a lot of Claude though: > Neither is a URL fetch, so the allowlist never saw them. > No code ran; this vector is p…

This. The title might as well be “Choose a hammer rather than a wrench (when driving nails)”

Because huggingface is not charging them? CFAA doesn't just mean the feds kick down your door, you actually have to get reported and sued over it.

throws away spec doc for my own Are we all having this idea?

25k tokens is a few turns

J-space sounds oddly similar to...

finally, this was needed. A big worry was always "why does workers sit in front of my cache? that's a waste of an invocation if i'm returning a cached result"

We needed hyper-lightweight sandboxes for massively parallel agent fanout that could be recycled in milliseconds, take only KBs of memory when not actively running a command, and c…

i believe the author is confused this is the wrong direction (jk i read the readme)

If you actually bench it locally (local S3, actually writes to disk for "staged" operations), ZeroFS performs horrifically. Ceph blows it out of the water. I don't have the exact n…

How are they going to be competitive with top models at 70B size?

iroh is consistently one of the most delightful projects i've ever worked with. The people reflect that too. Congrats iroh team!

These are actually the most durable businesses because they have network effects: restaurants alright signed up, sellers onboarded, etc. Easier for them to adopt AI than AI compani…

Not comparing to GPT Pro models is a bit strange, considering that's the natural comparison

I'm really not looking forward to Gemini models on my devices. Gemini models clearly gaslight the user and hallucinate, they're also SUPER verbose, as shown in the demos from the k…

> The Messages API now accepts system entries inside the messages array. Developers can update Claude’s instructions mid-task without breaking the prompt cache or routing the updat…

Exactly this

It has been 0 days since GCP has taken down a startup (again). You see this at least once a year. Never heard of this from AWS or Azure. In all seriousness, this is why we don't us…

This. Type casting is an insidious problem (both correctness, and perf)

Why pick Gemini? It's probably the worst tool calling model of the major labs.

Seems like AI slop. They list Rippling, and the description starts with Parker Conrad, but the rest of it is about Deel: > Rippling > Parker Conrad's redemption arc after Zenefits …