Viewing profile — alexeldeib

Why are those incompatible? Pricing is 10% under moonshot, and pure infra providers also want money

KV cache is, well, a cache that can fill up and trigger eviction. You require enough space to execute at least 1 fwd pass of 1 request at your context length. KV cache hits reduce …

“It depends”: what’s your prior experience, what kind of roles interest you, how big is the gap between what you have + a little ML knowledge/side projects? I’d argue there’s a big…

as someone in the space this ticks a lot of boxes: kubernetes-native, strong isolation, python sdk (ideal for ML scenarios). devmapper is a nice ootb approach. Glancing at the read…

Fun one: https://incident.io/blog/festive-macbooks

Oh nice! I just had an excuse to try mojo via max inference, it was pretty impressive. Basically on par with vllm for some small benchmarks, bit of variance in ttft and tpot. Very …

ouch, last “recent update” in 2023. Any idea what happened?

Larger memory, weaker comms. You can optimize for this by doing things like increasing batch size/data parallelism vs sharding schemes with more comms. At scale training won’t be a…

can't speak to GCP specifically but usually the issue is they are host-attached and can't be migrated, so need to be wiped on VM termination or migration -- that's when you lose da…

yeah, the system/application distinction feels somewhat superficial. The “multiple user space” inside a container thing sounds interesting (not sure what that means exactly), but m…

The "first" link (after the home button) on bbchallenge is the header bar link to https://bbchallenge.org/story which cites Aaronson in the first sentence (double first!). I would …

that's kind of a thing with https://docs.rs/no-panic/latest/no_panic/ or no std and custom panic handlers. not sure what the latest is in the space, if I recall there are some subt…

Brightline https://www.gobrightline.com/ Never had the chance to use it, but one of the more exciting US rail developments I’ve seen recently.

you seen kubie? `kubie ctx` is great for avoiding the first issue https://github.com/sbstp/kubie

Supabase would be a good pick. Vercel and Cloudflare both do SQL DBs now too, curious how they are. Neon seemed interesting, haven’t heard much about them in a while. None of those…

great talk! I’m curious about an approach like this combined with CUDA checkpoint for GPU workloads https://github.com/NVIDIA/cuda-checkpoint

What was your takeaway? Any added insights/reading?

Isn’t there an argument we’re simply better at brain statistics and modeling than current AI? Forget architectural limitations. What is the nature of the extrapolation? How do indi…

have you seen systemd-analyze?

This is the classic Dropbox criticism, no? Moreover, the pleasure has nothing to do with self hosting or not, it’s just a pleasant and whimsical UX while being technically solid.

They allegedly tried chromium without luck.

Fair question. This is where I’m struggling and part of the reason I ask the question. On some things, it’s likely I neither have a chance nor would they want me interfering. I res…

My parents turned 70 this year. They both have deteriorating health and independence, albeit in different ways. I want to help them but they are very set in their ways. What would …

From the description, I’d think this is all in cluster, not public.

Huh! Does this account for the difference between what we perceive as "room temperature" and our body temperature? I suppose that delta in temperature depends on medium the body is…