Viewing profile — arkmm

I'd also be really curious about the cost to run something like this, and what things you think it's particularly helpful for?

Building a simple sandboxed way to run open weight models over a copy of all my personal data (email, docs, messaging, photos, etc). Think it'd be cool to have a self hosted AI "ch…

And the human has to explain it at 2 tokens/sec (average speaking speed ~130-150 wpm). That's another constraint against slop - humans need to be able to explain their code succinc…

I think part of the problem is the context windows for humans are actually much smaller than what an LLM can keep track of today. The small context window of humans is a feature th…

Seems like LLMs embrace that last point as well.

everything is computer

Didn't know this technique had a name, but I would think a modern compiler could make this optimization on its own, no?

You can fine tune a small LLM with a few thousand examples in just a few hours for a few dollars. It can be a bit tricky to host, but if you share a rough idea of the volume and wh…

Can you share more details about your use case? The good applications of fine tuning are usually pretty niche, which tends to make people feel like others might not be interested i…

Payment fees are crazy when you think about them from the perspective of a merchant in a low margin business. E.g. in retail or restaurants, margins aren't much better than ~10%. I…

I used to also have this optimistic take, but over time I think the reality is that most people will instead just distrust unknown online sources and fall into the mental shortcuts…

Get ready for the acquisition offers.

Sorry Ploum, just getting a chance to read this now and comment. Great insights!

this is a really cool insight, going to use this on my team from now on!

Because of the coordination across multiple systems + chaining LLM calls, a lot of agents today can feel really slow. I would love to know how others are tackling this: - How are y…

They're still very good for finetuned classification, often 10-100x cheaper to run at similar or higher accuracy as a large model - but I think most people just prompt the large mo…

Maybe a bit off-topic, but how'd you meet your partner while on your adventures?

As a follow-up to this, even though water makes up 70% of the Earth's surface, it's only 0.02% of the Earth's mass.

Wow, this deserves its own submission.

Neat approach, but seems like the eventual goal of caching DOM maps for all users would be a privacy nightmare?

What's misleading about that? You rent $100 of time on an H100 to train the model.

What sorts of automations were you able to get working with the Chrome dev tools MCP?

The irony of this is so much of Reddit comments these days are AI generated.

Unfortunately I think they have stopped doing this since COVID.

This misses the forest from the trees IMO: - The datacenter GPU market is 10x larger than the consumer GPU market for Nvidia (and it's still growing). Winning an extra few percenta…