Viewing profile — salamo

As someone who's done something similar ( https://blog.lukesalamone.com/posts/creating-tiny-semantic-s... ) the expensive part wasn't the training itself but the data curation and …

Possible reasons: - They might be dynamically adjusting these at inference time [1]. For example, start with a low temperature and generate samples with increasingly high temperatu…

Yeah, the model is small enough that inference is already basically instant for my usecase (only 6 transformer layers for the blog search).

Yeah, I also found that for ultra low footprint models ORT is a big portion of the total payload, because it contains logic for general ONNX graph operations. In my case I found th…

On the one hand, compacting at 300k saves OpenAI 40%. That's great. On the other hand, $10 for 1M tokens still seems really high? It's not too hard to blow through that in an hour …

I come at it from a slightly different angle. I write technical blog posts with visualizations and live demos. That usually means embedding a bit of custom javascript in the page f…

$1.7 billion is small potatoes. My bill is over $155 billion and growing. I'm worried if the trend continues I'll have depleted my rainy day fund.

An alternative algorithm which would probably converge faster than 100 questions would be something like Elo or Glicko 2. A word's "difficulty" would be some function of how rare i…

I’m working on an iOS app, One Million Checkmates [1]. It scratches an itch I had of chess puzzles for a long plane ride. This app has a functionally unlimited number of puzzles, a…

> I'd really wouldn't on the machine. I'll second this. Much better to set up a second machine you can ssh/tailscale into. If a training run takes down your training machine, you d…

See, that's why I have to post these things. Someone will inevitably reply with something more clever.

You'll also have some fun pinning down the difference between an "inaccuracy", a "mistake", and a "blunder". These are meaningful delineations for humans but not for a chess algori…

Really happy to see additional solutions for on-device ML. That said, I probably wouldn't use this unless mine was one of the specific use cases supported[0]. I have no idea how ha…

I mainly blog for myself in the future, but in a slightly different flavor than the author mentions. If there's a complicated ML concept that I'd really like to understand, explain…

Ok, I emailed you.

I live in the South Bay and would be willing to "host". But there's no way to announce a meetup or even reach out to some people.

I believe that observation is borne out in the statistics too, but traditional chess training usually centers around finding the best, hard-to-find move in a position rather than a…