Viewing profile — fnbr

(I'm a researcher on Olmo.) There's a bunch of other fully open models, including the [Marin]( https://marin.community/ ) series of models out of Stanford and Nvidia regularly rele…

MoEs have a lot of technical complexity and aren't well supported in the open source world. We plan to release a MoE soon(ish). I do think that MoEs are clearly the future. I think…

(I’m a researcher on the post-training team at Ai2.) Where did you try this? On the Ai2 playground?

(I’m a researcher on the post-training team at Ai2.) 7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of compa…

Like what? All the examples people have said are where either 1) the company has Nx preferences, for N >1, in which case the company has essentially failed to fundraise or 2) the c…

This is why I will never work somewhere with a short post termination exercise period (PTEP). If it’s not at least 5 years, ideally 10, they don’t seriously consider equity somethi…

Can you explain? In most cases, preferences won’t come into play, assuming you raise at a standard 1x preference and sell for more than you have raised. In that case, owning 0.5% s…

I hate how every company that I place an order with treats that as permission to send a constant drip of marketing emails. I send them straight to spam.

They raised ~$200M total, and $150M at the series A. So if they're just paying back investors, they'd "only" need $500M.

do we know they were profitable? I doubt it, if they pulled this. I think they had high DAU/MAU but low paid users. this is basically Inflection 2.0.

Yes, many AI startups pay more than FAANG for ML talent.

What's the dating app?

The rule of thumb is roughly 44gb, as most models are trained in bf16, and require 16 bits per parameter, so 2 bytes. You need a bit more for activations, so maybe 50GB? you need e…

Agreed, that’s what I’m seeing too.

These prices are insane- you can do much, much better than those prices if you negotiate. If you're paying $7.20 per GPU-hour for an H100, you should find another supplier.

Yeah Alberta has very little hydro, while Ontario/Quebec/BC have lots, so our electricity generates a lot more carbon.

That's a great reason not to have electric rental cars, but not a great reason to not charge rental cars.

I meant rent on GCP. You’re right.

I’m surprised they sell any to external customers, to be honest.

Wow. This is surprising. Not even an acquihire. I’m very curious about what happened internally to lead to this.

Private equity firms. I’d never take money from them.