71–80 of 196 posts
About one year ago, I created an LLM gateway with metrics, provider fallback and switching, tools support, injecting, etc. etc., and unique features like acting as an MCP tools client and server, all streamed, with low latency. It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field. Putting $7.3M into such a project would make sense only in the…
The calculus in “buy or build” has shifted for me over the last six months especially. If I can make an agent build it, I get the version that’s tailored for me. > It was a simple project in terms of technical complexity. That’s the thing, though. The version I build for myself sheds all the features that get in my way. I don’t share them either because they’re only useful for me. Perhaps in the future big tech proje…
I feel like this is really going to change the software industry moving forwards. Historically it was tedious and time consuming to actually develop tailored dev tools which is why so many organizations relied on third party solutions. When nowadays you can easily half bake something in a few hours and get it working, tailored _specifically_ to your needs.
About one year ago, I created an LLM gateway with metrics, provider fallback and switching, tools support, injecting, etc. etc., and unique features like acting as an MCP tools client and server, all streamed, with low latency. It was a simple project in terms of technical complexity. I didn't publish it as I counted several similar projects in the field. Putting $7.3M into such a project would make sense only in the…
The calculus in “buy or build” has shifted for me over the last six months especially. If I can make an agent build it, I get the version that’s tailored for me. > It was a simple project in terms of technical complexity. That’s the thing, though. The version I build for myself sheds all the features that get in my way. I don’t share them either because they’re only useful for me. Perhaps in the future big tech proje…
I suspect so, the headless / "api/cli only" tools like CRM are pretty big right now and I don't think we've seen the end of that trend, probably more like just beginning.
Earlier quoted context omitted.
Burning through $7m in 9 months? That's an impressive amount of avocado toast.
$7m actually isn't a whole lot, especially if they hired a (larger) engineering team. Assuming their cali based, that's easily 150-200k per engineer, a team of 20 easily eats through that. Idk the specifics, but I don't the organization was fradulent, it could also be that they're going commercial and no longer want to maintain their oss stack
VCs think, 'Apps are risky, infrastructure is safe,' so they invested in AI infra. "infra is safe" Hmm, but that wasn't a good idea. because if an open source infrastructure project like TensorZero gets shut down this quickly, won't they start to realize that those investment theories are also risky? The difficult thing about AI infrastructure is that, unlike other industries, it will not become fragmented. It will l…
> VCs think, 'Apps are risky, infrastructure is safe,' so they invested in AI infra.
First off, this isn't even infra in the infra sense of the word. Infrastructure implied something physical, a pure software product can almost never be considered 'infra'. A tool maybe, but not 'infra'.
VCs can also be irrational and driven primarily by personal connections rather than reason. I didn't do a deep dive in this project/leadership, but often who you know is some important than what you produced. There's a reason why a lot of VCs go for the old motto of "I'd rather invest in an A team with a C product; than invest in a C team with an A product".
Earlier quoted context omitted.
Burning through $7m in 9 months? That's an impressive amount of avocado toast.
$7m actually isn't a whole lot, especially if they hired a (larger) engineering team. Assuming their cali based, that's easily 150-200k per engineer, a team of 20 easily eats through that. Idk the specifics, but I don't the organization was fradulent, it could also be that they're going commercial and no longer want to maintain their oss stack
Earlier quoted context omitted.
It's not on anyone to set up your favourite "governance" system. If anyone honestly wants to keep maintaining or using it the code is still there.
[flagged]