Viewing profile — jonas_scholz

They wont, they are very public about never subsidising any products. I doubt they change that after 29 years now.

also slightly disrespectful to think that this was a single prompt, but ok:D

yeah, but why would LLM inference now triple the price of the other products? Or am I misunderstanding what you're saying?

"no reason" like hardware prices going through the roof?

Why do you think this would be madness? It seems like, at least in the EU, there is barely competition for the big open-weight models?

fine, i agree that this doesnt sound like me. But the content is correct and not a hallucination!

I mostly use Hetzner baremetal servers and not cloud, but the support there is in my experience very competent, but also VERY german and direct. I can imagine if youre neither germ…

what is the hallucination here? it is fast, free and fun to try. And I genuinely think that the hardware decision (if they get bigger gpus) decides if this will be a banger product…

yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane

I really hope they dont stop at the small models though! The bigger ones that dont fit on a single GPU are more interesting I think

agree. I have a usecase for a bigger open-weight model hosted by an EU company and the selection isnt really great, hard to make the regulatory gods (and the devs) happy at the sam…

My writing wasnt clear here I think, without the option it defaults to reasoning enabled. With "without it" I meant without enable_thinking=False!

Interesting, didn’t know about them! Weird model selection though, no glm or deepseek?

we love and support netbird at sliplane https://docs.sliplane.io/private-networking/netbird

Thank you for mentioning Sliplane! Really cool project.

afaik no firecracker support with virt-manager. There's firectl to make it a bit easier but the tooling is generally still pretty rough

Yes, we're on Hetzner! The availability is actually insane. Thank you :)

Thats cool! Id like to check that out if you want to share! jonas@sliplane.io or you can find me on Twitter/X (JonasScholz19) :)

BTW, this is also kinda how Sliplane started. We both are coming from a freelancing background and had built similar things for clients before

Yes! And its not like we don't care about that or don't want to follow all the rules, it's just really hard. Especially when you're not funded and a tiny team.