Live data from Hacker News

Show HN: sllm – Split a GPU node with other developers, unlimited tokens

sllm.cloud

81–90 of 117 posts

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#81
post #31

Earlier quoted context omitted.

This problem sounds like an excellent opportunity. We need a race to the bottom for hosting LLMs to democratize the tech and lower costs. I cheer on anyone who figures this out.

This is classic queuing theory, rate limits etc. I don't have an answer but I would look there.

What if you could group multiple of them. Long queries run on the group that’s commonly doing those. Shorter queries que faster because they’ll execute faster.

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#82

Earlier quoted context omitted.

20 tok/s is an average. It can be more, it can be less. If you are running off-peak I'm sure you'd get some crazy number.

Why wouldn't developers just do llm arbitrage against openrouter if it is a better deal?

For the same reason people don’t do server arbitrage because Hetzner is cheaper than AWS.

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#84

$40/mo for deepseek r1 seems steep compared to a pro sub on open ai /claude unless you run 24x7. im not sure how sharing is making this affirdable.

> $40/mo for deepseek r1 seems steep compared to a pro sub on open ai /claude unless you run 24x7. "Running 24x7" is what people want to do with openclaw.

Seems like they have a rate limit so it is kinda the same as normal subs - don’t really see the advantage yet

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#85
what is the main moat of your idea? privacy? otherwise it looks like a less flexible API compared to what chutes.ai or openrouter.ai providing. and they have TEE instances, which are more private. also why did u decide on launching V3 instead of some much more exciting models revealed recently like MiMo-V2-Pro or Arcee's Trinity Large?

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#87
Especially with only 1mo commitment, what happens if there's a lot of churn after the first month – more people leave a cohort than are waiting for one? The whole cohort is then waiting for it to fill again before it restarts? And will people waiting for the next cohort to fill automatically be reassigned to the last (now not full) one anyway, or would there then be multiple partially filled cohorts for a single spec?

I like the idea, I just wouldn't want my subscription to suddenly be on hold because a peer decided to stop theirs.

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#88
“Unlimited tokens” is doing a lot of heavy lifting here.

This feels less like a pricing breakthrough and more like shifting the abstraction down to GPU sharing — which most developers probably don’t want to think about.

Curious how usable this actually feels under contention.

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#89

“Unlimited tokens” is doing a lot of heavy lifting here. This feels less like a pricing breakthrough and more like shifting the abstraction down to GPU sharing — which most developers probably don’t want to think about. Curious how usable this actually feels under contention.

This comment reeks of AI.

Out of your other three comments in the your entire account’s history, two of them are pretty structurally identical: quote hook + tangentially related question.

What is the ultimate play for all these AI accounts? Warming them up for future astroturfing and marketing? Manipulating upvotes?

Re: Show HN: sllm – Split a GPU node with other developers, unlimited tokens

#90

[flagged]

For my part, the code quality of the next.js dashboard isn't even something I'd evaluate.

I instantly get a quick, functional-appearing view of the offering. I can picture how I might interact with it and what mental gymnastics stand between right now and me pulling out a credit card.

I don't see marketing fluff that bring up more questions than it provides answers. I can be pretty certain I won't wind up in a sales funnel from hell, also.

Post reply on HN