Live data from Hacker News

Show HN: We built open OpenRouter that turns usage into a better model

github.com

41–50 of 50 posts

Re: Show HN: We built open OpenRouter that turns usage into a better model

#41
Congrats on the launching of your product. I will be taking it for a spin to compare it with these other products that seem to be competing directly with what you have to offer:

- https://github.com/ENTERPILOT/GoModel - https://github.com/maximhq/bifrost - https://github.com/BerriAI/litellm

Would you care to share what makes experiential different?

Re: Show HN: We built open OpenRouter that turns usage into a better model

#42
We built our own model router at GPTree but this looks interesting. Caching is definitely one of the hardest parts to get right, especially in our scenario where users can branch from any part of the conversation and keep the dynamic context from the parent (unlike most other platforms that lock in the context once you branch).

Re: Show HN: We built open OpenRouter that turns usage into a better model

#43
post #16

Open source and no markup is the right default for a gateway. The caching question above is the one I would want answered before swapping models though.

Ans: we rarely switch, often times it's just a "switch to using this model for your agent"

You guys should look into ngrok ai gateway. We have some small models running on local hardware that we tried to use but it was too painful. Just wanted to not waste all the compute hit one endpoint and be done but as a team.

Re: Show HN: We built open OpenRouter that turns usage into a better model

#44
I think I have to look at setting up one of these AI gateways for work, since AWS bedrock is such a PITA to hook a harness up to over IAM roles. Also I still can't believe bedrock hasn't released any open models in months (so there's paranoia that I'll want to swap in another provider).

Really though I'm hoping anthropic fixes the oppressive claude verbosity. I saw someone refer to being "clauderboarded" and my brain cannot let go of this as Claude's tokens bombard me.

Re: Show HN: We built open OpenRouter that turns usage into a better model

#45
post #32
post #31

Earlier quoted context omitted.

the business model, I suspect, is classic rug-pull in some time after building user base. proof: boldly claiming being open source in literally first sentence, while cowardly hiding on-by-default telemetry (WTF??) in truly last paragraph of readme. sorry to sound harsh, but this is typical old era playbook here. in the era of AI, fortunately, such products has much lower value. people and VCs didn’t yet tune to it.

Telemetry is off by default. PostHog is for usage analytics on the open source repo. Audit it if you're skeptical. We make money off enterprise licenses and hosting models. I have strong reason to suspect you either can't read or are a bad actor.

Your GitHub readme says telemetry is on by default

Re: Show HN: We built open OpenRouter that turns usage into a better model

#46
post #44

I think I have to look at setting up one of these AI gateways for work, since AWS bedrock is such a PITA to hook a harness up to over IAM roles. Also I still can't believe bedrock hasn't released any open models in months (so there's paranoia that I'll want to swap in another provider). Really though I'm hoping anthropic fixes the oppressive claude verbosity. I saw someone refer to being "clauderboarded" and my brain…

We had this exact problem so we solved it for ourselves. Happy to help if you run into any issues.

I have a /hmmm command I use for the second part that works reasonably well: "Stop using jargon and speak coherently. State it more simply and concisely, like one human talking to another. Make it like google dev docs style. More dead prose. No aphorisms, no flourishes. Simple."

Re: Show HN: We built open OpenRouter that turns usage into a better model

#47
post #32

Earlier quoted context omitted.

Telemetry is off by default. PostHog is for usage analytics on the open source repo. Audit it if you're skeptical. We make money off enterprise licenses and hosting models. I have strong reason to suspect you either can't read or are a bad actor.

Your GitHub readme says telemetry is on by default

"Anonymous aggregate PostHog product telemetry is enabled by default. It never includes prompts, traces, actions, observations, paths, model names, credentials, or raw customer content."

Re: Show HN: We built open OpenRouter that turns usage into a better model

#49
post #44

I think I have to look at setting up one of these AI gateways for work, since AWS bedrock is such a PITA to hook a harness up to over IAM roles. Also I still can't believe bedrock hasn't released any open models in months (so there's paranoia that I'll want to swap in another provider). Really though I'm hoping anthropic fixes the oppressive claude verbosity. I saw someone refer to being "clauderboarded" and my brain…

Oh. The UI screenshot on github is... not actually in the github repo? It's platform/hosted only? There's my first awkward discovery, but makes sense in retrospect.
Post reply on HN