S3-backed CH merge trees are notoriously expensive due to the high API call rates. We have a table doing over 11M APi calls per day. What are you seeing?
[deleted]
Show HN: HyperDX – open-source dev-friendly Datadog alternative
41–50 of 186 posts
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#42Earlier quoted context omitted.
This one is a fun one that I've spent too many nights on - we're largely similar to Google-style search syntax (bare terms, "OR" "AND" logical operators, and property:value kind of search). We include a "query explainer" - which translates the parsed query AST into something more human readable under the search bar, hopefully giving good feedback to the user on whether we're understand their query or not. Though ther…
Potentially useful resource – https://github.com/gajus/liqe
I've tried liqe! I really wanted to love it - and I think it's amazing for the use case you've built it for, but I recall we ran into a few fatal issues (maybe it was supporting URLs or something as a property value?) and had to fork one of the `lucene` forks to get the grammar that we wanted.
Edit: happy to chat more about it as well if you're looking for more specific feedback - it's an area I've spent a decent amount of time on and would love to improve projects like liqe or others based on our experience if we can.
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#43Since this is MIT, someone should fork it and add SSO to the OSS version/remove the SSO tax. Looks like they're just using Passport for auth, shouldn't take much to enable the OAuth bits of it. That's why this is MIT right, so folks can contribute stuff like this?
We're more than happy to have users self-host and deploy in a way that works with their SSO provider! Whether that's via SSO on Nginx or forking and adding SSO to Passport in their fork. Depending on the provider, it's likely very straight-forward to do. We did explicitly choose MIT for the freedom of end users to deploy and modify the code how they want - and tried to open source pretty much everything that doesn't…
Balancing open core needs is pretty much an impossible task IMO. You will never do enough to placate your open source users, and you will constantly be competing against yourself and spending cycles on non-value add things. Your cloud offering will be a huge time sink chasing regulatory compliance, security, and data sovereignty needs as well. It's for all these reasons that I personally think open core with a SaaS model is no longer a sustainable option.
There's nothing wrong with asking folks to pay for software instead of giving it away via FOSS, especially if you're honest about your intentions and goals. When you choose FOSS to gain traction and rug pull your users when no one converts later on, you end up reaping what you sow.
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#44This could be huge for healthcare companies like Metriport [1] - do you sign BAAs with customers for HIPAA compliance? [1] https://github.com/metriport/metriport
[deleted]
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#45S3-backed CH merge trees are notoriously expensive due to the high API call rates. We have a table doing over 11M APi calls per day. What are you seeing?
Is anyone doing these on cloudflare r2 where the cost is significantly lower?
R2 is significantly cheaper for egress, but not for API calls. It's still cheaper for API calls, but only by 10%:
- 1M GETs $0.36 (R2) vs $0.40 (S3)
- 1M PUTs $4.50 (R2) vs $5.00 (S3)
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#46Since this is MIT, someone should fork it and add SSO to the OSS version/remove the SSO tax. Looks like they're just using Passport for auth, shouldn't take much to enable the OAuth bits of it. That's why this is MIT right, so folks can contribute stuff like this?
The "SSO tax" is used to fund development of the project.
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#47S3-backed CH merge trees are notoriously expensive due to the high API call rates. We have a table doing over 11M APi calls per day. What are you seeing?
Is anyone doing these on cloudflare r2 where the cost is significantly lower?
I'd love to be using Cloudflare as our cloud provider, but it didn't seem to make a lot of sense for our use case.
We were concerned with some of the performance benchmarks we've seen with R2 in the past (though they've probably have improved), not to mention our compute options become a bit more limited to bandwidth alliance clouds otherwise we'll be eating network egress fees (which I do hate with a HUGE passion).
Though I can imagine if you're comfortable with one of the bandwidth alliance clouds already and can take a bit of a perf hit for search, R2 and Backblaze both can provide some cost savings depending on your workload.
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#48I remember when every SaaS landing page looked like Slack, then they all looked like Stripe, and I guess now they all look like Linear.
Linear seems to be the latest trend. https://www.linears.art/ - A collection of websites inspired by Linear
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#49Earlier quoted context omitted.
We're more than happy to have users self-host and deploy in a way that works with their SSO provider! Whether that's via SSO on Nginx or forking and adding SSO to Passport in their fork. Depending on the provider, it's likely very straight-forward to do. We did explicitly choose MIT for the freedom of end users to deploy and modify the code how they want - and tried to open source pretty much everything that doesn't…
Balancing open core needs is pretty much an impossible task IMO. You will never do enough to placate your open source users, and you will constantly be competing against yourself and spending cycles on non-value add things. Your cloud offering will be a huge time sink chasing regulatory compliance, security, and data sovereignty needs as well. It's for all these reasons that I personally think open core with a SaaS m…
Just clarifying, your alternative to open core is open nothing? Just proprietary it up?
Re: Show HN: HyperDX – open-source dev-friendly Datadog alternative
#50Earlier quoted context omitted.
Balancing open core needs is pretty much an impossible task IMO. You will never do enough to placate your open source users, and you will constantly be competing against yourself and spending cycles on non-value add things. Your cloud offering will be a huge time sink chasing regulatory compliance, security, and data sovereignty needs as well. It's for all these reasons that I personally think open core with a SaaS m…
Just clarifying, your alternative to open core is open nothing? Just proprietary it up?
Alternatives depend on what the goals of the person or organization who wrote the code are. There are various FOSS and source available options that can grant some freedoms while protecting others for the creator, such as if they want to let users still contribute and view the source.
My main point was you should get these ducks in order first and be genuine with your intentions. Don't use FOSS as a growth hack, it never ends well for the creator or the user. I don't think HyperDX is genuine with their intentions, as with all open core, it's all kumbaya FOSS until you start encroaching on their enterprise feature set.