Viewing profile — lukes386

Vector is designed to work well with systems like Kafka, not to replace them. While it does have a _very_ simple durable queue in the optional disk buffer feature, it is nowhere ne…

Yes, streaming k8s pod logs to Kafka and/or S3 is a great example of when you could use Vector. The "collect, transform, and route all your logs, metrics, and traces" bit is our mo…

Thanks for pointing this out! That limitation is largely a holdover from when the Kafka sink was written and our support for accepting multiple data types was not as good as it is …

I only mentioned it briefly at the end of the post, but metamorphic testing is a very interesting technique that addresses exactly this [0]. The basic idea is to start with some kn…

I've looked into OpenCensus/OpenTracing/OpenTelemetry (and the apparently unaffiliated OpenMetrics?) a bit, but I'm not as familiar as I'd like to be. It does seem like they're foc…

Thanks for your interest! And please feel free to get in touch if you have any questions or feel there are things we could do to better support your use case: https://vector.dev/co…

Absolutely, Veneur is something we looked at quite a bit when it popped up. It's clear Stripe was feeling a lot of the same pain points we were when we started building Vector and …

Vector can act as a Splunk forwarder, but is designed to be much more flexible. In addition to forwarding to more storage systems (S3, Elasticsearch, syslog, etc), Vector can do th…

We really love the idea of mtail and think it's criminally underused. A big part of the reason we started building Vector was to integrate that kind of functionality into a larger …

Thank you! Very glad it looks useful to you. It's still slightly rough around the edges, but Vector can actually ingest metrics today in addition to deriving metrics from log event…

That's a good way to think about it! Heka was a big inspiration. The design isn't exactly the same, but we're aiming to solve a lot of the same problems.

Hi! I work on Vector. For a motivating example, let's say you have an application fronted by nginx. Using Vector would allow you to ingest your nginx logs off disk, parse them, exp…

https://github.com/carols10cents/rustlings

Yep, you're right, a plain FutureResult works fine in this case. I was aware of the general rule about boxing futures, but didn't realize it was unnecessary in this case. Thanks fo…

Interesting post, but that much scaffolding around the tests is a bit of a red flag to me. I personally try to move as much logic as possible into easily testable, independent meth…

I've always wondered how difficult it would be to extract the vim "engine" into a library that could easily be reused by other programs. I can only assume the answer is "very diffi…

Yes, that's true. The approach has it's drawbacks though (validates_uniqueness_of being a prime example). As much as I like Rails, I sometimes wish it were designed with the databa…

On a somewhat related note, I'd love to see a more intermediate resource on how to really leverage PostgreSQL in your applications. As someone who primarily works with Rails, I fee…

previous discussion here: https://news.ycombinator.com/item?id=5889477

Even easier would be to setup cloudflare in front of the site. All you have to do is set the cache control headers for your landing page to something like "max-age=300, public". Th…

Just so you know, the "Give it a go" link in the README gives: An error has occurred: {"code":"ECONNREFUSED","errno":"ECONNREFUSED","syscall":"connect"}