Live data from Hacker News

Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

github.com

1–10 of 36 posts

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#2
I stil remember the initial announcement of this years ago... I wasn't able to use it back then but saved it for later.

I'm currently in a situation in which I'd love to use osquery which is why I tried it out a few month ago.

Sadly, there wasn't any inbuilt multi-node/cluster functionality to speak of.

I gave up on it as it's utility is pretty low if you're constrained to localhost queries... And the third party "cluster" tools looked pretty barebones and seemed a hassle to setup. And not even really useful, as they just enable you too execute queries on several nodes.

I would want to do queries across servers. (I.e. select load,uptime, hostname where servertype "worker" and kernelversion "3.4")

there was very little value for me which I could already get with an adhoc Ansible task on my servers

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#3
The Linux kernel already has a pretty good API available via file nodes. And there are other lightweight tools to gather and parse information. Not sure I understand the benefits of exposing it through SQL, but I know some people are obsessed with SQL.

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#4
post #2

I stil remember the initial announcement of this years ago... I wasn't able to use it back then but saved it for later. I'm currently in a situation in which I'd love to use osquery which is why I tried it out a few month ago. Sadly, there wasn't any inbuilt multi-node/cluster functionality to speak of. I gave up on it as it's utility is pretty low if you're constrained to localhost queries... And the third party "cl…

Hey, there are a few open-source projects doing this:

- https://github.com/kolide/fleet - https://github.com/mwielgoszewski/doorman - https://github.com/zentralopensource/zentral

Then there are a few freemium:

- https://www.zercurity.com/ (Shameless plug - free for as long as you like) - https://kolide.com/ (Though no SQL interface anymore) - https://www.uptycs.com/ (Free trial)

Hope that helps. I'm sure there are a few others.

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#5

The Linux kernel already has a pretty good API available via file nodes. And there are other lightweight tools to gather and parse information. Not sure I understand the benefits of exposing it through SQL, but I know some people are obsessed with SQL.

Normalizing the data without vast sort/sed/awk gymnastics seems the key win.

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#6
OSQuery is pretty powerful and the SQL-like query makes it easier to correlate various system metrics in 1 step.

However compared to a central metric system that can aggregate metrics across all the hosts, its use quickly becomes less important.

Also there are some CPU considerations, as OSQuery is not as lightweight as other metrics gather tools. Several times I've ran into OSQuery interfering with the actual application, competing for resources. So if you do run it, make to renice it to mitigate this, especially if you're running time-sensitive apps like video/audio.

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#7
post #5

The Linux kernel already has a pretty good API available via file nodes. And there are other lightweight tools to gather and parse information. Not sure I understand the benefits of exposing it through SQL, but I know some people are obsessed with SQL.

Normalizing the data without vast sort/sed/awk gymnastics seems the key win.

My understanding is there’s security and standardization benefits as well. If I’m remembering correctly there was a local keychain credential stealing attack around the time I was first looking at it and they had a plug-in available for detection the same day. While it wasn’t something magical you couldn’t write, test and run on your fleet yourself a central place to deduplicate that sort of work/test cycle and collaborate was compelling.

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#8

The Linux kernel already has a pretty good API available via file nodes. And there are other lightweight tools to gather and parse information. Not sure I understand the benefits of exposing it through SQL, but I know some people are obsessed with SQL.

Correlating around different API calls is a good use case for SQL

Re: Osquery: SQL-powered operating system instrumentation, monitoring, and analytics

#9

The Linux kernel already has a pretty good API available via file nodes. And there are other lightweight tools to gather and parse information. Not sure I understand the benefits of exposing it through SQL, but I know some people are obsessed with SQL.

Personally I'll be glad if this serves me as a tool to get info from `ps`, `netstat` and similar things without looking through man pages every time I'm doing something other than the handful routine invocations.

Thought of writing such an util myself, actually, though not with SQL.

Post reply on HN