Live data from Hacker News

Osquery

osquery.io

21–29 of 29 posts

Re: Osquery

#21
post #17
post #5

If you're in a security team adding this to your stack, we're building a visual playbook & pivoting system, and have been wanting to experiment with scenarios that include an osquery connector. Can share more @ info@graphistry.com , would love to explore!

What is a "visual playbook and pivoting system"?

We don't know but sales said those terms and trending hard, ohh and we also have AI .... not sure in which part of the system but we do!!!!!!

Re: Osquery

#22
How do you issue queries programmatically from another program? Just execute "osqueryi"? I see mention of a Thrift API but no details.

Re: Osquery

#23

Not directly related to Osquery, but we're using Tanium to run queries against ~180,000 endpoints and we get good results back in about a minute.

Tanium says, the max # of endpoints that the "core" can support is 33K. How did you scaled this to 180 K.

Re: Osquery

#24
post #16
post #15

Earlier quoted context omitted.

Thank you for the reply; however, I am still having a hard time understanding how exactly Osquery works under the hood. How does it communicate with other hosts? With what does it query for information once it reaches a remote node? What kind of overhead does it have in terms of network transfer when querying? Maybe I am completely off base and am mistaking how this works... Is Osquery set up on every individual host…

You can configure osquery to execute periodic queries (scheduled queries) of all kinds: computing md5 of your binaries and other files, taking a snapshot of sockets/connections per process, and so on. By default, osquery uses glog, which means it'll output the results to a local file that you can ship anywhere you want. There's also logging plugins to help you push the results of scheduled queries to other systems. O…

But do you need an installation of osquery on the remote machines too? Or some kind of remote agent? Or does it just try to login to each remote machine over e.g. SSH?

Re: Osquery

#25
post #16

Earlier quoted context omitted.

You can configure osquery to execute periodic queries (scheduled queries) of all kinds: computing md5 of your binaries and other files, taking a snapshot of sockets/connections per process, and so on. By default, osquery uses glog, which means it'll output the results to a local file that you can ship anywhere you want. There's also logging plugins to help you push the results of scheduled queries to other systems. O…

But do you need an installation of osquery on the remote machines too? Or some kind of remote agent? Or does it just try to login to each remote machine over e.g. SSH?

It's a remote agent. If you want the scheduled execution, you install the program and configure it internally to run on a schedule.

I haven't finished the work yet, but my employer will be feeding the log results into our ELK stack.

There are other frontends like 'doorman' which allow for ad hoc queries. That is a little more work to stand up.

Re: Osquery

#26
post #17

Earlier quoted context omitted.

What is a "visual playbook and pivoting system"?

We don't know but sales said those terms and trending hard, ohh and we also have AI .... not sure in which part of the system but we do!!!!!!

Edit: I guess the above post was trolling, but I think it's fair to ask what pivoting & playbooks are.

They're coming from the investigative & ops sides of the enterprise security world. Not terms I used when I was on the R&D side, but useful when they describe big chunks of your job:

-- "Visual pivoting" is where a visual tool -- typically in node-link diagrams like Maltego, Palantir, and ours (Graphistry) -- lets you click on an entity like a user etc, and get the result of running queries. For example, "according to vpn/dhcp logs, what hostname was this yesterday? Did the IDS logs say anything funny about that hostname?", or, "Looks like this patient had a bad experience with that doctor, what are the interactions other patients had with that doctor?" AFAICT, "pivoting" became the shorthand for "a left-join, including across different APIs instead of within one database".

-- We're using "Visual playbooks" to describe a way of helping turn a team's text documents describing their manual operating procedures for incident investigation & response into interactive software. They often can't just automatically trigger chef/puppet scripts because someone needs to check incident data. For example, we find a lot of teams want help triaging an endpoint incident alerts: resolving the host/user involved, what other alerts were happening for them, were other users/hosts getting similar alerts, and if external IPs are involved, what threat intel feeds say + is anyone else internally talking to those. A visual playbook helps you kick off an executable sequence of context-gathering pivots + maybe API action calls, and instead of returning a text file / dashboard, drops you into a visual analytics session that shows you how the pivot results chain together. So basically visual etl + visual analytics + visual querying.

It's new but fun. Hopefully you can see why osquery is a nice tool for some of the steps within an investigation... or visual playbook ;-)

Re: Osquery

#27
post #7

Outside of facebook, what's the largest install base of osquery?

We have an ongoing project and existing prototype that combines OSquery with the Bro network security monitor. This enables correlation of network and host state in the same framework.

More details here: https://www.bro.org//bro4pros2017/Haas_OSquery_Bro4Pros2017....

Re: Osquery

#28

Earlier quoted context omitted.

We don't know but sales said those terms and trending hard, ohh and we also have AI .... not sure in which part of the system but we do!!!!!!

Edit: I guess the above post was trolling, but I think it's fair to ask what pivoting & playbooks are. They're coming from the investigative & ops sides of the enterprise security world. Not terms I used when I was on the R&D side, but useful when they describe big chunks of your job: -- "Visual pivoting" is where a visual tool -- typically in node-link diagrams like Maltego, Palantir, and ours (Graphistry) -- lets y…

I have a little exposure to enterprise security and I can't say I have heard visual playbook or visual pivotting. A quick Google search does not reveal that many links for either term. Between playboy or pivotting the only one that i associate with security is pivotting and that was started with Core Impact usage a decade ago.

I'm always interested in learning new things about security. Do you have any pointers to other materials related to visual playboy's or visual pivotting?

Post reply on HN