Monitoring Raspberry Pi Devices Using Telegraf, InfluxDB and Grafana

Post by dls2016 » Fri, Aug 27, 2021, 1:09 PM UTC

justin_oaks wrote: post #21

dls2016 wrote: post #20

Earlier quoted context omitted.

I recently built a janky system which runs nmon (plus a few custom rpi stats) every two minutes or so and pushes the output file to a watch folder. Another service uploads to server if network available. The server then ingests into timescale. Have been running it on two rpis and a few aws servers for the past few months. Edit: I’m using grafana but was considering checking out apache superset.

How is the data sent into timescale? Do you run psql to load the data?

Post by mhall119 » Fri, Aug 27, 2021, 4:03 PM UTC

jimmySixDOF wrote: post #17

camtarn wrote: post #10

Earlier quoted context omitted.

Yes, agreed. This is basically what we do at my work: plot stuff from PLCs onto Grafana, while coping with intermittent connectivity. I'd love to buy a ready-made product that could do it, but there's literally nothing out there that quite comes close. As well as the things you identified, I suspect that there's just a lot of mistrust of open source in the industrial world - there's that whole thing of perceived valu…

A roll your own open source method works if you have a good low level understanding of what you are listening to and can organize your own alarm thresholds and groupings etc. Dealing with a large number of modbus/BACnet endpoints with vendor specific device profiles and PLC logic means the vendors backend systems will handle events and trend paterns better than what most facility teams can put together. However, the…

Post by liketochill » Fri, Aug 27, 2021, 6:24 PM UTC

camtarn wrote: post #19

liketochill wrote: post #15

Earlier quoted context omitted.

Wonderware historian, inductive automation ignition, and osi pi all can buffer data at a collection or edge node that it collects from a Plc and then forward it on to the central database historian when connectivity is present. Grafana might have a better web ui but they all offer some client for plotting. I am curious in what regard nothing comes close to grafana? I am Currently paying a lot for citect and wonderwar…

We're a bit of a weird case in that we log data at 20Hz and 100Hz for prototypes, so we need custom queries and/or aggregation to reduce that down for display. We had a good chat with Inductive earlier this year, but even they said that might be a bit much for them. Other than that, though, Ignition is literally everything we want in a single product.

Post by justin_oaks » Fri, Aug 27, 2021, 11:29 PM UTC

fignews wrote: post #23

justin_oaks wrote: post #14

Earlier quoted context omitted.

I looked into TimescaleDB, but didn't find a lot of support for monitoring agents that push data into Postgres. TimescaleDB is built on Postgres and uses the same mechanisms for ingesting data. There's a plugin for Telegraf that looks promising, but it hasn't been merged yet. Is anyone else using TimescaleDB? If so, what do you use to push monitoring data to it?

The solution I came up with but haven’t implemented yet is to use the collectd mqtt output plugin to get the data onto my broker (I use mqtt for other purposes, many of which should also end up in timescale) and then an mqtt to Postgres/Timescale bridge.

Post by raffraffraff » Wed, Sep 01, 2021, 12:00 PM UTC

justin_oaks wrote: post #14

dijit wrote: post #6

If I have a regret in my observability stack I think it’s got to be influxdb. I bought in to the TICK stack and planned on using an enterprise support contract when going to production, but every interaction with InfluxData the company has felt a bit sleazy. Trying to push very hard to the cloud offering for example. That’s bad enough, but the documentation and observability of the database is quite poor, and it’s tr…

I looked into TimescaleDB, but didn't find a lot of support for monitoring agents that push data into Postgres. TimescaleDB is built on Postgres and uses the same mechanisms for ingesting data. There's a plugin for Telegraf that looks promising, but it hasn't been merged yet. Is anyone else using TimescaleDB? If so, what do you use to push monitoring data to it?