Ask HN: How do you manage event tracking at your workplace • Hacker News Board

Re: Ask HN: How do you manage event tracking at your workplace

#11

Post by steve76 » Sat, Jul 20, 2019, 10:39 AM UTC

scottfr wrote: post #10

Google Cloud Function streaming inserts to BigQuery. Then analysis is carried out with the BigQuery UI (ad hoc analyses or scheduled queries for pipelines), DataStudio (visualizations -- we use this infrequently, it's really not great) or Google Colab (statistical analyses, complex visualizations). The pros are: * full SQL access to the data via BigQuery * simple to set up (yes, you have to write custom code; but a b…

My biggest problem with GA is that api key. If it ever leaks public, people can hack you.

I would like a guest account please, some way to do it without authorization or authentication. They sample anyways. .. ... ...

What I'm working on is using discord app bots. Have public guest channels, and see if my team is good enough to see what's real and what's fake. Great with auditing.

Hey!

You want to take out Pro/E, Solidworks, AutoCAD, Catia, EVERYONE?

I'm working on PDM ERP CAD Parametric standards.

Just host SVG through github!

RFC Please:

https://twitter.com/thisbounty_com/status/115239055482049741...

Re: Ask HN: How do you manage event tracking at your workplace

#12

Post by mosselman » Sat, Jul 20, 2019, 11:03 AM UTC

Papertrail gem in Ruby on rails. If that doesn’t exist for your platform, just roll your own little table with logging for who did what when. This is so easy to do, why pay thousands per year for some third party to do it and at the same time siphon off possibly sensitive data as a side effect?

Re: Ask HN: How do you manage event tracking at your workplace

#13

Post by chrisan » Sat, Jul 20, 2019, 11:28 AM UTC

namanyayg wrote: post #7

We're using Snowplow and it's quite great. There's a complicated setup process and you have to declare event schema before starting tracking, but it's quite cost effective if that's your priority. We have millions of rows coming from unique users in realtime at $600/mo, with Segment this would at least be $5000/mo. We then use Redash to prepare charts, tables, etc for analysis.

snowplow looks like $1500/month with no realtime until the $5000/month plan?

https://snowplowanalytics.com/pricing/

Re: Ask HN: How do you manage event tracking at your workplace

#14

Post by buremba » Sat, Jul 20, 2019, 11:35 AM UTC

That's what we do at Rakam. If you have less than ~10M events per month, Postgresql works smoothly if you use features such as partitioned tables, parallel queries, and BRIN indexes. The only limitation is that since it's not horizontally scalable, your data must fit in one server. We have SDKs that provide ways to send the event data with the following format:

rakam.logEvent('pageview', {url: 'https://test.com'})

The event types and attributes are all dynamic. The API server automatically infers the attribute types from the JSON blob and creates the tables which correspond to event types and the columns which correspond to event attributes and inserts the data into that table. It also enriches the events with visitor information such as user agent, location, referrer, etc. The users just run the following SQL query:

SELECT url, count(*) from pageview where _city = 'New York' group by 1

All the project is open-source: https://github.com/rakam-io/rakam Would love to get some contribution!

Re: Ask HN: How do you manage event tracking at your workplace

#15

Post by envolt » Sat, Jul 20, 2019, 12:23 PM UTC

dajohnson89 wrote: post #9

contingencies wrote: post #8

Logfiles.

but that doesn't look good on my resume!

Generating logs in a specific format. Push that to ElasticSearch, visualize with Kibana.

This might!

Re: Ask HN: How do you manage event tracking at your workplace

#16

Post by nairobi222 » Sat, Jul 20, 2019, 1:24 PM UTC

Most product analytics companies offer a free startup account for a year, so check on that. If you just need web server log processing, AWStats is free and pretty good: https://awstats.sourceforge.io/

Re: Ask HN: How do you manage event tracking at your workplace

#17

Post by bobbydreamer » Sat, Jul 20, 2019, 5:12 PM UTC

Firebase & cloud functions could be a start. I use this to track events and take according actions via cloud functions but they are not user events. In a user scenario it can be used.

Re: Ask HN: How do you manage event tracking at your workplace

#18

Post by bradwood » Sat, Jul 20, 2019, 5:21 PM UTC

Dabezium on all the relational databases into kafka.

Re: Ask HN: How do you manage event tracking at your workplace

#19

Post by elrobinto » Sat, Jul 20, 2019, 5:46 PM UTC

chrisan wrote: post #13

namanyayg wrote: post #7

We're using Snowplow and it's quite great. There's a complicated setup process and you have to declare event schema before starting tracking, but it's quite cost effective if that's your priority. We have millions of rows coming from unique users in realtime at $600/mo, with Segment this would at least be $5000/mo. We then use Redash to prepare charts, tables, etc for analysis.

snowplow looks like $1500/month with no realtime until the $5000/month plan? https://snowplowanalytics.com/pricing/

It's open source, so if you set it up yourself you only pay for aws costs (I think it can also run in Google cloud, not tried myself though).

Re: Ask HN: How do you manage event tracking at your workplace

#20

Post by namanyayg » Sun, Jul 21, 2019, 9:34 AM UTC

chrisan wrote: post #13

namanyayg wrote: post #7

We're using Snowplow and it's quite great. There's a complicated setup process and you have to declare event schema before starting tracking, but it's quite cost effective if that's your priority. We have millions of rows coming from unique users in realtime at $600/mo, with Segment this would at least be $5000/mo. We then use Redash to prepare charts, tables, etc for analysis.

snowplow looks like $1500/month with no realtime until the $5000/month plan? https://snowplowanalytics.com/pricing/

That's for the hosted version, you can self host on aws