very interesting and approacheable solution. With regards to: >" Rudder runs as a single go binary with Postgres. It also needs the destination (e.g. GA, Amplitude) specific transformation code which are node scripts. " what would be a recommended approach, if I would like to keep the data internally, and not use external Analytics engine?
We also have a S3 destination so you can just add S3. Support for other data-warehouses (Redshift, Bigquery etc) is coming soon.
What I was hoping/looking for is something where another tool lightweight tool that can be installed alongside Rudder, that can use PG instance (may be just different db within Rudder's instance or just different schema).
For a light weight, end-to-end solution (including analytics) that can 'grow' with needs.
For many small self-funded startups that care about privacy a combination of following challenges exist:
a) need self-hosted solutions that require minimal footprint (because data, even anonymized, is hosted on self-paid VPS instances )
b) need to use solutions that do not require initial purchase/investment, but yet can scale out (both technically, and in terms of support) when/if commercial model of the startup becomes more successful
c) need to use solutions that are not heavy VC backed, because those typically do not have stable engagement model (as VCs rates of return demand, typically, changes in initial service/open source model, while self-funded startups are typically much slower growing (and slower in committing to buying expenses))
d) need self-hosted solutions to cover lot of ground in one (so that the learning curve, and time needed to integrate are minimized).