Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
docs.fiveonefour.com
Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
1–10 of 17 posts
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#2I put this Docker-Compose recipe together to make kicking the tires on Moose—our open-source data-backend framework—almost friction-less.
What you get:
• A single docker compose up that spins up ClickHouse, Redpanda, Redis and Temporal with health-checks & log-rotation already wired.
• Runs comfortably on an 8 GB / 4-core VPS; scale-out pointers are in the doc if you outgrow single-node.
• No root Docker needed; the stack follows the hardening tips ClickHouse & Temporal recommend.
Why bother?
Moose lets you model data pipelines in TypeScript/Python and auto-provisions the OLAP tables, streams and APIs—cuts a lot of boilerplate. Happy to trade notes on the approach or hear where the defaults feel off.
Docs: https://docs.fiveonefour.com/moose/deploying/self-hosting/de...
18-min walkthrough video: https://www.youtube.com/watch?v=bAKYSrLt8vo
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#3[dead]
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#4this is too perfect.
as an SRE who often needs to hand roll my own deployments in k8s or w/e medium, these are the docs that really accelerate my path to production.
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#5For everyone else confused too…think moose in this context is probably this:
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#6For everyone else confused too…think moose in this context is probably this: https://mooseframework.inl.gov/
Actually, this https://github.com/514-labs/moose
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#7I put this Docker-Compose recipe together to make kicking the tires on Moose—our open-source data-backend framework—almost friction-less. What you get: • A single docker compose up that spins up ClickHouse, Redpanda, Redis and Temporal with health-checks & log-rotation already wired. • Runs comfortably on an 8 GB / 4-core VPS; scale-out pointers are in the doc if you outgrow single-node. • No root Docker needed; the…
I have a small open-source project, that uses docker compose behind the scenes, to help startup any service. You can look to add it in (or I am also happy to add it in) and then users are one command away from running it (insta moose). Recently just added in lakekeeper and various data annotation tools.
insta-infra: https://github.com/data-catering/insta-infra
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#8For everyone else confused too…think moose in this context is probably this: https://mooseframework.inl.gov/
I thought of https://moosetechnology.org/ and wondered why I'd need all that fancy other stuff?
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#9I put this Docker-Compose recipe together to make kicking the tires on Moose—our open-source data-backend framework—almost friction-less. What you get: • A single docker compose up that spins up ClickHouse, Redpanda, Redis and Temporal with health-checks & log-rotation already wired. • Runs comfortably on an 8 GB / 4-core VPS; scale-out pointers are in the doc if you outgrow single-node. • No root Docker needed; the…
I have a small open-source project, that uses docker compose behind the scenes, to help startup any service. You can look to add it in (or I am also happy to add it in) and then users are one command away from running it (insta moose). Recently just added in lakekeeper and various data annotation tools. insta-infra: https://github.com/data-catering/insta-infra
Interesting. How do you do dependencies between those pieces of infrastructure if there's any? For example, in our Docker Compose file, we have temporal that depends on progress and then moose depends on temporal. How is that expressed in Insta-Infra?
Re: Self-Hosting Moose with Docker Compose, Redis, Temporal, Redpanda and ClickHouse
#10Earlier quoted context omitted.
I have a small open-source project, that uses docker compose behind the scenes, to help startup any service. You can look to add it in (or I am also happy to add it in) and then users are one command away from running it (insta moose). Recently just added in lakekeeper and various data annotation tools. insta-infra: https://github.com/data-catering/insta-infra
Interesting. How do you do dependencies between those pieces of infrastructure if there's any? For example, in our Docker Compose file, we have temporal that depends on progress and then moose depends on temporal. How is that expressed in Insta-Infra?
It leverages docker compose 'depends_on' for the dependencies (https://docs.docker.com/compose/how-tos/startup-order/). For example, airflow depends on airflow-init container to be completed successfully which then depends on postgres.
https://github.com/data-catering/insta-infra/blob/main/cmd/i...