Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Run Kubernetes on top of DC/OS

mesosphere.com

Post reply on HN
Print view View original

21–30 of 37 posts

Re: Run Kubernetes on top of DC/OS

#21

Post by bogomipz »

estill01 wrote: post #15
bogomipz wrote: post #10

I was confused by this passage: >"Running Kubernetes on DC/OS allows you to run different types of workloads (more explicitly, both the stateless and stateful components that make up most modern applications) on the same infrastructure." Can someoene answer - how does Running Kubernetes on top of DC/OS help you run stateful apps on Kubernetes? Or is the meaning that DC/OS is better for running stateful services and t…

Currently running stateful apps on a DC/OS cluster + HA DBs. Fairly straight forward to get stateful working now + there are libs to migrate data around to chase your apps/services when/if Mesos/Marathon relocates them (e.g. after a service restart/crash) if you need your data co-located with a managed app/service. The thing I'm most interested in exploring with K8+DC/OS is having DC/OS manage a couple of K8 instance…

Thanks, can you elaborate on the libs available to "migrate your data around"? Does Mesosphere reschedule your DB to another node that has an equivalent persistent and reserved storage(SSD etc.) volume configured on it?

Are you using Portworx for this?

Re: Run Kubernetes on top of DC/OS

#22

Post by tknaup »

trengrj wrote: post #18
don71 wrote: post #9

Earlier quoted context omitted.

DC/OS is also open source. What are your concerns with it?

Components aren't open source. Still waiting for the new hdfs package to be released see https://github.com/mesosphere/hdfs-deprecated/blob/master/RE...

The new package is here: http://universe.dcos.io/#/package/beta-hdfs/version/latest

Re: Run Kubernetes on top of DC/OS

#23

Post by mej10 »

devrandomguy wrote: post #17

Could anyone point out the boundary between the open-source Mesos / Marathon stack, and the commercial DC/OS? The official documentation ( https://docs.mesosphere.com/1.9/overview/what-is-dcos/ ) doesn't make it clear. What capabilities does DC/OS have that are not available in the open-source portion of the stack? > As a distributed system, DC/OS includes a group of agent nodes that are coordinated by a group of mas…

DC/OS is a distribution of Mesos similar to how Red Hat is a distribution of Linux.

It includes additional open-source and closed-source components that make running/managing a Mesos cluster and Mesos frameworks (such as Marathon, Spark, Cassandra, etc) easier.

The community edition is free to use.

Re: Run Kubernetes on top of DC/OS

#24

Post by trengrj »

tknaup wrote: post #22
trengrj wrote: post #18

Earlier quoted context omitted.

Components aren't open source. Still waiting for the new hdfs package to be released see https://github.com/mesosphere/hdfs-deprecated/blob/master/RE...

The new package is here: http://universe.dcos.io/#/package/beta-hdfs/version/latest

Yes the package is available but as far as I can see not open source yet.

Re: Run Kubernetes on top of DC/OS

#25

Post by nemothekid »

devrandomguy wrote: post #17

Could anyone point out the boundary between the open-source Mesos / Marathon stack, and the commercial DC/OS? The official documentation ( https://docs.mesosphere.com/1.9/overview/what-is-dcos/ ) doesn't make it clear. What capabilities does DC/OS have that are not available in the open-source portion of the stack? > As a distributed system, DC/OS includes a group of agent nodes that are coordinated by a group of mas…

As I understand it, DC/OS is essentially a nicer interface for Mesos / Marathon with baked in monitoring, service discovery, security add-ons and a "package" manager-esque framework manager.

DC/OS is actually open source (I think) so I don't think it has any capabilities you could get for free.

Re: Run Kubernetes on top of DC/OS

#26

Post by estill01 »

bogomipz wrote: post #21
estill01 wrote: post #15

Earlier quoted context omitted.

Currently running stateful apps on a DC/OS cluster + HA DBs. Fairly straight forward to get stateful working now + there are libs to migrate data around to chase your apps/services when/if Mesos/Marathon relocates them (e.g. after a service restart/crash) if you need your data co-located with a managed app/service. The thing I'm most interested in exploring with K8+DC/OS is having DC/OS manage a couple of K8 instance…

Thanks, can you elaborate on the libs available to "migrate your data around"? Does Mesosphere reschedule your DB to another node that has an equivalent persistent and reserved storage(SSD etc.) volume configured on it? Are you using Portworx for this?

> "can you elaborate on the libs available to 'migrate your data around'? ... Are you using Portworx for this?"

The tool I had in mind was 'REX-Ray'[https://mesosphere.github.io/marathon/docs/external-volumes....].

That said, we're not actually doing the 'chasing db' config. Instead we run a HA Neo4j DB deployment as a Marathon service pegged to a handful of nodes each with local persistent volumes allocated to Neo4j. I.e. we can allocate a % of a node's resources to 'static' Neo4j deploys, and then let Marathon dynamically manage any remaining free resources on the nodes. Our other services then use the Marathon service DNS to look up the Neo4j service for read/write.

Portworx looks cool too -- will need to investigate.

Also, the DC/OS documentation is quite good in general if you're looking to dig in on this: https://dcos.io/docs/1.9/storage/

> "Does Mesosphere reschedule your DB to another node that has an equivalent persistent and reserved storage(SSD etc.) volume configured on it?"

Yes/it can, but in that config you're booting up new/empty storage volumes. Obviously not what you want for many core persistence requirements though great for caches. We'll probably opt for this config near-term for our web-server SSR cache.

Re: Run Kubernetes on top of DC/OS

#27

Post by spahl »

trengrj wrote: post #24
tknaup wrote: post #22

Earlier quoted context omitted.

The new package is here: http://universe.dcos.io/#/package/beta-hdfs/version/latest

Yes the package is available but as far as I can see not open source yet.

Here it is: https://github.com/mesosphere/dcos-commons/tree/master/frame...

Re: Run Kubernetes on top of DC/OS

#28

Post by ferrantim »

estill01 wrote: post #26
bogomipz wrote: post #21

Earlier quoted context omitted.

Thanks, can you elaborate on the libs available to "migrate your data around"? Does Mesosphere reschedule your DB to another node that has an equivalent persistent and reserved storage(SSD etc.) volume configured on it? Are you using Portworx for this?

> "can you elaborate on the libs available to 'migrate your data around'? ... Are you using Portworx for this?" The tool I had in mind was 'REX-Ray'[ https://mesosphere.github.io/marathon/docs/external-volumes.... ]. That said, we're not actually doing the 'chasing db' config. Instead we run a HA Neo4j DB deployment as a Marathon service pegged to a handful of nodes each with local persistent volumes allocated to Neo…

Michael from Portworx here. Thanks for the shout out. Just for some context, we just announced a partnership with Mesosphere today to help accelerate adoption of DCOS for stateful services [0] in fact. We handle the automation of all the state management mentioned above, not just volume provisioning. Our customers include big companies like GE and Dreamworks but also a lot of smaller companies. You can use PX-Dev[1] for free up to 3 nodes. Would love feedback.

[0] http://m.marketwired.com/press-release/mesosphere-partners-w...

[1] https://docs.portworx.com

Re: Run Kubernetes on top of DC/OS

#29

Post by estill01 »

ferrantim wrote: post #28
estill01 wrote: post #26

Earlier quoted context omitted.

> "can you elaborate on the libs available to 'migrate your data around'? ... Are you using Portworx for this?" The tool I had in mind was 'REX-Ray'[ https://mesosphere.github.io/marathon/docs/external-volumes.... ]. That said, we're not actually doing the 'chasing db' config. Instead we run a HA Neo4j DB deployment as a Marathon service pegged to a handful of nodes each with local persistent volumes allocated to Neo…

Michael from Portworx here. Thanks for the shout out. Just for some context, we just announced a partnership with Mesosphere today to help accelerate adoption of DCOS for stateful services [0] in fact. We handle the automation of all the state management mentioned above, not just volume provisioning. Our customers include big companies like GE and Dreamworks but also a lot of smaller companies. You can use PX-Dev[1]…

Cool -- We're a small operation atm so will take a look at that dev tier. For more context, we also do some block storage off-cluster in GCE.
Post reply on HN