Man I can't way to pay for a ML dev service that handles the infrastructure dev service that I pay for to host my ML dev services.
We're actually building infrastructure to serve ML as a Saas and would love to get your input.
Cortex – An ML model deployment platform that runs in your AWS account
21–25 of 25 posts
Re: Cortex – An ML model deployment platform that runs in your AWS account
#22Earlier quoted context omitted.
The Terraform provider idea is interesting, I'll think about it more carefully. Almost all of our deployment configuration under the hood is done with Kubernetes (which is focused on the declaration of deployment state). We modeled our configuration after Kubernetes for that reason, and we want to go beyond low-level infrastructure configuration by allowing users to configure prediction tracking, model retraining thr…
Terraform has first class support for K8s - https://www.terraform.io/docs/providers/kubernetes/index.htm... In fact, i would say that's what Terraform was built around, so there's nothing more maintained than the k8s provider. In addition, it has EKS ( https://www.terraform.io/docs/providers/aws/r/eks_cluster.ht... ) as well as GKE providers ( https://www.terraform.io/docs/providers/google/r/container_c... ) in case…
Terraform slightly predates Kubernetes, May 21 vs. June 6, 2014. They were developed independently.
Links at: https://landscape.cncf.io/category=automation-configuration,...
Re: Cortex – An ML model deployment platform that runs in your AWS account
#23You should be using Terraform as your configuration management language. Please do not invent your own. Pretty much your yaml is a pseudo-configuration management language. That will become one of the biggest blockers because of the amount of automation that already exists. By leveraging Terraform, you will also have the added benefit of getting all the other pieces of AWS/GCP/azure components for free - and is rock…
You should be using an existing scripting language as your configuration language. Seriously, Every single fucking stupid infrastructure-deployment-tool/"platform" whatever has it's own, dumb in-house language that winds up basically re-implementing the programming language the tool is written in badly . - Puppet: Has a stupid ad-hoc config language. - Terraform: Has a stupid ad-hoc config language. - SaltStack: Has…
Re: Cortex – An ML model deployment platform that runs in your AWS account
#24You should be using Terraform as your configuration management language. Please do not invent your own. Pretty much your yaml is a pseudo-configuration management language. That will become one of the biggest blockers because of the amount of automation that already exists. By leveraging Terraform, you will also have the added benefit of getting all the other pieces of AWS/GCP/azure components for free - and is rock…
You should be using an existing scripting language as your configuration language. Seriously, Every single fucking stupid infrastructure-deployment-tool/"platform" whatever has it's own, dumb in-house language that winds up basically re-implementing the programming language the tool is written in badly . - Puppet: Has a stupid ad-hoc config language. - Terraform: Has a stupid ad-hoc config language. - SaltStack: Has…
Yes!! Glad someone said this. Most of these languages, Terraform "HCL" specifically, are awful for anyone familiar with a real language.