Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

news.ycombinator.com

Post reply on HN
Print view View original

21–30 of 41 posts

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#21

Post by tommy_mcclung »

michaelmior wrote: post #20

This looks cool, but I'm a little confused about the pricing model. It sounds like I'm paying you for every hour my jobs are running on my own infrastructure if I'm reading it right. That seems like a really odd way to price things if true.

Yeah, I hear you and the confusion. We decided on this as a management fee that only gets charged when you’re using the environment. It was the best tradeoff we could come up with but it definitely isn’t perfect. Any ideas on how we can make this clearer or better?

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#22

Post by richardw »

michaelmior wrote: post #20

This looks cool, but I'm a little confused about the pricing model. It sounds like I'm paying you for every hour my jobs are running on my own infrastructure if I'm reading it right. That seems like a really odd way to price things if true.

It's not a unique model - that's what e.g. Databricks does too. You pay for the resources, which means you can deploy them with whatever security model you require (good for enterprise, with all the firewalls and secrets and security reviews your heart desires), but you also pay for the management layer that Databricks offers. In Databricks' case you're basically doubling the infrastructure cost per hour.

Data and compute stay in your own tenant.

Edit: confirmed - look at that enterprise tier. If you want SSO & RBAC you click that button and pay $5k/month minimum. Definitely an enterprise play and the pricing model and approach to security will make sense to those customers.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#23

Post by drawnwren »

I'm pretty much exactly your target market. I run a kubernetes, docker, poetry devops hell at an ml startup and was curious how your product helped. You got about 2 minutes of my time. I scanned your website, I have no idea what you do or whether you fix my problem.

Not trying to be negative, but I think there may be a 30 second pitch to be made to people like me that isn't made on your site.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#24

Post by JoeCortopassi »

I've noticed that while a bunch of developers have played with LLM's for toy projects, few seem to have any actual experience taking it to prod in front of real users. I’ve personally had to do so for a few startups, and it's like trying to nail Jell-O to a tree. Every random thing you change, from prompts to models, yields massively different/unpredictable results.

I think because of this, a bunch of companies/tools have tried to hop in this space and promised the world, but often times people are best served by just hitting OpenAI/GPT directly, and jiggling the results until they get what they want. If you're not comfortable doing that, there are even companies that do that for you, so you can just focus on the prompt itself.

So that being said, help me understand why I should be adding this whole system/process to my workflow, versus just hitting OpenAI/Anthropic/Google directly?

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#25

Post by tommy_mcclung »

drawnwren wrote: post #23

I'm pretty much exactly your target market. I run a kubernetes, docker, poetry devops hell at an ml startup and was curious how your product helped. You got about 2 minutes of my time. I scanned your website, I have no idea what you do or whether you fix my problem. Not trying to be negative, but I think there may be a 30 second pitch to be made to people like me that isn't made on your site.

Thanks for the feedback and I agree we need to do a better job messaging the value on the site. How would this have landed for you?

We are an AI orchestration platform that makes deploying open source models and frameworks using Kubernetes and docker simple. We manage the GPU and k8s resources, provide templates to common open source frameworks and an orchestration engine for your AI workflows.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#26

Post by drawnwren »

tommy_mcclung wrote: post #25
drawnwren wrote: post #23

I'm pretty much exactly your target market. I run a kubernetes, docker, poetry devops hell at an ml startup and was curious how your product helped. You got about 2 minutes of my time. I scanned your website, I have no idea what you do or whether you fix my problem. Not trying to be negative, but I think there may be a 30 second pitch to be made to people like me that isn't made on your site.

Thanks for the feedback and I agree we need to do a better job messaging the value on the site. How would this have landed for you? We are an AI orchestration platform that makes deploying open source models and frameworks using Kubernetes and docker simple. We manage the GPU and k8s resources, provide templates to common open source frameworks and an orchestration engine for your AI workflows.

I think at the end of the day, I have a bunch of config files and commands. Showing a quick translation between the spaghetti and your solution would make the most sense. The less language I have to parse the better.

i.e. you have a set of kubernetes CRDs probably managed by a gitops solution -> we do this for you, you have a bunch of different pyproject.toml files that need to be orchestrated into a docker container -> this is what that looks like in release, tbh our terraform isn't a huge bottleneck because so much just ends up going in the kube crds.

maybe have two pitches: 1 for startups getting started and 1 for startups who already have a lot of this figured out (probably your bigger target audience if you have a strong pitch)

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#27

Post by tommy_mcclung »

drawnwren wrote: post #26
tommy_mcclung wrote: post #25

Earlier quoted context omitted.

Thanks for the feedback and I agree we need to do a better job messaging the value on the site. How would this have landed for you? We are an AI orchestration platform that makes deploying open source models and frameworks using Kubernetes and docker simple. We manage the GPU and k8s resources, provide templates to common open source frameworks and an orchestration engine for your AI workflows.

I think at the end of the day, I have a bunch of config files and commands. Showing a quick translation between the spaghetti and your solution would make the most sense. The less language I have to parse the better. i.e. you have a set of kubernetes CRDs probably managed by a gitops solution -> we do this for you, you have a bunch of different pyproject.toml files that need to be orchestrated into a docker container…

Awesome feedback, thank you!!

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#30

Post by ira23 »

JoeCortopassi wrote: post #24

I've noticed that while a bunch of developers have played with LLM's for toy projects, few seem to have any actual experience taking it to prod in front of real users. I’ve personally had to do so for a few startups, and it's like trying to nail Jell-O to a tree. Every random thing you change, from prompts to models, yields massively different/unpredictable results. I think because of this, a bunch of companies/tools…

You're right - hitting OpenAI/Anthropic/Google directly is often the quickest way to get started, and for many simple applications, it might be all you need. However, Release.ai addresses the needs of companies that require more control, customization, and scalability in their AI systems.

Release.ai isn't about replacing the big players but about giving you options. It's for when you need more than a generic API call but don't want to build an entire ML infrastructure from scratch. You can build exactly what you need without getting a Ph.D. in machine learning or becoming a DevOps expert.

Post reply on HN