Live data from Hacker News

Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

news.ycombinator.com

11–20 of 41 posts

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#13

How do you hook up data to an environment? And what data sources do you support (Snowflake/etc?)

We have a way to connect data to an environment through workspaces. The docs are here: https://docs.release.com/reference-documentation/application...

Right now we support s3 and pulling in full github repos. Snowflake is on our roadmap and has been requested by some of our customers already.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#14

Why do you have such generic name? It will make searching so much harder.

It's funny you ask this because this question has come up a bunch of times. It just maps to our mission and we decided we really wanted to be true to it. Our mission is to help people/companies release their ideas to the world quickly. So it just fit and we decided it was worth the tradeoff for it to be a little harder to search for. In the end if we're successful it will be because we built something people want (i.e. apple.com) vs the name we chose.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#15
This looks awesome, getting started with AI development is daunting and I really like how this focuses on integrating with a bunch of open source frameworks and then deploying them into your own cloud (I always prefer to run the infrastructure, it feels weird to rely on something that's a complete black box).

The sandbox environment with free GPU hours is a cool way to try things out without a big commitment too. It's nice seeing a product that genuinely seems to address the practical challenges of AI deployment. Looking forward to seeing how the platform develops!

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#17

Seems pretty vague. Something to do with half self-hosting open source LLMs with a proprietary docker-like template thing. Am I on the right track?

Not sure I would describe it that way exactly, :). The templates are to get your started. Release itself takes docker compose, docker files, helm, terraform, etc and gives you a way to organize them and a workflow engine to deploy, update and remove every part of the environment. All of the functionality works with the AI templates.

The templates are a good place to start and with our concept of workspaces, you an easily attach data sources and do development with common ai tools and frameworks.

A lot of our customers and others we have talked to don't even know where to start with AI, including RAG. Our templates, infra management and workflow engine make it easy to spin up multiple environments, with varying configs for testing all the way to production.

While a lot of companies are getting into the RAG framework or Fine Tuning framework business, by releasing open source project, it is still very difficult to tie it all together.

Both nvidia and Docker have lamented about this issue to us and this is our attempt to make some of these frameworks easier to use.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#18

This looks awesome, getting started with AI development is daunting and I really like how this focuses on integrating with a bunch of open source frameworks and then deploying them into your own cloud (I always prefer to run the infrastructure, it feels weird to rely on something that's a complete black box). The sandbox environment with free GPU hours is a cool way to try things out without a big commitment too. It'…

Thanks! Hopefully, the sandbox allows people to try out some things and see how Release works. Release become most powerful when you are deploying into your own infra and mixing and matching your web apps and AI apps.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#19
This is very cool! I love seeing tooling targeting inference. I feel like stable diffusion and LLAMA have to be the primary use cases for these types of services. DALL-E is super lacking and GPT does actually start to get pretty expensive once you are using it in production.

Re: Launch HN: Release (YC W20) – Orchestrate AI Infrastructure and Applications

#20
This looks cool, but I'm a little confused about the pricing model. It sounds like I'm paying you for every hour my jobs are running on my own infrastructure if I'm reading it right. That seems like a really odd way to price things if true.
Post reply on HN