Live data from Hacker News

Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

github.com

11–20 of 22 posts

Re: Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

#14

Who is this for? I get it for hobbyists, but do you imagine it being used for...startups that...what, self-host AI? Where's support for the rest of OpenAI functionality? Where's assistants?

We want this tool to be for everyone that wants to train and tune their own LLMs.

Our vision is that the sphere of people who do these types of tasks will grow as LLMs become more accessible and the tooling becomes more reliable.

Let us know what other types of functionality you'd like to see. I will record Assistant-type functionality for our team to look into!

Re: Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

#15
post #11

Runs great on Apple Silicon. Impressed with one-click downloads and its flexible fine-tuning suite.

Apple MLX is a game changer for what is possible in Local LLM development for everyone. Getting this to work as a single application that "just works" across platforms has been one of the hardest engineering problems we've ever worked on, but we're determined to get it right.

Re: Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

#19
I tried this out last night, and the UI is so intuitive! Have tested a few other tools in the space, and this by far, was the most user-friendly and made with developers in mind :)

Excited for more features to support enterprise functionality and deployment, but overall impressed with what the team has built so far. Well done!

Post reply on HN