Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

github.com

Post reply on HN
Print view View original

1–10 of 22 posts

Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

#1

Post by aliasaria »

Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.

Show HN: Open-Source Alternative to OpenAI Platform, for Local Models
github.com

Re: Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

#6

Post by aliasaria »

abhimazu1006 wrote: post #4

I tried the tool, works flawlessly on mac. Finetuning was quick, do you support model conversion as well ? To TensorRT ?

The functionality in Transformer Lab comes from plugins. Plugins are just Python scripts behind the scenes. So anything that can be done in Python can be done as a plugin.

Right now we have export plugins for going to GGUF, MLX and LlamaFile but if you know a good library for exporting to TensorRT, let's make a plugin for this! (Feel free to join our Discord if you want help)

Re: Show HN: Open-Source Alternative to OpenAI Platform, for Local Models

#7

Post by dadmobile »

anonymous_llama wrote: post #2

This looks pretty cool! Does it support the new Deepseek model as well?

Yes! The easiest way to run this locally is to use one of the distilled models (you download one from the Model Zoo or enter any huggingface ID at the bottom of the page). If you are on a mac, the MLX versions work great, and of course GGUF if you want a quantized model or don't have a GPU.
Post reply on HN