Viewing profile — aliasaria

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestl…

https://transformerlab.ai/docs/resources/Uninstall%20Transfo...

Transformer Lab maintainer here. We'd love to build this! Please contact us on our our Discord https://discord.gg/transformerlab or Twitter https://x.com/transformerlab and we'd lo…

Thanks for finding this! Will get this merged as soon as we can test across platforms.

One of the maintainers here. Yes this is a big part of our plans. In addition to our plugin system which allows arbitrary Python scripts, we will soon publish how to add decorators…

Yes it all works as webapp, in addition to working as an electron app. we haven’t gotten to publishing how in the docs as this feature is brand new. Short story, run: “npm run star…

Apple MLX is a game changer for what is possible in Local LLM development for everyone. Getting this to work as a single application that "just works" across platforms has been one…

We want this tool to be for everyone that wants to train and tune their own LLMs. Our vision is that the sphere of people who do these types of tasks will grow as LLMs become more …

If you know any we should incorporate, let us know! We really want to bring the best of open source LLM tools together in one UI.

The functionality in Transformer Lab comes from plugins. Plugins are just Python scripts behind the scenes. So anything that can be done in Python can be done as a plugin. Right no…

Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been t…

From my digging... Apple seems to get most of their recycled titanium from IperionX: https://www.linkedin.com/posts/iperionx_over-20-years-ago-ap... IperionX announced they get the…

I’m curious: what was the podcast?

Some of the tools offer a path to doing tool use (fetching URLs and doing things with them) or RAG (searching your documents). I think Oobabooga https://github.com/oobabooga/text-g…

You can chat with the models directly in the same way you can chat with GPT 3.5. Many of the opensource tools that run these models let you also edit the system prompt, which lets …

If you're able to purchase a separate GPU, the most popular option is to get an NVIDIA RTX3090 or RTX4090. Apple Mac M2 or M3's are becoming a viable option because of MLX https://…

If you are looking for a downloadable app as an alternative to Oobabooga / Sillytavern, we built https://github.com/transformerlab/transformerlab-app as a way to easily download, i…

Transformer Lab is an open source tool that lets you interact, train, and evaluate LLMs on your own machine or in the cloud (currently Mac or Linux, Windows soon) through a simple …

There is some good information on how PCI-Express works here: https://blog.ovhcloud.com/how-pci-express-works-and-why-you-...