Viewing profile — rsaha7

Thanks for the feedback! Glad you got the default setting working quickly! Right now, we are focussed mostly on offering support for open-source models but we can definitely extend…

Thanks for the feedback! The goal is to extend the training optimization techniques to beyond LoRA / QLoRA :) Happy to have you join our team!

Thanks for the feedback! 1. The largest model that we have tested is Llama2 13B. For the first phase, we focussed on fine-tuning LLMs in the 1B-13B range. For our next phase, we wi…

Thanks for the feedback! The goal is to offer new techniques via our toolkit as soon as they become available on HuggingFace. To that end, we are aiming to move fast and bring thos…

Thanks for the feedback! Yes, it is similar to ludwig but we do think that our toolkit is a more lightweight solution to fine-tuning and ablation studies. In most cases, finding th…

You can fine-tune on your own dataset! As long as your dataset is in one of json, csv or huggingface formats, our toolkit can ingest your data!

The toolkit does not support UI at this time. We focussed on simplifying the experimentation experience that a data scientist / engineer typically go through. For instance, if you …

The toolkit supports open-source LLMs that are available on HuggingFace. So, that would include Llama2, Falcon, Mistral and the likes.

Also worth noting that the toolkit comes with 3 settings: 1. Basic - set up your first simple fine-tuning experiment 2. Intermediate - Create custom config files for specialized fi…

Great question. Right now, the roadmap includes extending the training optimizer sections to include techniques beyond LoRA. Furthermore, the testing suite will be extended to add …

Hello all! Very happy to share this toolkit that allows you to fine-tune your choice of open-source LLMs on your data! The toolkit also allows you to run ablation studies across LL…

Hi HN community, I wrote this short blog post on ways to leverage the LLM Falcon 7B. In this blog post I cover: - zero shot prompting - few shot prompting - Finetuning with QLoRA I…

I have received a lot of great feedback. We are moving fast to add instructions of how to load your custom dataset, and how to choose prompts to give researchers a finer-level of c…

Thanks a ton! And that’s a great question! Before starting this project, I realised that while there are a ton of resources that talk about using these models for chat inference an…

This is a very common use-case, and other users have mentioned this as well. We have taken this feedback, and will move fast to add instructions on how to leverage these models on …

I don’t think you fully understand the scope of this project. Your thinking and arguments are limited by your understanding of what all is possible with these models. This reposito…

Great feedback! We are working on adding instructions on loading custom datasets for your own needs. What the format of the prompt should be, etc. Next release will have these feat…

Looked at the project. Great initiative.

Feedback taken. We are working on making it more explicit for users to mention the task and dataset they want to train models on. Additionally, we will introduce a flag to let peop…

Great observation. We are working on making this part very explicit. The goal was to let researchers get up to speed with the codebase to begin with, and then they would understand…

You are right in that the loading is right now on huggingface’s dataset. The feedback about it being opaque has merit, and we are working on giving users more control and visibilit…

Hi HN community, I have been working on benchmarking publicly available LLMs these past couple of weeks. More precisely, I am interested on the finetuning piece since a lot of busi…