Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF

argilla.io

Post reply on HN
Print view View original

1–10 of 12 posts

Re: Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF

#4

Post by dvilasuero »

sathergate wrote: post #3

how does this compare to scale or surge’s offerings?

Thanks! The main difference is that Argilla is built as an open-source component to be integrated into the wider MLOps/LLMOps stack. The focus being on continous data collection, monitoring, and fine-tuning with open-source and commercial LLMs, as opposed to outsourcing training data collection, and one-off labeling projects. In the blog post we mention this with other words:

Domain Expertise vs Outsourcing. In Argilla, the process of data labeling and curation is not a single event but an iterative component of the ML lifecycle, setting it apart from traditional data labeling platforms. Argilla integrates into the MLOps stack, using feedback loops for continuous data and model refinement. Given the current complexity of LLM feedback, organizations are increasingly leveraging their own internal knowledge and expertise instead of outsourcing training sets to data labeling services. Argilla supports this shift effectively.

I'd love to hear your thoughts on this!

Re: Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF

#5

Post by sathergate »

dvilasuero wrote: post #4
sathergate wrote: post #3

how does this compare to scale or surge’s offerings?

Thanks! The main difference is that Argilla is built as an open-source component to be integrated into the wider MLOps/LLMOps stack. The focus being on continous data collection, monitoring, and fine-tuning with open-source and commercial LLMs, as opposed to outsourcing training data collection, and one-off labeling projects. In the blog post we mention this with other words: Domain Expertise vs Outsourcing. In Argil…

OSS approach makes sense!

Re: Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF

#7

Post by dvilasuero »

anakin87 wrote: post #2

In my experience, Argilla is a good open source platform for datacentric NLP. And these features are a great addition... Have you tried it?

Thanks Anakin! we want to bring the data-centric approach to how LLMs are built and fine-tuned too.

Re: Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF

#8

Post by dvilasuero »

xrd wrote: post #6

Looks like no quantized options with llama.cpp? https://github.com/ggerganov/llama.cpp/issues/1602

We're very much looking forward to seeing Falcon-40B support on llama.cpp. For production use cases, this is also highly relevant: https://huggingface.co/blog/sagemaker-huggingface-llm
Post reply on HN