I hope we will soon have an open-source project for training such small LLMs where one can just pick the architecture (like Qwen / DeepSeek / etc.), parameter count, dataset, ... and then let it run on a local/rented GPUs...
> “open-source project”
I’m with you. But what are we going to get? I think this goal sits in a funny place between knowledge and convenience.
On the one hand, tons of “products” promising this.
On the other hand, I’m sure we can find student works—sharing the code they created from a course or book. And I expect there will be gaps, niches filled by pro-coders who see a pro need and fill it.
What I don’t want to do is see the market for model training filled with whatever Microsoft thinks will make money.