> Open-Source AI There are no open source AI models, at least not useful ones (yet [1]). Open weight is not the same as open source. "Open weight" models are still just inscrutable binary blobs that you can (theoretically) run on your own computer instead of through a SAAS web app. The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.…
I think there needs to be some nuance to this. Without the training data and open sourcing the training code and protocol you cant reproduce the model from scratch, thats true, but because the weights and structure are free to download you can modify, inspect and make derivative works off it. Calling it an inscrutable binary blob is misleading. I do agree that its not reproducible and its often talked about like it i…
Even with a team of researchers inspecting the weights and understanding what is going on internally is a tedious operation. Having the training data doesn't really solve any issues here. But what it it does do is allow for auditability and public scrutiny - which imo is pretty important if you rely on these models.