Viewing profile — sahil_chaudhary

Dropping the batch size

Yeah the license issue is the only reason why I didn't release the weights yet.

I'm training a 65B model right now, also I believe you can use lora-alpaca to train on this data on a much smaller machine.

Given how many people are asking for the weights, I'm working to make them available now. So you'll be able to run them locally as well.

Yeah the weights did change.

All included it costs under 70$ for the 13B model. Training 65B now so will report what that will cost.

Interesting, in my experiments alpaca-lora performed worse but definitely possible that isn't the case generally.

That was an issue on my end, should be fine now

You can find my email on my HN profile