How can I run some inference with this model locally? Do I have to make a huggingface account?
if you can't figure it out send me an email and I can help you figure it out
MosaicML MPT-7B: A Commercially-Usable LLaMa-Quality Model
11–12 of 12 posts
Re: MosaicML MPT-7B: A Commercially-Usable LLaMa-Quality Model
#12How can I run some inference with this model locally? Do I have to make a huggingface account?
I'm not sure, but maybe GPT4All will eventually add support for it: https://gpt4all.io/