I'm currently hosting on AWS, but it's proving to be quite expensive, especially during the development phase. I'm actively exploring more cost-effective options as I'm concerned about the potential server costs once the project moves into production.
Ask HN: Where do you host your Llama 2 model?
1–3 of 3 posts
Re: Ask HN: Where do you host your Llama 2 model?
#2Hugging face maybe.
Re: Ask HN: Where do you host your Llama 2 model?
#3Hugging face maybe.
I am using hugginface. But it is not even suitable for staging.