Question behind the question. I'm building a startup which offers "AI Compute Box", essentially Hardware loaded with a fine-tuned LLM model which will be deployed to enterprises.
I am looking to understand whether (a) enterprises install models on their own rack, (b) deploy on AWS/Azure cloud, (c) use private instances offered by offered by AWS or Azure
Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?
1–3 of 3 posts
Re: Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?
#2Due to privacy issues, I would as a company only ever use a finetuned LLM.
Re: Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?
#3Due to privacy issues, I would as a company only ever use a finetuned LLM.
thanks for your response. would this be an open source fine-tuned?