If you are comfortable with purchasing used hardware, used 3090 are great value, they can be had for roughly a third of the price of a new 4090. How many GPUs you need is completely dependent on the size of your team, their frequency of usage, and the size of the models you are comfortable with. I generally recommend you rent instances on something like runpod to build out a good estimate of your actual usage before…
thanks for your recs. I had tried runpod and want to start building a setup