61–70 of 164 posts
Earlier quoted context omitted.
Yes, the volume discounts and economies of scale they can get (while you can't) are insane.
One of the simplest is that data center energy pricing is just simply different from residential energy, because they often get wholesale (plus small markup) rather than residential rates.
In the summer, I have to pay to run an AC to get it out of the envelope.
The price of a brand new Dell precision PC with a core i9 13900 CPU (24 cores), 64 GB RAM and 2X2TB NVMe is probably around 2.5k$. It costs tens of Euros per month in electricity to run this PC. The hardware is good to go for some 3 years, before running into various issues (newer CPUs becoming much more power efficient, firmware updates getting less and less frequent etc). Consider also the cost of components failur…
This is what you expect prices to be when a vendor is buying in bulk.
Cloud vendors should be like "Costco" (buy servers in bulk and can pass along those savings & this is what Hetzner does)
The trick AWS (and other cloud vendors have done), is charge "Uber Eats" pricing for Costco items.
Earlier quoted context omitted.
Wouldn't the GeForce license then say "no block chain" and a different NVIDIA brand (BlockForce?) would allow it, letting NVDA charge more for large scale mining? Otherwise it looks like gamers and miners are paying the same prices.
They do. But since most miners would just ignore the license, they implemented LHR (low hashrate) beginning on GeForce 3000-series that detects the types of ops used for mining and artificially slows the GPU to about 25% of its actual speed.
20GB RAM, can fit 13B param models, and maybe some quantized larger models.
Earlier quoted context omitted.
From https://www.yourdictionary.com/articles/contractions-correct... - Contractions can be used in any position in a sentence; however, homophone contractions such as "it's" and "they're" sound better when followed by another word or phrase. The reason is that the sounds of "its" and "it's" and "they're" and "their" are so similar that they can be confusing unless they are used with the context of an additional word.
To be fair, the contracted version doesn't read nearly as nicely. Q. Is it good for training? A. It's with ample RAM and the latest Intel CPU. vs Q. Is it good for training? A. It is with ample RAM and the latest Intel CPU.
"It is with great pleasure..."
Earlier quoted context omitted.
Have been in deep contact with data centre and rental server offerings in the past, there is a crazy large amount of fraud going on, e.g. 2 hours for free means 2 hours free resource to DDOS.
I don't want it free. I want to put $2 on the account. Try the server and decide after using the server.
Earlier quoted context omitted.
Doesn’t this imply that it’s better to rent than to buy? TANSTAAFL 1. Physical hardware is a useful abstraction. 2. At the end of a three year cycle, you can sell something you own. (This has associated costs of course). 3. Rents can go up. Terms and Conditions can change. Credit cards can expire or be cancelled. In other words, renting introduces a significant dependency. 4. You are your own most important customer.…
>2. At the end of a three year cycle, you can sell something you own. (This has associated costs of course). This is huge and often overlooked or undervalued. Renting means you have nothing when the contract ends, buying means you have something for your money spent.
Earlier quoted context omitted.
Nvidia RTX 4000 SFF Ada From the OP link, the GPU-Server GEX44 server line includes RTX 4000. And the server only cost €184/month.
I meant if they have other GPUs normally available in the server auction. As far as I understand the servers in the server auction are mostly custom built ones for customers and once they stop renting them they land on the server auction for others to rent. The one with the RTX 4000 seems to be a standardized line of products.
The old GPUs would have very litle memory by the way. Not ideal for AI.
I mean what explains this? It's a billion dollar corporation and I am having serious reservations about whether I would even enter my credit card info on this site.
I've just ordered one to ditz around with. We're early in the process of deploying our own internal server for Mixtral work, but it'll be interesting to see how this performs (in raw terms, almost certainly worse, since we can roll out a 4090 without getting into trouble – but Hetzner has a better connection and handles the maintenance, so..) Order has been accepted but not deployed yet. I'll update when I have some…