Viewing profile — ftufek

https://huggingface.co/models is usually good place to look, you can sort by trending and filter by the task you care about (ex: Image-Text-to-Text). The first page will usually ha…

Yeah, some people say they got replacements through the warranty. The problem is, this thing is really big and heavy, so boxing it up is a real pain, especially if you've had it a …

Unfortunately those "solutions" don't work, the person who had a potential solution was able to at least go through the inputs, this is not the case here, you can't even go through…

Their consumer cards are the entry point for many researchers and students though, so it pays off eventually when they become engineers working with the expensive enterprise cards.…

It's not just the home insurance either. Last week, I bought a car and 3 of the big insurance companies refused to insure it without a 15 days waiting/underwriting period (Geico wh…

You'll need something like EPYC/Xeon CPUs and motherboards which not only have many more PCIe lanes, but also allow bifurcation. Once you have that, you can get bifurcated risers a…

Yeah, it's really just trying to get as much compute as possible as cheaply as possible interconnected in a reasonably fast way with low latency. Slow networking would be a bottlen…

I meant each card is limited to 240w, instead of the usual 450w. Also, it's more like 4 circuits after all, because the main cpu/mb/2gpus are on a 15a too.

Never got around to writing some public docs. It's essentially bunch of GPUs on custom aluminum extrusion frames sitting in a server rack, connected to romed8-2t motherboard throug…

Really depends on the model and the software tricks you're using. With DDP and gradient accumulation, you can reduce the bandwidth bottleneck by quite a bit. We've trained with 409…

Local workstation is much cheaper in the long run. Even ignoring that, most of the development is running experiments. You're gonna be hesitant to run lots of experiments if they e…

I've been seeing a bunch of them in Bay Area, I thought it was already launched and started deliveries. In person, it looks like something out of a movie set.

The release event is in like ~30 minutes on their discord, probably the announcement went out a bit early.

1. You can pair normal atx PSUs for the motherboard/CPU and server PSUs for the GPUs using breakout boards. 2. You can power limit GPUs down to 250W and barely lose any performance…

My guess is this isn't their competitive edge, network effects, products, data and distribution is. In a way, it takes away their competitors edge while racing to the bottom to com…

I think less effort has gone into image editing compared to image generation so far. That said, we're building some photo realistic image editing tools at https://www.faceshape.com…

I wrote it from the perspective of a small startup ( But yes I agree, it will be very competitive with much smaller margins.

I've tried it, sure it's good, but not even close to the real thing. But yes it's getting cheaper through better hardware, better data and better architectures. Also it builds on F…

It's easier for large rich companies with infrastructure and datasets. It's very hard for small startups to build useful real world models from scratch, so you see most people buil…

Yeah I agree it's too slow for autocompletion at the moment, but this would be for full feature implementations, not just autocomplete. For example, if I have a repo I want to add …

This is awesome, can't wait to get api access to the 32k token model. Rather than this approach of just converting the whole repo to a text file, what I'm thinking is, you can let …