Live data from Hacker News

We were wrong about GPUs

fly.io

31–40 of 604 posts

Re: We were wrong about GPUs

#31
post #14
post #11

I noticed quite a few spelling and grammar mistakes - could do with a bit of an edit pass?

In the current days of AI I think spelling and grammar mistakes is perhaps a great way to tell it is still written by human...... ( Until AI copy this )

I'm sure AI is already capable of linking anonymous forum handles by writing style. Best to reinvent ourselves every month like one would with monthly password resets

Re: We were wrong about GPUs

#32
Gpus don't fit the usual "start with free tier then upgrade when monetizing" approach most devs have with these kinds of platforms.

For simple inference, its too expensive for a project that makes no money. Which is most projects.

Re: We were wrong about GPUs

#35
post #22

Not sure about this: > like with our portfolio of IPv4 addresses, I’m even more comfortable making bets backed by tradable assets with durable value. Is that referencing the gpus, the hardware? If yes, why should they have a durable value? Historically hardware like that deprecated fast and reaches a value of 0, energy efficiency alone kills e.g. old server hardware. Something different here?

Historically GPUs didn't cost 30,000 a pop. Also, the end of Moore's law etc.,.

Re: We were wrong about GPUs

#36
post #33
post #2

We wrote all sorts of stuff this week and this is what gets to the front page. :P

You just wrote a blog post about whats needed for a top HN post. You should have known it would do well :) https://fly.io/blog/a-blog-if-kept/

I'm a little sore the FOIA thing didn't make it up here, but Kurt's post did. ;)

Re: We were wrong about GPUs

#38
post #2

We wrote all sorts of stuff this week and this is what gets to the front page. :P

FWIW, I'd consider this good publicity. I have no use for GPUs in the cloud (at least not at the prices that they're available at (in general, not just on fly)). So if fly is moving there effort towards things I actually need (like managed databases) then that's going to increase my confidence in them as a platform quite a bit.

Re: We were wrong about GPUs

#39
post #37

Has service reliability improved at all? I tried Fly at two different points in time and I’ve never had a worse experience with a service.

You didn’t say at which points in time so it’s kind of hard to say yes but I will say “yes, reliability has improved”.

Re: We were wrong about GPUs

#40
Hah. We're doing AI, but we're doing vision-based stuff and not LLMs. For us, the problem has been deploying models.

Google and AWS helpfully offered their managed LLM AI services, but they don't really have anything terribly more useful than just machines with GPUs. Which are expensive.

I'm going to check fly.io...

Post reply on HN