Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Dungeon 2 costing over $10k/day to run on GCS/Colab

twitter.com

Post reply on HN
Print view View original

1–10 of 215 posts

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#2

Post by baroffoos »

Insane but also expected. When I tried it out when it was posted here and saw it took multiple minutes to warm up I knew it was probably expensive.

>And it's currently costing 30-40 cents per download.

Is there no way to have a single hosted instance rather than downloading again for each user?

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#3

Post by [deleted] »

baroffoos wrote: post #2

Insane but also expected. When I tried it out when it was posted here and saw it took multiple minutes to warm up I knew it was probably expensive. >And it's currently costing 30-40 cents per download. Is there no way to have a single hosted instance rather than downloading again for each user?

[deleted]

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#5

Post by blotter_paper »

baroffoos wrote: post #2

Insane but also expected. When I tried it out when it was posted here and saw it took multiple minutes to warm up I knew it was probably expensive. >And it's currently costing 30-40 cents per download. Is there no way to have a single hosted instance rather than downloading again for each user?

> Is there no way to have a single hosted instance rather than downloading again for each user?

This might make the problem worse; then they'd have to do processing server side, rather than offloading it on the client. I dunno whether this would be more or less expensive than the initial download, but the torrent they put up seems cheaper either way.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#6

Post by nickwalton00 »

55555 wrote: post #4

Well that was obviously forseeable and dumb then. Use the user's resources or charge money.

The unexpected thing was that Google colab and GCS are separate such that transfer costs between them often end up as international external egress fees

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#7

Post by klingonopera »

Wait, wait, this is a university developing something, that needs to be downloaded, they choose a commercial solution for that, and that costs them $10k per day? They don't have their own file-hosting solutions? At a university with an AI dept?

With that money ("for a couple of days"), you could buy your own server and do it yourself, for a fraction of the price. And don't tell me you can't find people who'd be capable of doing that, if you've got AI development going on.

What am I missing?

Post reply on HN