Live data from Hacker News

AI Dungeon 2 costing over $10k/day to run on GCS/Colab

twitter.com

151–160 of 215 posts

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#151

Still not clear why a university research lab would keep this running 'for a few more days' and not pull the plug immediately until either having the costs under control or some sort of reasonal matching benefit in place.

Because it’s probably government funded. If it’s not burning a hole in your own pocket it’s not worth staying up all night over.

BYU is not federally funded.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#153
post #100

I am, personally, amazed by this. The following might be kinda NSFW, though. > You are Jesus, a knight living in the kingdom of Larion. You have a steel longsword and a wooden shield. You are on a quest to defeat the evil dragon of Larion. You've heard he lives up at the north of the kingdom. You set on the path to defeat him and walk into a dark forest. As you enter the forest you see a huge black dragon flying abov…

> suck his d-ck

Thank you for shading my eye from this indignity.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#154
Could someone explain the appeal in keeping this going long-term? When it was posted here, I played it and read several adventure logs here and on reddit. In every case the story is nonsense. Sure some parts read like something a human would write, but anytime you go beyond a few sentences you can see contractions and lack of flow that good human author would never make.

Don't get me wrong, it's a cool demo of how far we have gone beyond Markov chains. Am I missing something or just spoiled from those Infocom games I played as a kid?

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#155
Someone, probably: People who don't know how their services work are doomed to spend lots of money on them.

From the GCS pricing page:

  Network egress within Google Cloud applies when you move or copy data from one bucket in Cloud Storage to another or when another Google Cloud service accesses data in your bucket.

  Within the same location (for example, US-EAST1 to US-EAST1 or EU to EU) -- Free
From the original tweet (not the linked reply):

  For reference most of the fees are from transferring from NA to EU and ACAP
It's costing them assloads of money because they're moving data between regions. AWS works the same way. Azure is probably also the same but their pricing page is incomprehensible so who knows.

Lesson: if you're going to use data in a given location, you need to host data in the same location.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#156

Speaking as someone who runs a bunch of large websites - out of my own pocket, for profit.... I'm confused. How did we get from 60K users to 10K per day expense? For comparison, I serviced millions of users per month for years from a single virtual server... (granted, that was after making our site super lean for a data & CPU perspective) How much resources is each user consuming?

I guess you don't instantiate a 5Gb image / user. It's the data transfer that costs 30/40c / user.

Cloudflare ? or just one machine at OVH ?

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#157
You are Faif, a ranger living in the kingdom of Larion. You have a hunting bow and a quiver of arrows. You spot the deer and are ready to finish your hunt when suddenly you hear a voice calling out to you from behind a tree.

> nosaving

Saving turned off.

> shoot the deer

You quickly turn around and see a young man with a long beard standing there. He is dressed in rags and his face is covered by a large bandage. His eyes are red and puffy and he has a large scar across his cheek

> shoot the man

You fire an arrow at him and it hits him square in the chest. The arrow flies through the air and slams into the ground. You look up and see that the man is lying on the ground motionless. You can't believe what just happened

> Check his pockets

You pick up the arrow and examine it. It's made of bone and is very sharp. You wonder if you should take it. You could use this to kill someone else.

Doesn't seem to understand me too well?

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#158

Someone, probably: People who don't know how their services work are doomed to spend lots of money on them. From the GCS pricing page: Network egress within Google Cloud applies when you move or copy data from one bucket in Cloud Storage to another or when another Google Cloud service accesses data in your bucket. Within the same location (for example, US-EAST1 to US-EAST1 or EU to EU) -- Free From the original tweet…

[deleted]

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#159
post #156

Earlier quoted context omitted.

I guess you don't instantiate a 5Gb image / user. It's the data transfer that costs 30/40c / user.

Cloudflare ? or just one machine at OVH ?

https://wasabi.com/cloud-storage-pricing/

Wasabi’s pricing model of $.0059 per GB/mo ($5.99 per TB/month) with no additional charges for egress or API requests means you don’t pay to access your data

I don't know, could be a couple of dollars only ?

Post reply on HN