Update: the issue has been fixed, apparently:
"Should note for anyone who comes and sees this that's no longer how were hosting the model. :) Model is now hosted on a peer to peer torrent network so no more costs for us."
AI Dungeon 2 costing over $10k/day to run on GCS/Colab
181–190 of 215 posts
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#182Why would a user need a 12gb gpu to run the game locally? The deep learning model is already trained, and I can’t imagine one needs a gpu to just evaluate the model.
You can use your CPU, certainly. It'll take a couple seconds per reply.
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#183Someone, probably: People who don't know how their services work are doomed to spend lots of money on them. From the GCS pricing page: Network egress within Google Cloud applies when you move or copy data from one bucket in Cloud Storage to another or when another Google Cloud service accesses data in your bucket. Within the same location (for example, US-EAST1 to US-EAST1 or EU to EU) -- Free From the original tweet…
[deleted]
So be more constructive, I'd like to learn more about IBM Cloud as I have no experience with it. Is there a Lambda-like service, pay-by-use 'serverless' database hosting, and support for direct client-to-DB connections with RLS/ACLs?
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#184Someone, probably: People who don't know how their services work are doomed to spend lots of money on them. From the GCS pricing page: Network egress within Google Cloud applies when you move or copy data from one bucket in Cloud Storage to another or when another Google Cloud service accesses data in your bucket. Within the same location (for example, US-EAST1 to US-EAST1 or EU to EU) -- Free From the original tweet…
[deleted]
I checked a while ago and IBM Cloud costed the same price down to the dollar.
IBM bills by the network interface, hundreds of dollars per months to get a dual bonded NIC for private and public transfer. If you use the bandwidth close to capacity all day long for he whole month, it ends up the same cost as you would pay on Amazon for transferring that amount of GB.
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#185Someone, probably: People who don't know how their services work are doomed to spend lots of money on them. From the GCS pricing page: Network egress within Google Cloud applies when you move or copy data from one bucket in Cloud Storage to another or when another Google Cloud service accesses data in your bucket. Within the same location (for example, US-EAST1 to US-EAST1 or EU to EU) -- Free From the original tweet…
The gcs bucket just needs to be set to region? See documentation:-
Data egress from your bucket to a non-Cloud Storage Google Cloud service is free in the following cases:
Your bucket is located in a region, the Google Cloud service is located in a multi-region, and both locations are on the same continent. For example, accessing data in a US-EAST1 bucket with a US App Engine instance. Your bucket is located in a multi-region, the Google Cloud service is located in a region, and both locations are on the same continent. For example, accessing data in an EU bucket with an EU-WEST1 GKE instance.
EDIT 2:
the cloud ai documentation suggests the correct setting is regional/regional
https://cloud.google.com/ml-engine/docs/regions
Cloud Storage You should run your AI Platform job in the same region as the Cloud Storage bucket that you're using to read and write data for the job.
You should use the Standard Storage class for any Cloud Storage buckets that you're using to read and write data for your AI Platform job.
EDIT 3:
----------- I don't think you can set a region for colab, so I am not sure you can make egress free. ----------
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#186After having read Rizwan Virk's "The Simulation Hypothesis", and playing this amazing new game, I can say that AI-generated text adventure games are an important step on the road to the Simulation Point (the point at which it would be technologically possible for us to construct a simulation that is all-encompassing as the one in The Matrix).
Have you tried psychadelics yet? Or maybe learned how to lucid dream? I think such technologies will be preferable to you, even if our electronics can catch up with our biological evolution. Sure, maybe dream machines are fun and cool, but the ones in our future will be made for profit by companies like Facebook and Alphabet which severely diminishes any potential they may have had. Real dreams are libre, gratis, and…
I've never tried any psychedelic. But I am able to lucid dream sometimes, I just never got deep into it. I guess I should read more about it.
I agree with your second statement, this so-called dream machine sounds a lot like a future iteration of Facebook's Oculus Rift.
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#187Earlier quoted context omitted.
Colab is effectively JupyterLab/JupyterHub with Google's own add-ins (like integration with Google Drive). JupyterHub is a huge PITA to manage, and Colab also offers a degree of free compute and limited access to a dated, but still free K80 GPU. From the tweet thread, it seems like there was some misunderstanding over where the files are being stored and being executed. This is a pretty common issue with Google Drive…
Google Colab now comes with free T4 GPUs.
Occasionally. You randomly get a K80 or T4. It's annoying.
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#188Could someone explain the appeal in keeping this going long-term? When it was posted here, I played it and read several adventure logs here and on reddit. In every case the story is nonsense. Sure some parts read like something a human would write, but anytime you go beyond a few sentences you can see contractions and lack of flow that good human author would never make. Don't get me wrong, it's a cool demo of how fa…
Man, why so cynical? I don't see how those Infocom games spoiled you since they were limited to whatever a team of writers could come up with. And a well-written, dynamical-feeling CRPG is so rare that we still trumpet the handful that were any good from 20 years ago like Planescape: Torment. Here's an example of how this game is fun: https://twitter.com/ptychomancer/status/1203246078989987840 It's just fun to play w…
I only dug into this because people were raving about it. Never played D&D, but it did remind me of those text adventure games I played as a kid.
When humans play D&D as the game progresses, are the rules of the world that people establish supposed to be internally consistent and is there a planned plot arc? Can you say there's no gravity and then later drop your sword?
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#189Someone, probably: People who don't know how their services work are doomed to spend lots of money on them. From the GCS pricing page: Network egress within Google Cloud applies when you move or copy data from one bucket in Cloud Storage to another or when another Google Cloud service accesses data in your bucket. Within the same location (for example, US-EAST1 to US-EAST1 or EU to EU) -- Free From the original tweet…
EU-USA data costs a lot for a good reason.
Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab
#190Cloud bandwidth costs are a rip off. For this particular situation though, make sure to replicate your files across multiple buckets, one in each GCP zone, otherwise you incur the cross zone transfer costs. We do something similar to serve julia downloads, because it turns out that most downloads are from people running on the cloud (so we basically replicate our binaries to every cloud provider and then to every reg…
OVH, BuyVM, Scaleway, etc provide cheap bandwith: serverhunter.com
Disclaimer: serverhunter.com sponsored my game