AI Dungeon 2 costing over $10k/day to run on GCS/Colab • Hacker News Board

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#101

Post by YeGoblynQueenne » Mon, Dec 09, 2019, 10:02 AM UTC

Can I be controversial and ask what justifies such expenses? Why is this game so important that it needs to be up and running so badly?

From what I've seen so far the "game" (if you can even call it that) highlights the weaknesses of GPT-2 much more than its strengths (the model's answers to user actions are random, the story is incoherent, the world is inconsistent). I don't get the feeling it was setup to demonstrate _weakness_ though. I think it was meant to demonstrate strngths.

I suppose it's just advertising for the BYU Perception, Control and Cognition Lab, but it sounds awfuly expensive for advertising for an academic group.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#102

Post by qxnqd » Mon, Dec 09, 2019, 10:08 AM UTC

YeGoblynQueenne wrote: post #101

Can I be controversial and ask what justifies such expenses? Why is this game so important that it needs to be up and running so badly? From what I've seen so far the "game" (if you can even call it that) highlights the weaknesses of GPT-2 much more than its strengths (the model's answers to user actions are random, the story is incoherent, the world is inconsistent). I don't get the feeling it was setup to demonstra…

Why justify it, when it's public money? It's free!

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#103

Post by echelon » Mon, Dec 09, 2019, 10:09 AM UTC

When will we come full circle and do "edge computing" on our own devices again? I'm getting sick of exorbitant cloud costs and the moat that is forming.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#104

Post by jacobwilliamroy » Mon, Dec 09, 2019, 10:10 AM UTC

csomar wrote: post #100

I am, personally, amazed by this. The following might be kinda NSFW, though. > You are Jesus, a knight living in the kingdom of Larion. You have a steel longsword and a wooden shield. You are on a quest to defeat the evil dragon of Larion. You've heard he lives up at the north of the kingdom. You set on the path to defeat him and walk into a dark forest. As you enter the forest you see a huge black dragon flying abov…

I don't get it. What's NSFW here? Suck his what?

Also, yeah I think it's funny how chatbots can generate undesirable or NSFW responses and there's basically no way to stop it. I know GPT-2 can parrot old-timey scientific racism back at me, just like the redditors who trained it!

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#105

Post by mola » Mon, Dec 09, 2019, 10:11 AM UTC

YeGoblynQueenne wrote: post #101

Can I be controversial and ask what justifies such expenses? Why is this game so important that it needs to be up and running so badly? From what I've seen so far the "game" (if you can even call it that) highlights the weaknesses of GPT-2 much more than its strengths (the model's answers to user actions are random, the story is incoherent, the world is inconsistent). I don't get the feeling it was setup to demonstra…

Welcome to the hype cycle

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#106

Post by Piskvorrr » Mon, Dec 09, 2019, 10:13 AM UTC

kbenson wrote: post #90

dodobirdlord wrote: post #79

Earlier quoted context omitted.

Google Colab gives each user a dedicated Nvidia Tesla K80 GPU for 12 hours for free, which is super cool and presumably why the project is on Colab. But as each user spins up their own Colab instance it pulls down the 6GB of GPT-2 model weights, incurring 30-40 cents of data egress charges against the GCP Storage Bucket that the data is stored in. 60k users yesterday * 6GB each -> 360TB of data egress! Normally, a sc…

This is sort of a killer example for the layperson of what ML can do, so hopefully Google will recognize this and comp most/all the data egress since it's a drop in the bucket for them, but every person that uses it can still go "Wow, Google's services allows for some amazing stuff."

Oh, it does. NOT.FOR.FREE, though; that's the entire reason it exists at all.

In other words, yes, this is an amazing amount of raw power - with a corresponding price tag.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#107

Post by csomar » Mon, Dec 09, 2019, 10:16 AM UTC

jacobwilliamroy wrote: post #104

csomar wrote: post #100

I am, personally, amazed by this. The following might be kinda NSFW, though. > You are Jesus, a knight living in the kingdom of Larion. You have a steel longsword and a wooden shield. You are on a quest to defeat the evil dragon of Larion. You've heard he lives up at the north of the kingdom. You set on the path to defeat him and walk into a dark forest. As you enter the forest you see a huge black dragon flying abov…

I don't get it. What's NSFW here? Suck his what? Also, yeah I think it's funny how chatbots can generate undesirable or NSFW responses and there's basically no way to stop it. I know GPT-2 can parrot old-timey scientific racism back at me, just like the redditors who trained it!

NSFW as don't go loudly reading it in an office.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#108

Post by skohan » Mon, Dec 09, 2019, 10:17 AM UTC

skissane wrote: post #68

Aeolun wrote: post #60

Earlier quoted context omitted.

Probably because they have to spend their grant money some way.

One hears stories about researchers with unspent grant money scrambling madly to find something, anything, to spend it on before the grant expires. Use it or lose it. My Dad told me how back in the 1970s he worked at a government-funded research lab. One time they called up a laboratory glassware supplier and said "We'd like to order $10,000 worth of glassware". The supplier asked "Sure, what specifically would you l…

It sounds like there is a missing incentive to go under budget. There's something wrong with the system if people feel like they just have to burn money.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#109

Post by jacobwilliamroy » Mon, Dec 09, 2019, 10:31 AM UTC

andrekorol wrote: post #38

After having read Rizwan Virk's "The Simulation Hypothesis", and playing this amazing new game, I can say that AI-generated text adventure games are an important step on the road to the Simulation Point (the point at which it would be technologically possible for us to construct a simulation that is all-encompassing as the one in The Matrix).

Have you tried psychadelics yet? Or maybe learned how to lucid dream? I think such technologies will be preferable to you, even if our electronics can catch up with our biological evolution.

Sure, maybe dream machines are fun and cool, but the ones in our future will be made for profit by companies like Facebook and Alphabet which severely diminishes any potential they may have had. Real dreams are libre, gratis, and uninterrupted by ads.

Re: AI Dungeon 2 costing over $10k/day to run on GCS/Colab

#110

Post by jacobwilliamroy » Mon, Dec 09, 2019, 10:33 AM UTC

z3t4 wrote: post #80

I'm too scared Google will charge my credit card just by opening this lab page... I've got a gaming rig, why can't I just run this locally?

I have an unpriveledged user account named "wilson" designed specifically for situations like this.