Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GAN Theft Auto [video]

youtube.com

Post reply on HN
Print view View original

91–99 of 99 posts

Re: GAN Theft Auto [video]

#91

Post by fartcannon »

sentdex wrote: post #44
fartcannon wrote: post #18

Earlier quoted context omitted.

Your original self driving GTA5 videos are what helped me come to understand machine learning in the first place (along with some of Seth Bling's MarI/O, and a bit of Tom7's learn/play-fun magic). I used your tech to make an AI that played Donkey Kong Country in LSNES emulator shortly before Gym-Retro was released. So, thanks a bunch, Sentdex. You are rad.

Hah, awesome! Any plans to apply GAN Theft Auto to something else? :o

Not offhand, but you've probably inspired a lot of creativity with this across the internet... and a lot of copy cats. I'm looking forward to seeing what gets made.

Re: GAN Theft Auto [video]

#92

Post by sentdex »

magic_quotes wrote: post #90
sentdex wrote: post #88

Earlier quoted context omitted.

No, that's just false. How about a direct quote? I suggested there could be a "future where many game engines are entirely or even mostly AI based like this. Or even things like operating system or other programs." The thought here was just a wondering of what the future might be and if we might have far more AI based programs. I still think the answer is a strong yes, this is a glimpse into the future. No where did…

I'd like my OS being deterministic, thank you. > You're just trying your hardest to hate. Manipulative much? I don't hate you (well, so far), you aren't being attacked, I'm just noting what a few informed people here don't like about your video. No, they aren't trolls. And, yes, everyone has different level of tolerance to exaggerations, of course.

Odd, pretty sure it was you who misrepresented what I said in attempts to manipulate.

You were also the one who "exaggerat[ed]" my claims. I made a general statement about my thoughts about future AI-based software rather than human-coded.

I still think that's indeed the inevitable future. Doesn't seem like it's remotely outrageous or an exaggerated. I never said GameGAN would be that software, but you seem to want to make that be the case so you can put it down.

What makes you believe neural networks aren't or could not be deterministic? What makes you think NNs could not eventually produce far more robust, reliable, and secure operating systems?

Seems obvious to me, but I guess you're more informed than me :)

Re: GAN Theft Auto [video]

#93

Post by bastawhiz »

andrepd wrote: post #86
bastawhiz wrote: post #29

Earlier quoted context omitted.

Skepticism is good when it targets bold claims with vague proof. This is not a bold claim (it's a video demo showing the process) and its proof is not vague (you can inspect the source). Skepticism over something like GPT-2 without more than sample output is good. Skepticism over GPT-2 with a workable demo and source is unhelpful.

Funny you mention GPT-2/3, which is by all accounts a glorified chatbot, but which has nevertheless been hyped as one step below AGI by many people.

Has anyone at OpenAI made that claim?

Re: GAN Theft Auto [video]

#94

Post by alimov »

YeGoblynQueenne wrote: post #72
sentdex wrote: post #17

Earlier quoted context omitted.

Heh, yeah, tough crowd I guess. The full code, models, and videos are all released and people are still skeptical. I feel like 95%+ of papers don't do anything besides tell you what happened and you're just supposed to believe them. Drives me nuts. Not sure why all the hate when you could just see for yourself. I'd welcome someone who can actually prove the model just "memorized" every combo possible and didn't do an…

>> The full code, models, and videos are all released and people are still skeptical. If you're uncomfortable with criticism of your work you should definitely try publishing it, e.g. at a conference or journal. It will help you get comfortable with being criticised very quickly.

I think he’s pointing out that the “criticism” here is similar to that of a person criticizing a book they’ve never read or even flipped through.

Re: GAN Theft Auto [video]

#95

Post by HerrmannM »

Great work! I'm curious about what could be achieved in this space in the future.

I'm curious about why you cannot share the GTA5 mod and collection script? I'm curious about that part too -- obtaining good data is always hard.

Cheers and all the best!

Re: GAN Theft Auto [video]

#96

Post by YeGoblynQueenne »

alimov wrote: post #94
YeGoblynQueenne wrote: post #72

Earlier quoted context omitted.

>> The full code, models, and videos are all released and people are still skeptical. If you're uncomfortable with criticism of your work you should definitely try publishing it, e.g. at a conference or journal. It will help you get comfortable with being criticised very quickly.

I think he’s pointing out that the “criticism” here is similar to that of a person criticizing a book they’ve never read or even flipped through.

Perhaps, but that criticism should be the easiest to ignore. The OP expresses frustration to lay criticism and I expect that even brief contact with academic criticism will make the frustration felt by the OP to lay criticism fade into irrelevance.

Re: GAN Theft Auto [video]

#97

Post by 90211 »

sentdex wrote: post #92
magic_quotes wrote: post #90

Earlier quoted context omitted.

I'd like my OS being deterministic, thank you. > You're just trying your hardest to hate. Manipulative much? I don't hate you (well, so far), you aren't being attacked, I'm just noting what a few informed people here don't like about your video. No, they aren't trolls. And, yes, everyone has different level of tolerance to exaggerations, of course.

Odd, pretty sure it was you who misrepresented what I said in attempts to manipulate. You were also the one who "exaggerat[ed]" my claims. I made a general statement about my thoughts about future AI-based software rather than human-coded. I still think that's indeed the inevitable future. Doesn't seem like it's remotely outrageous or an exaggerated. I never said GameGAN would be that software, but you seem to want t…

You, like many youtubers, made completely exaggerated claims in your commentary. Your model fits a sequence of inputs to a video frame. But you say "wow look it even models the movement of the sun!". It's pretty absurd.

Re: GAN Theft Auto [video]

#98

Post by jallbrit »

riveducha wrote: post #48
reasonabl_human wrote: post #35

Earlier quoted context omitted.

This exists via recent NLP models, I’ll see if I can dig up a link… Edit: https://www.reddit.com/r/linux/comments/mtnld7/programmer_cr...

As the original creator of that video, it’s a little sad to see people download and then re-upload the entire video to Reddit. You can find the original video as well as written commentary on my web page: https://riveducha.onfabrica.com/openai-powered-linux-shell

Wow, what an incredible video and showcase. This really puts GPT-3's power into perspective. I can't wait till the public has access to something that powerful- or maybe I should enjoy not receiving GPT-3 phishing emails in my inbox.

Re: GAN Theft Auto [video]

#99

Post by ShamelessC »

sentdex wrote: post #17
ShamelessC wrote: post #10

Great work! Hacker News still seems to have a deeply skeptical culture with regard to machine learning - not sure why. There's always someone saying it's "not novel" and it's "just doing x". Overfitting is a known issues in machine learning, people. If you still think all neural networks are doing is memorizing the dataset completely in the year 2021 - you might want to revisit the topic. It is one of the first conce…

Heh, yeah, tough crowd I guess. The full code, models, and videos are all released and people are still skeptical. I feel like 95%+ of papers don't do anything besides tell you what happened and you're just supposed to believe them. Drives me nuts. Not sure why all the hate when you could just see for yourself. I'd welcome someone who can actually prove the model just "memorized" every combo possible and didn't do an…

I've been learning about this stuff for about a year now. Your earlier experiments with learning to drive in GTA V were an inspiration for me - because they hit that perfect intersection of machine learning, accessibility in education, and just plain cool.

The pandemic hit and Open AI had released DALL-E and CLIP. I was unemployed and bored with my Python skills and decided to just dive in. I found a nice gentleman named Phil Wang on github had been replicating the DALL-E effort and decided to start contributing!

You can find that work here

https://github.com/lucidrains/DALLE-pytorch

and you'll find me here:

https://github.com/afiaka87

We have a few checkpoints available with colab notebooks ready and there is also a research team with access to some more compute who will eventually be able to perform a full replication study and match a similar scale to Open AI and then some because we are also working with another brilliant German team https://github.com/CompVis/ who has provided us with what they are calling a "VQGAN" (if you're not familiar) - which is a variational autoencoder for vision tokens with the neat trick from GAN-land of using a discriminator in order to produce fine details.

https://github.com/CompVis/taming-transformers

We use their pretrained VQGAN to convert an image into digits. We use another pretrained text tokenizer to convert words to digits. The digits both go into a Transformer architecture and a mask is applied to the image tokens in the transformer so that the text tokens can't see the image tokens. The digits come out and we encode them back into text and image respectively. Then, a perceptual loss is computed. Rinse, wash, repeat. Slowly but surely, text predicts image without ever having been able to actually _see_ the image. Insanity.

Anyway, taking a caption and making a neural network output an image from it has again hit that "perfect intersection of machine learning, accessibility in education, and just plain cool". I don't know if you could fit it into the format of your YouTube channel but perhaps it would be a good match?

Post reply on HN