Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

World Emulation via Neural Network

madebyoll.in

Post reply on HN
Print view View original

21–30 of 48 posts

Re: World Emulation via Neural Network

#21

Post by bjornsing »

AndrewKemendo wrote: post #12

I think this is very interesting because you seem to have reinvented NeRF, if I’m understanding it correctly. I only did one pass through but it looks at first glance like a different approach entirely. More interesting is that you made an easy to use environment authoring tool that (I haven’t tried it yet) seems really slick. Both of those are impressive alone but together that’s very exciting.

NeRF is a more complex and constrained approach, based on a kind of ray tracing. But results are obviously similar.

Re: World Emulation via Neural Network

#24

Post by attilakun »

ollin wrote: post #6
quantumHazer wrote: post #2

Is this a solo/personal project? If it is is indeed very cool. Is OP the blog’s author? Because in the post the author said that the purpose of the project is to show why NN are truly special and I wanted a more articulate view of why he/she thinks that? Good work anyway!

Yes! This was a solo project done in my free time :) to learn about WMs and get more practice training GANs. The special aspect of NNs (in the context of simulating worlds) is that NNs can mimic entire worlds from videos alone, without access to the source code (in the case of pokemon) or even without the source code having existed (as is the case for the real-world forest trail mimicked in this post). They mimic the…

Amazing project. This has the same feel as Karpathy’s classic “The Unreasonable Effectiveness of Recurrent Neural Networks” blog post. I think in 10 years’ time we will look back and say “wow, this is how it started.”

Re: World Emulation via Neural Network

#25

Post by Valk3_ »

This might be a vague question, but what kind of intuition or knowledge do you need to work with these kind of things, say if you want to make your own model? Is it just having experience with image generation and trying to incorporate relevant inputs that you would expect in a 3D world, like the control information you added for instance?

Re: World Emulation via Neural Network

#28

Post by downboots »

nopakos wrote: post #26

Next we should try "Excel emulation via Neural Network". We get rid of a lot of intermediate steps, calculations, user interface etc! What could go wrong? Jokes aside, this is insanely cool!

or for a large dataset of math identities and have the user draw one side

Re: World Emulation via Neural Network

#29

Post by titouanch »

This is very impressive for a hobby project. I was wondering if you were planning to release the source code. Being able to create client-hosted, low-requirement neural networks for world generation could be really useful for game dev or artistic projects.

Re: World Emulation via Neural Network

#30

Post by das_keyboard »

> So, if traditional game worlds are paintings, neural worlds are photographs. Information flows from sensor to screen without passing through human hands.

I don't get this analogy at all. Instead of a human information flows through a neural network which alters the information.

> Every lifelike detail in the final world is only there because my phone recorded it.

I might be wrong here but I don't think this is true. It might also be there because the network inferred that it is there based on previous data.

Imo this just takes the human out of a artistic process - creating video game worlds and I'm not sure if this is worth archiving.

Post reply on HN