Live data from Hacker News

Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

github.com

21–30 of 35 posts

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#21
post #2

Really cool project. Some questions to ML/AI researchers here on HN: - Are there any ML/AI papers out there that trained on this? E.g. training robots in virtual environments? - What data sets are used today in the ML/AI space to train robots?

I'm pretty sure i saw a video from Nvidia research using generated environments for training robots etc.

Can't find it quickly though.

Nvidias Omniverse is one of the core things though

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#22
post #7

Earlier quoted context omitted.

From the video: "Infinigen is 100% procedural. Math rules only. Zero AI. Just graphics." . Timestamp: https://youtu.be/6tgspeI-GHY?t=107

The question wasn't "does this use AI". It was, "does any AI use this".

Exactly, thanks.

Did some light digging and found some related papers:

- https://robogen-ai.github.io/

- https://genesis-embodied-ai.github.io/, related HN thread: https://news.ycombinator.com/item?id=42457213

- https://paperswithcode.com/datasets?q=robot&v=th&o=match

These use other data sets, however.

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#23
post #11

The indoor scenes look completely plausible, but the outdoor leaves a lot to be desired. Very much behind the state of the art.

You have to admit the sea water was way better than any video game today. The rest though, yeah.

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#24
The fact that this is possible feels like it says something about the universe— that there is not as much information in our environment as we think there is.

This in turn could explain the unreasonable effectiveness of brains — especially small ones like animal brains — at modeling and operating in the world.

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#25
post #24

The fact that this is possible feels like it says something about the universe— that there is not as much information in our environment as we think there is. This in turn could explain the unreasonable effectiveness of brains — especially small ones like animal brains — at modeling and operating in the world.

That's a very superficial way of looking at the universe.

Existence is not limited to whether or not it's observed. Brains have evolved to only gather the minimum amount of information required to keep the organism alive in its particular environment. But there is an unfathomable amount of complexity in the universe, even in the things we _can_ perceive.

For 3D modeling specifically these details don't matter, which is why we're able to approach photorealism. The renders look good enough to fool our brains into thinking that we're looking at the object as it would appear in the real world. They're a good approximation of visual aspects, but they're far from a good representation of real world objects. We don't have nearly enough compute for that. We've only recently gained the ability to model how light behaves in the real world in real-time, and even that is an approximation.

Anyway, Infinigen looks like a cool product. It's great to see classical simulations instead of AI for a change.

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#27
post #24

The fact that this is possible feels like it says something about the universe— that there is not as much information in our environment as we think there is. This in turn could explain the unreasonable effectiveness of brains — especially small ones like animal brains — at modeling and operating in the world.

>The fact that this is possible feels like it says something about the universe

Similarly, the character models in Final Fantasy 7 say something about the human endocrine system. Aeris clearly reads as human despite you not being able to see her adrenal glands so maybe they don’t exist in real life

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#28
post #21
post #2

Really cool project. Some questions to ML/AI researchers here on HN: - Are there any ML/AI papers out there that trained on this? E.g. training robots in virtual environments? - What data sets are used today in the ML/AI space to train robots?

I'm pretty sure i saw a video from Nvidia research using generated environments for training robots etc. Can't find it quickly though. Nvidias Omniverse is one of the core things though

If you look up the nvidia keynote from 2024, omniverse, robotics, and digital twins are discussed at length [1]. The relevant parts are near timestamp: 1 hour 34 minutes

[1]: https://www.youtube.com/live/Y2F8yisiS6E

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#29
post #24

The fact that this is possible feels like it says something about the universe— that there is not as much information in our environment as we think there is. This in turn could explain the unreasonable effectiveness of brains — especially small ones like animal brains — at modeling and operating in the world.

The information density is large, our perception (i.e. the universe perceiving itself) filters for our particular length and time scale.

Re: Infinigen: Infinite Photorealistic Worlds Using Procedural Generation

#30
post #24

The fact that this is possible feels like it says something about the universe— that there is not as much information in our environment as we think there is. This in turn could explain the unreasonable effectiveness of brains — especially small ones like animal brains — at modeling and operating in the world.

> "The fact that this is possible feels like it says something about the universe"

the map is not the territory

Post reply on HN