Live data from Hacker News

MeshGPT: Generating triangle meshes with decoder-only transformers

nihalsid.github.io

11–20 of 166 posts

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#11
post #5

What is the input? Is it converting a text query like "chair" to a mesh? edit: Seems like mesh completion is the main input-output method, not just a neat feature.

That's what I was wondering. From the diagram it looks like the input is other chair meshes, which makes it somewhat less interesting.

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#13
post #2

This looks really cool! Seems like it would be an incredible boon for an indie game developer to generate a large pool of assets!

I think indie game development is dead with these techniques. Instead big companies will create "make your own game" games. Indie games already seems pretty derivative these days. I think this tech will kill them in mid-term as big companies use them.

For values of "dead" equal to "Now people who aren't 3D artists and can't afford to hire them will be able to make games," maybe.

User name checks out.

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#14
post #5

What is the input? Is it converting a text query like "chair" to a mesh? edit: Seems like mesh completion is the main input-output method, not just a neat feature.

You prompt this LLM using 3D meshes for it to complete, in the same manner you use language to prompt language specific LLMs.

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#15
post #2

This looks really cool! Seems like it would be an incredible boon for an indie game developer to generate a large pool of assets!

I think indie game development is dead with these techniques. Instead big companies will create "make your own game" games. Indie games already seems pretty derivative these days. I think this tech will kill them in mid-term as big companies use them.

People who use "make your own game" games aren't good at making games. They might enjoy a simplified process to feel the accomplishment of seeing quick results, but I find it unlikely they'll be competing with indie developers.

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#16
post #5

What is the input? Is it converting a text query like "chair" to a mesh? edit: Seems like mesh completion is the main input-output method, not just a neat feature.

Yeah it's hard to tell.

It looks like the input is itself a 3D mesh? So the model is doing "shape completion" (e.g. they show generating a chair from just some legs)... or possibly generating "variations" when the input shape is more complete?

But I guess it's a starting point... maybe you could use another model that does worse quality text-to-mesh as the input and get something more crisp and coherent from this one.

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#17
post #14
post #5

What is the input? Is it converting a text query like "chair" to a mesh? edit: Seems like mesh completion is the main input-output method, not just a neat feature.

You prompt this LLM using 3D meshes for it to complete, in the same manner you use language to prompt language specific LLMs.

That's what it seems like. Although this is not an LLM.

> Inspired by recent advances in powerful large language models, we adopt a sequence-based approach to autoregressively generate triangle meshes as sequences of triangles.

It's only inspired by LLMs

Re: MeshGPT: Generating triangle meshes with decoder-only transformers

#19
post #2

This looks really cool! Seems like it would be an incredible boon for an indie game developer to generate a large pool of assets!

I think indie game development is dead with these techniques. Instead big companies will create "make your own game" games. Indie games already seems pretty derivative these days. I think this tech will kill them in mid-term as big companies use them.

“Make your own game” games will never replace regular games. They target totally different interests. People who play games (vast majority) just want to play an experience created by someone else. People who like “make your own game” games are creative types who just use that as a jumping off point to becoming a game designer.

It’s no different than saying “these home kitchen appliances are really gonna kill off the restaurant industry.”

Post reply on HN