Earlier quoted context omitted.
Are those millions of people actually creating something of lasting value, or just playing around with a new toy?
Is there a problem with the latter?
[dead]
MeshGPT: Generating triangle meshes with decoder-only transformers
101–110 of 166 posts
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#102As a machine learning engineer who dabbles with Blender and hobby gamedev, this is pretty impressive, but not quite to the point of being useful in any practical manner (as far as the limited furniture examples are concerned. A competent modeler can make these types of meshes in under 5 minutes, and you still need to seed the generation with polys. I imagine the next step will be to have the seed generation controlle…
Just like a competent developer can use LLMs to bootstrap workflows, a competent model will soon have tools like this as part of their normal workflow. A casual user would be able to do things that they otherwise wouldnt have been able to. But an expert in the ML model's knowledge domain can really make it shine.
I really believe that the more experienced you are in a particular use case, the more use you can get out of an ML model.
Unfortunately, it's those very same people that seem to be the most resistant to adopting this without really giving it the practice required to get somewhere useful with it. I suppose part of the problem is we expect it to be a magic wand. But it's really just the new PhotoShop, or Blender, or Microsoft Word, or PowerPoint ...
Most people open those apps, click mindleslly for a bit, promptly leave never to return. And so it is with "AI".
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#103This is fantastic! You can broad-strokes sketch the key strokes of the shape you want, and this will generate some "best" matches around that.
What I really appreciate about this is that they took the concept (transformers) and applied it in a quite different-from-usual domain. Thinking outside of the (triangulated) box!
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#104As a machine learning engineer who dabbles with Blender and hobby gamedev, this is pretty impressive, but not quite to the point of being useful in any practical manner (as far as the limited furniture examples are concerned. A competent modeler can make these types of meshes in under 5 minutes, and you still need to seed the generation with polys. I imagine the next step will be to have the seed generation controlle…
As I understand it their claim is more about efficiency and quality.
Being able to model something - is way different from being able to do it in the least amount of triangles and/or without losing details.
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#105As a machine learning engineer who dabbles with Blender and hobby gamedev, this is pretty impressive, but not quite to the point of being useful in any practical manner (as far as the limited furniture examples are concerned. A competent modeler can make these types of meshes in under 5 minutes, and you still need to seed the generation with polys. I imagine the next step will be to have the seed generation controlle…
> A competent modeler can make these types of meshes in under 5 minutes
It's not about competent modellers, any more than SD is for expert artists.
It's about giving tools to the non-experts. And also about freeing up those competent modellers to work on more interesting things than the 10,000 chair variants needed for future AAA games. They can work on making unique and interesting characters instead, or novel futuristic models that aren't in the training set and require real imagination combined with their expertise.
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#106Fantastic, but still useless from a professional perspective. i.e. A mesh that represents a cube as 12 triangles is a better prestation of the form than previous efforts, but barely more usable.
Whilst it might not be the solution I'm waiting for, I can now see it as possible. If an AI model can handle traingles, it might handle edge loops and NURBS curves.
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#107As a machine learning engineer who dabbles with Blender and hobby gamedev, this is pretty impressive, but not quite to the point of being useful in any practical manner (as far as the limited furniture examples are concerned. A competent modeler can make these types of meshes in under 5 minutes, and you still need to seed the generation with polys. I imagine the next step will be to have the seed generation controlle…
> A competent modeler can make these types of meshes in under 5 minutes It's not about competent modellers, any more than SD is for expert artists. It's about giving tools to the non-experts. And also about freeing up those competent modellers to work on more interesting things than the 10,000 chair variants needed for future AAA games. They can work on making unique and interesting characters instead, or novel futur…
Like most of the generative AI space, it'll eliminate something like the bottom half of modelers, and turn them into lower paid prompt wizards. The top half will become combo modelers / prompt wizards, using both skillsets as needed.
Prompt wizard hands work off to the finisher/detailer.
It'll boost productivity and lead to higher quality finished content. And you'll be able to spot when a production - whether video game or movie - lacks a finisher (relying just on generation by prompt). The objects won't have that higher tier level of realism or originality.
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#108My chosen profession (3D / filmmaking) feels like being in some kind of combat trench at the moment. Both fascinating and scary
I don't see that LLM's have come that much further in 3D animation than programming in this regard: It can spit out bits and pieces that looks okay in isolation but a human need to solve the puzzle. And often solving the puzzle means rewriting/redoing most of the pieces. We're safe for now but we should learn how to leverage the new tech.
> We're safe for now
Some are safe for several years (3-5), that's it. During that time it's going to wreck the bottom tiers of employees and progressively move up the ladder.
GPT and the equivalent will be extraordinary at programming five years out. It will end up being a trivially easy task for AI in hindsight (15-20 years out), not a difficult task.
Have you seen how far things like MidJourney, Dalle, Stable Diffusion have come in just a year or two? It's moving extremely fast. They've gone from generating stick figures to realistic photographs in two years.
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#109Earlier quoted context omitted.
I'm not a professional in VFX, but I work in television and do a lot of VFX/3D work on the side. The quality isn't amazing, but it looks like this could be the start of a Midjourney-tier VFX/3D LLM, which would be awesome. For me, this would help bridge the gap between having to use/find premade assets and building what I want. For context, building from scratch in a 3D pipeline requires you to wear a lot of differen…
On an unrelated note, could I ask your opinion? My wife is passionate about film/TV production and VFX. She's currently in school for this but is concerned about the difficulty of landing a job afterwards. Do you have any recommendations on breaking into the industry without work experience?
As a producer? Huh. That’s such a great question.
I think producer roles are a little bit less ultra competitive / scarce as they are actually jobs jobs where you have to use excel and planning and budgeting.
Being a producer means being on the phone all the time, negotiating, haggling, finding solutions where they don’t seem to exist.
Be it in TV, advertising or somewhere in the media space, the common rule is that producers are mostly actually terrible at their jobs, that’s my experience in London. So if she’s really good and really dedicated and learns the job of everyone on set, I’d say she has a shot.
The real secret to being good in filmmaking is learning everyone else’s job. Toyota Production System says if you want to run a production line you have to know how it works.
If she wants to do VFX production she could start doing her own test scenes, learning basics in nuke and Blender, even understanding the role of Houdini and how that works.
If she does that - any company will be lucky to have her.
Re: MeshGPT: Generating triangle meshes with decoder-only transformers
#110As a machine learning engineer who dabbles with Blender and hobby gamedev, this is pretty impressive, but not quite to the point of being useful in any practical manner (as far as the limited furniture examples are concerned. A competent modeler can make these types of meshes in under 5 minutes, and you still need to seed the generation with polys. I imagine the next step will be to have the seed generation controlle…
> A competent modeler can make these types of meshes in under 5 minutes Sweet. Can you point me to these modelers who work on-demand and bill for their time in 5 minute increments? I’d love to be able to just pay $1-2 per model and get custom dropped into my game when I need it.
they said competent though no cheap