Live data from Hacker News

BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

github.com

71–80 of 301 posts

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#71

Earlier quoted context omitted.

It just raises the bar so that 3D artists who are only capable of reproducing the same boring things they saw in YouTube tutorials are no longer considered proficient. The more I think about this trend, the more I think it might be good. Bootcamp devs are no longer good enough for junior roles since a GPT could replace them. Digital media people who learnt via YouTube and have no real talent are no longer skilled eno…

How do you get senior people when juniors no longer have careers?

In the same way that junior artists still exist despite us having moved from MS Paint to Photoshop!

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#72

Famous quote: "Wouldn't it be nice if our machines were smart enough to allow programming in natural language?". Well, natural languages are most suitable for their original purposes, viz. to be ambiguous in, to tell jokes in and to make love in, but most unsuitable for any form of even mildly sophisticated precision. And if you don't believe that, either try to read a modern legal document and you will immediately s…

In (language model-backed) natural language interfaces the loss of precision can be made up via iteration. If it were about getting it right on the first try this would be a dead end but there's no need for that restriction.

And specifically, if the agent implementing the requested actions has a mental model of the domain that is similar to the mental model held by the imprecise specification writer, then the specification doesn't need to be precise to have a high probability of being implemented right the first time! The miracle here is that LLMs don't even need fine-tuning to get to that level - and that's unprecedented for non-human agents.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#73
post #9

I know this tech is terrifying to actual 3D artist who don’t want be a “prompt engineer”, but as someone who has never used Blender, I think its cool that I can create something using tools like this and use them in my projects, ex background animation on a website hero section.

I don't think this is "terrifying" to 3D artists any more than github copilot is terrying to us haha, I'm not sure why we engineers have this tendency of imagining every other industry as being populated by superstitious peasants from the dark ages who fear new tools. In my experience the vast majority of people are excited about GPT including artists.

my main issue is the people making hiring and budget decisions aren't 3D artists, they're managers. my work might be objectively better than GPT's, but is that going to matter when my boss compares the cost difference and decides GPT is 'good enough'?

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#74

Famous quote: "Wouldn't it be nice if our machines were smart enough to allow programming in natural language?". Well, natural languages are most suitable for their original purposes, viz. to be ambiguous in, to tell jokes in and to make love in, but most unsuitable for any form of even mildly sophisticated precision. And if you don't believe that, either try to read a modern legal document and you will immediately s…

In (language model-backed) natural language interfaces the loss of precision can be made up via iteration. If it were about getting it right on the first try this would be a dead end but there's no need for that restriction.

Legibility is generally a requirement though. At least is currently is.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#75
post #61

Until We started to see LLMs, and the tools that can be created with them, I doubted the possibility of Star Trek's Voice command system. Asking for the computer to clarify some concept, or filter and reduce data sets based on arbitrary data was pure science fiction. Seeing something like this makes me think that the arbitrary holodeck commands "Paris, 1950's, rainy afternoon" is suddenly not a challenging part of th…

Here's an image result from MidJourney for "Paris, 1950s, rainy afternoon". No additional editing, and I intentionally avoided adding any text to the prompt beyond your own. https://i.imgur.com/IYuh29H.png Not perfect but man, we're getting pretty close.

These systems sure hallucinate text.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#76
post #9

Earlier quoted context omitted.

I don't think this is "terrifying" to 3D artists any more than github copilot is terrying to us haha, I'm not sure why we engineers have this tendency of imagining every other industry as being populated by superstitious peasants from the dark ages who fear new tools. In my experience the vast majority of people are excited about GPT including artists.

I don't know, maybe I am one of those "superstitious peasants from the dark ages who fear new tools", but I'm increasingly terrified of GPT-4 and future iterations of it as applied to the industry I work with (i.e. software). It does seem to threaten to suddenly eliminate all the interesting parts of the job, a good chunk of openings, and to significantly reduce salaries for the openings that remain - all at the same…

For me the interesting job in software is designing architecture and implementing complex things. Automation with tools like this is not remotely there and to some extent probably won't be because we're often talking about human preferences and subjective design choices. Gpt4 in software is Intellisense++ right now, it provides code snippets for things you want to do, it's just raising the bar of abstraction, not replacing the designer.

On the second point, I actually think my salary is inflated and we'd be in the dark ages if I took that for a reason to hamper technology. Not only am I not just a developer of software but also a consumer, so I benefit directly, but more importantly so does everyone else. If everyone operated on that logic I'd still pay 20 bucks for a potato and a hundred for a hammer.

Let's be real the entire point of software is to replace labor. The software industry has done it to many sectors of the economy and called it progress. Which it is. We have no right to start complaining now.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#78

"The generated code might not always be correct. In that case, run it again lmao" is the best documentation I've read all week.

Hey everyone makes mistakes when coding, even LLms.

There’s two approaches I use, I’m sure there are more.

* Do multiple completions and, filter the ones that successfully run, and take the most common result.

* Do a completion, if it fails, ask the Llm to find and correct the bug.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#79

"Limitations: The generated code might not always be correct. In that case, run it again lmao." LOL

I’ve been using ChatGPT to general SQL and it’s either amazing or totally wrong. But that’s on 3.5, I’m fairly sure 4 would be nearly fully reliable.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#80
post #3

Did you run into issues that made you tweak the prompt? You often tell the tool not to do extra work despite having it in the prompt, did you find that it often tries to do a lot of "boilerplate" work like setting up lights and cameras? system_prompt = """You are an assistant made for the purposes of helping the user with Blender, the 3D software. - Respond with your answers in markdown (```). - Preferably import ent…

Usually it tries to explain code, hence the last one.
Post reply on HN