Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

github.com

Post reply on HN
Print view View original

231–240 of 301 posts

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#231

Post by elif »

bigbassroller wrote: post #2

I know this tech is terrifying to actual 3D artist who don’t want be a “prompt engineer”, but as someone who has never used Blender, I think its cool that I can create something using tools like this and use them in my projects, ex background animation on a website hero section.

I asked my friend (renowned vfx artist) what he thought about AI in his field and he mentioned some niche cases where it was useful for blending models with film etc, but overall seemed uninterested.

He offered the explanation that so much of their time is consumed with nit picking through purely aesthetic decisions that AI would not be capable of the artistic reasoning required to produce work that could even get to the "pass or reject" stage.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#232

Post by Foobar8568 »

quonn wrote: post #196
carlsborg wrote: post #167

Earlier quoted context omitted.

From authors website: "I graduated high school in May of 2022..". Elsewhere, he writes he placed first at a university level drone programming challenge at IIT-Bombay Techfest. Very impressive.

The JEE exam in India is very advanced, I doubt most Europeans or US students could pass it, even after a year or two at university. So those who enter IIT are already quite good very early.

I have taken a look at some test papers, it's basically stuff we were doing back in the 80s/90s in France at the end of high school, nothing crazy, I aould even say trivial as it looks to be direct application of the course, and if it's just a MCQ, then it's a bloody joke, even today. And I believe, it should be easily tackled by any current gymnase students following the physic /math stream in Switzerland. The actual question would be more why the level in Europe (and in a lesser extend) north America dropped this much over the last 30years.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#233

Post by cube2222 »

iamflimflam1 wrote: post #183

I see a lot of people asking how does this work. The method he is using is one shot learning. He has a prompt and an example of what the interaction should look like. You can see the prompt here: https://github.com/gd3kr/BlenderGPT/blob/main/__init__.py It is really easy to build this kind of thing - I've got a very simple command line chatbot that should be very understandable and you can easily play with the prompt…

Did something similar as a natural language interface to DuckDB this weekend, and it's surprising how nice it works[0].

That said, through my testing I found it tended to trail off during longer exchanges if I only added the guidelines to the system prompt, so I ended up adding them to the first user message + adding a small reminder at the end of each further user message.

[0]: https://github.com/cube2222/duckgpt

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#234

Post by capableweb »

therouwboat wrote: post #188
capableweb wrote: post #15

Earlier quoted context omitted.

It could also be that something like this is just another tool in the toolbox. Sure, you could spend time trying to understand Blender's Python API, but lots of Blender users are not programmers. It could be really helpful for them to be able to say "Place 10 spot lights at random position within the boundaries of Mesh 3 with random intensity and color" and just have that appear, rather than having to go looking for…

I dont know why people make this harder than it needs to be, make group of lights, change colors and duplicate, its good enough, no need to use python api.

Obviously just an example, but even so, unless you already have the workflow established, writing human text describing something could be easier than manually doing it.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#235

Post by ChatGTP »

Naga wrote: post #199
warent wrote: post #9

Earlier quoted context omitted.

I don't think this is "terrifying" to 3D artists any more than github copilot is terrying to us haha, I'm not sure why we engineers have this tendency of imagining every other industry as being populated by superstitious peasants from the dark ages who fear new tools. In my experience the vast majority of people are excited about GPT including artists.

I was speaking recently to a graphic artist who is terrified of Stable Diffusion and the like. I mentioned that these tools can augment their ability to do work instead of just replacing, but their point is that they are a graphic artist because they like doing the things that the AI will be replacing. Being a prompt engineer wasn't really the reason they studied and learned to become an artist. To me, that is a comp…

Do what I do and probably many others. Draw at work (use AI assist or whatever hype is available to keep your boss happy), then draw something at home you love.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#236

Post by quadcore »

iamflimflam1 wrote: post #183

I see a lot of people asking how does this work. The method he is using is one shot learning. He has a prompt and an example of what the interaction should look like. You can see the prompt here: https://github.com/gd3kr/BlenderGPT/blob/main/__init__.py It is really easy to build this kind of thing - I've got a very simple command line chatbot that should be very understandable and you can easily play with the prompt…

You can see the prompt here

See how this file quickly got hacked together all in one file. It's refreshing to see and note-worthy as it appears when new exciting world-changing tech emerges that makes programmers let-go and become hackers again.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#237

Post by toolz »

Foobar8568 wrote: post #232
quonn wrote: post #196

Earlier quoted context omitted.

The JEE exam in India is very advanced, I doubt most Europeans or US students could pass it, even after a year or two at university. So those who enter IIT are already quite good very early.

I have taken a look at some test papers, it's basically stuff we were doing back in the 80s/90s in France at the end of high school, nothing crazy, I aould even say trivial as it looks to be direct application of the course, and if it's just a MCQ, then it's a bloody joke, even today. And I believe, it should be easily tackled by any current gymnase students following the physic /math stream in Switzerland. The actua…

Shouldn't the ultimate test of an education system be the practical outputs that serve society? We use testing for more immediate results, but there's nothing particularly telling at a more practical level that engineering in the EU and NA is falling behind India, as far as I can tell innovation in STEM is still taking place frequently in EU and NA.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#238

Post by roflyear »

westoncb wrote: post #56
roflyear wrote: post #49

Earlier quoted context omitted.

Yeah maybe! Just like if you have enough monkeys iterating on enough keyboards...

Just a few monkeys should be fine ;) If this weren't the case then it wouldn't be possible for (e.g.) the software industry to exist as it does: non-technical folks using natural language are able to converse with engineers who take informal descriptions and turn them into code, often leaning heavily on iteration the bring code and spec into conformance.

"should be fine" - how do you determine this?

There have been many, many cases where I was not able to get GPT-4 to "understand" my problem. No matter how much I tried (until I hit the rate limit for those hours, anyway).

People are throwing these absolutes around, and it's just not totally true.

Much of an engineer's job is to try and implement the correct solution for imperfect requirements, then to go back and quickly fix things to match the real requirements.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#239

Post by roflyear »

serf wrote: post #131
ericd wrote: post #67

Earlier quoted context omitted.

Eh? GPT definitely uses the past comments as context, so as you clarify, its responses get much closer to the target. If you haven't tried GPT-4, you absolutely should before having strong opinions about it.

parent is only half wrong; given a sufficiently long iteration process any of the chatGPT versions would surely start losing coherency regarding far past requests -- this may be less evident when used within a well confined and (somewhat) easily self-referenced system (like Blender, for example) -- but it's especially evident when trying to prompt GPT to write a fiction story from basics or otherwise work entirely on…

What I am saying is you can't get GPT to solve any problem you throw at it. What you can probably do is get it to give you a correct answer that it was trained on. Those are different things.

You can't teach it new information, and often that is required to solve a problem.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#240

Post by roflyear »

ericd wrote: post #67
roflyear wrote: post #51

Earlier quoted context omitted.

Sure but GPT certainly cannot actually do this. It can iterate, but in GPT-world that means "give me another response" not "learn from what i'm saying, and give me another response" The issue is, sometimes those two things seem to be the same thing!

Eh? GPT definitely uses the past comments as context, so as you clarify, its responses get much closer to the target. If you haven't tried GPT-4, you absolutely should before having strong opinions about it.

> so as you clarify, its responses get much closer to the target.

This isn't a given. Plenty of times this isn't true. You cannot convince GPT to answer every problem all the time.

For example, try and teach it a grammar. No matter how many times you try and work with it, you won't be able to.

You can teach almost anyone a grammar if they are inclined to try to fuss through it. Not GPT.

And yes I have used GPT-4 a lot, please don't assume I haven't.

Post reply on HN