Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

github.com

Post reply on HN
Print view View original

171–180 of 301 posts

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#171

Post by guyomes »

endisneigh wrote: post #11

this is cool, but hm, how should I put it... Ultimately there's a relationship between the preciseness in which you want to control something and the underlying information, as conveyed in language, to describe such precision. Whether you use plain english, or code - ultimately to do things of sufficient precision you will have to be equally precise in your description. I'm sure someone with more time and more knowle…

If the command is not restricted to text only, but use text and geometrical context, you can remove a lot of ambiguities. This is often done in video games with contextual interactions.

After all, using the Blender GUI, you can do a lot using only a 2D mouse coordinate and two boutons. So 2D mouse coordinates and text could be better.

A nice evolution would be an AI model that can understand natural language instructions, while taking into account where your mouse pointer, how the model is zoomed and oriented, and that has geometric insight of the 3D scene built so far.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#172

Post by creativenolo »

DrewADesign wrote: post #126
wizzwizz4 wrote: post #44

Earlier quoted context omitted.

Chess is fundamentally a different kind of problem. You can prove things about chess in the general case, but it's mathematically impossible to prove things about computer programs in the general case.

There's no mathematical proof for the correctness of graphic design, either, but that won't stop cheap AI-generated garbage from taking over the role of making commodity images and putting a lot of people out of work.

I'm curious about graphic design and if AI can do it to a passable standard. Generating fiction photographs, paintings, illustrations seems more flexible than constrained and balanced proper graphic design. I am sure AI can mash together templates and icons. Less sure about producing a solution to a client brief with a timely and timeless design.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#173

Post by junon »

barking_biscuit wrote: post #113
junon wrote: post #37

Assuming this requires a premium subscription to chatgpt, this might actually push me to sign up. Never thought I'd see the day I'd pay OpenAI a cent given that I don't really agree with their level of "open"ness.

>I don't really agree with their level of "open"ness I see this complaint a lot, but after watching a lot of interviews with the founders, I think they have by and large taken the right approach. They're trying to drip feed things at a rate that allows it to be digested enough by all parties before releasing more. They actually appear to be quite principled thinkers on this topic.

I think the "holier than thou" approach is rather narcissistic personally. Their rationale has basically been that the world isn't ready, which is rather ridiculous to me.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#176

Post by iamflimflam1 »

sinuhe69 wrote: post #175

Anybody knows how it was done? Did GPT-4 generate all the codes, or did the author fine-tune GPT-4 on Blender code?

Typically, there's two ways to do this.

The first is to just use the fact the GPT-4 will have seen a lot of blender code so just knows how to do it.

The second way is to tell GPT-4 in the prompt what the API surface looks like and have it script against that.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#177

Post by iamflimflam1 »

iamflimflam1 wrote: post #176
sinuhe69 wrote: post #175

Anybody knows how it was done? Did GPT-4 generate all the codes, or did the author fine-tune GPT-4 on Blender code?

Typically, there's two ways to do this. The first is to just use the fact the GPT-4 will have seen a lot of blender code so just knows how to do it. The second way is to tell GPT-4 in the prompt what the API surface looks like and have it script against that.

You can actually just look in this file and see that the first method is being used. He feeds in a prompt with a basic example.

https://github.com/gd3kr/BlenderGPT/blob/main/__init__.py

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#178

Post by comfortabledoug »

kaashif wrote: post #118
pixl97 wrote: post #96

Earlier quoted context omitted.

People in the textile industry were well paid and given a place to live at one point in history. Then the auto loom showed up and they were kicked to the street to starve. I wouldn't want to try to live in any major US city on a blue collar salary.

Maybe one day AI will allow completely unskilled laypeople, ignorant of software, to build and deploy software end to end with no involvement from any software engineers, testers, SREs, anything. That would be the power loom of our time - the power loom allowed unskilled workers to completely replace skilled hand loom weavers with no drop in quality of output. When that's possible, the world will be very different. R…

This, and also every textile worker didn't have an auto loom in their pockets, or a lawyer, or an accountant, or a copywriter....I mean who will be left besides leadership teams??

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#179

Post by marginalia_nu »

sillysaurusx wrote: post #141
swyx wrote: post #136

Earlier quoted context omitted.

star trek is also fictional where things happen as the writers wish it to… the real world is not subject to such restrictions

Then why do our iPads seem to match their PADDs almost exactly?

Because Apple engineers watch Star Trek too, more than likely.

Also, the wax tablets of antiquity also strongly resemble iPads. It's a fairly old invention. Might as well argue the ancient Greeks invented iPads.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#180

Post by iamflimflam1 »

davidpolberger wrote: post #169

Does anyone know if this works well (to the extent that it does), because the documented Blender Python API was part of the GPT-4 training set, or because the Blender API is fairly predictable? I'd love to add this capability to our SaaS product, but I've waited for OpenAI to make GPT-3.5 or GPT-4 available for fine-tuning. (Cramming an entire API into the prompt does not seem feasible, not even with support for 32K…

He's using the fact the the blender python API is part of the training set. The prompt used can be seen in this file: https://github.com/gd3kr/BlenderGPT/blob/main/__init__.py
Post reply on HN