Live data from Hacker News

BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

github.com

91–100 of 301 posts

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#91
"Computer: tea, earl gray, hot."

We're nearing the precipice of more natural human-computer interaction that will need to rethink the interfaces and conventions.

Alexa and Siri seem like Model T Fords when there's a jet aircraft flying overhead. I'm thinking these agents need to be replaced by more natural agents who can co-create a language with their human counterparts rather than relying on fixed, awkward, and sometimes unhelpful commands. It would behoove us to expose APIs and permissions delegation in a more consistent and self-describing (OpenAPI + OAuth / SAML possibly) manner for all possible services one would wish to grant to an agent. If a natural language agent is uncertain, it should ask for clarification. And on results, it is necessary to capture ever-more-precise feedback from users because positive and negative prompts aren't good enough.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#92
post #81
post #40

I'm just thinking of that reddit post about the 3d artist who is demoralized about his small indie company and him being reduced to just inputting prompts all day. Now its spreading to the animators and Explosion/CreatureEffects artists. Studios like Wetta Digital / DoubleNegative etc.. are gonna pounce on this

Do you have a link to this post by any chance?

https://news.ycombinator.com/item?id=35308498

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#93
post #37

Assuming this requires a premium subscription to chatgpt, this might actually push me to sign up. Never thought I'd see the day I'd pay OpenAI a cent given that I don't really agree with their level of "open"ness.

You don't need ChatGPT Plus, but you do need to get an API key and give them your credit card so they can bill you at the end of the month. It's very cheap though! $1 is worth about 375 thousand words.

GPT-4 API costs $0.03-$0.12/1000 tokens (the top for prompt tokens on the 8k context option, the top for response tokens on the 32k context option, and response on 8k and prompt on 32k are $0.06/1000), so best case about 33,000 tokens/$. tokens:words is about 4:3, so that’s about 25,000 words/$, not 375,000 words/$.

(Practically, you aren’t going to get quite the ideal even on the 8k context option because you are going to use at least some response tokens on each request, though I would imagine text -> software controls can be optimized so that the response is fairly token-efficient in most cases.)

Also, GPT-4 API access is in limited-access with a waitlist that is advertised as prioritized based on submitting AI evaluation cases to OpenAI’s repository.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#94

Famous quote: "Wouldn't it be nice if our machines were smart enough to allow programming in natural language?". Well, natural languages are most suitable for their original purposes, viz. to be ambiguous in, to tell jokes in and to make love in, but most unsuitable for any form of even mildly sophisticated precision. And if you don't believe that, either try to read a modern legal document and you will immediately s…

fantastic quote, thank you

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#95
post #61

Earlier quoted context omitted.

Here's an image result from MidJourney for "Paris, 1950s, rainy afternoon". No additional editing, and I intentionally avoided adding any text to the prompt beyond your own. https://i.imgur.com/IYuh29H.png Not perfect but man, we're getting pretty close.

These systems sure hallucinate text.

Yes, because models like midjourny tiny compared to LLMs like GPT. I'm pretty sure there's a good hackernews discussion on this that occurred recently, but with all the AI talk I can't find it. But really we need a lot less information to make a reasonable city, then the amount of information we need to make billboards and signs make sense. I don't think Midjourny wants to pay 10+ million dollars to have their model trained.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#96
post #42

Earlier quoted context omitted.

I don't know, maybe I am one of those "superstitious peasants from the dark ages who fear new tools", but I'm increasingly terrified of GPT-4 and future iterations of it as applied to the industry I work with (i.e. software). It does seem to threaten to suddenly eliminate all the interesting parts of the job, a good chunk of openings, and to significantly reduce salaries for the openings that remain - all at the same…

In the past, when tools that significantly increased developer productivity emerged, like higher level languages (C, Java, Python), better IDEs, or better access to help (e.g. StackOverflow), the demand for more software has outpaced any decrease in demand for developers due to productivity improvements. I'm not saying I know that's going to continue forever, but it might. If the cost to produce software goes down, t…

People in the textile industry were well paid and given a place to live at one point in history. Then the auto loom showed up and they were kicked to the street to starve. I wouldn't want to try to live in any major US city on a blue collar salary.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#97
This is getting closer to the system I've been saying I wanted since the 1980s, whenever people said "what could you use a faster computer for anyway?"

It's a system where you can talk to it and make a photo realistic movie. The example I always use is, you're sitting at the computer, looking at a blank screen and you say something like:

"Ok opening scene. Dockside, London, early 19th century. Early evening. There are several ships docked, one being offloaded. Stevedores are working, some disreputable louts hanging around."

The screen is updating as I'm talking.

"OK make it grittier, more dirt and grime, let's have a fight break out in mid distance left of the screen. Now pan slowly right to reveal a bar called the Skull and Crown. Make the sign dirtier but let the last light of sunset glint off of the skull."

Screen updates. We are looking at what appears to be a Hollywood level period set full of extras who look the way they should, based on historical data that the model has.

"As we pan over towards the door Micky gets tossed out by the big burly barman. Make him younger, skinnier, he's about 17 years old."

The point of all this is, no, you don't need exact language to specify what you want. In the world of filmmaking you never do that. The screenwriter describes things in some detail, but always leaves a lot up to the interpretation of the director, the set designer, the costumer, the makeup artist, the casting director, etc.

The AI can take on any or all of those roles for us.

What I want is something I can control to make the movie I want to make. Then I want to be able to iterate on it: Let's make the main character a woman. Now everything gets changed to fit that. etc.

Of course the AI can replace the role of the writer too, and the director, and the producer leaving me with nothing to do. But the fact that I can bring my vision to the screen still makes it a great tool.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#98

Earlier quoted context omitted.

I don't know, maybe I am one of those "superstitious peasants from the dark ages who fear new tools", but I'm increasingly terrified of GPT-4 and future iterations of it as applied to the industry I work with (i.e. software). It does seem to threaten to suddenly eliminate all the interesting parts of the job, a good chunk of openings, and to significantly reduce salaries for the openings that remain - all at the same…

For me the interesting job in software is designing architecture and implementing complex things. Automation with tools like this is not remotely there and to some extent probably won't be because we're often talking about human preferences and subjective design choices. Gpt4 in software is Intellisense++ right now, it provides code snippets for things you want to do, it's just raising the bar of abstraction, not rep…

And while doing so income disparity has kept increasing.

Eventually we need to stop and think about how capitalism is winner take all, or we're all in for a very bad time.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#99
post #61

Earlier quoted context omitted.

Here's an image result from MidJourney for "Paris, 1950s, rainy afternoon". No additional editing, and I intentionally avoided adding any text to the prompt beyond your own. https://i.imgur.com/IYuh29H.png Not perfect but man, we're getting pretty close.

These systems sure hallucinate text.

I wonder if how feasible it would be to have mid journey mark the points where text should be, then pass it off to GPT to propose the text to write.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#100
post #61

Until We started to see LLMs, and the tools that can be created with them, I doubted the possibility of Star Trek's Voice command system. Asking for the computer to clarify some concept, or filter and reduce data sets based on arbitrary data was pure science fiction. Seeing something like this makes me think that the arbitrary holodeck commands "Paris, 1950's, rainy afternoon" is suddenly not a challenging part of th…

Here's an image result from MidJourney for "Paris, 1950s, rainy afternoon". No additional editing, and I intentionally avoided adding any text to the prompt beyond your own. https://i.imgur.com/IYuh29H.png Not perfect but man, we're getting pretty close.

[deleted]
Post reply on HN