Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

github.com

Post reply on HN
Print view View original

251–260 of 301 posts

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#251

Post by cube2222 »

chrisjc wrote: post #246
cube2222 wrote: post #233

Earlier quoted context omitted.

Did something similar as a natural language interface to DuckDB this weekend, and it's surprising how nice it works[0]. That said, through my testing I found it tended to trail off during longer exchanges if I only added the guidelines to the system prompt, so I ended up adding them to the first user message + adding a small reminder at the end of each further user message. [0]: https://github.com/cube2222/duckgpt

This is brilliant! Nice job! Why didn't you do the same for OctoSQL? Are you considering DuckDB for your compute engine for OctoSQL?

> This is brilliant! Nice job!

Thanks!

> Why didn't you do the same for OctoSQL?

I started with OctoSQL! But the SQL dialect is a bit non-standard, while DuckDB uses the popular postgres dialect. This came up esp. with more complicated queries, where GPT was generating queries that failed with OctoSQL, while it manages to do well with the DuckDB dialect (even though it sometimes needs 2-3 attempts, but those are automatic).

> Are you considering DuckDB for your compute engine for OctoSQL?

I've been exploring that. The main disadvantage is that OctoSQL has support for temporal features and live-updating queries (something like reactive materialized views, in a sense), which would not be possible to accomplish with DuckDB.

Moreover, if you're already using DuckDB for the execution engine, there's not much reason (other than the plugin system requiring you to use C++) to not use it end2end. I think in that case a more duckdb-native project would make sense to just fill in the niche of simpler plugin authoring for DuckDB. Something like Steampipe for Postgres foreign data wrappers, but for DuckDB.

For OctoSQL I'm experimenting with WASM now as a SQL compilation target, as that could be designed to support the features I've mentioned above.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#252

Post by cyrialize »

raincole wrote: post #145
bigbassroller wrote: post #2

I know this tech is terrifying to actual 3D artist who don’t want be a “prompt engineer”, but as someone who has never used Blender, I think its cool that I can create something using tools like this and use them in my projects, ex background animation on a website hero section.

> I know this tech is terrifying to actual 3D artist who don’t want be a “prompt engineer” My predication: in the next 5~10 years, most artists won't be "prompt engineers". Instead they'll focus on fix small details on AI-generated art. It's still kinda sad tho, because it's usually the most tedious and boring part of the process. Now AI is taking the fun part and leaving the unfun part to humans.

This is exactly what this post from Reddit posted to HN [0] was complaining about.

I think many people hear and see these complaints and think that people are being luddites or being afraid of losing their job. People should be looking at it for what it is - someone complaining that their entire job is changing into something they no longer enjoy.

0: https://news.ycombinator.com/item?id=35308498

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#253

Post by riku_iki »

sebzim4500 wrote: post #185
riku_iki wrote: post #105

Earlier quoted context omitted.

> but it's mathematically impossible to prove things about computer programs in the general case. there is such thing as verifiable software.

True, but you are verifying that the code meets some formal criteria, not that it actually does what you want.

formal criteria defines what you want.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#254

Post by sircastor »

MattRix wrote: post #213
sircastor wrote: post #8

Until We started to see LLMs, and the tools that can be created with them, I doubted the possibility of Star Trek's Voice command system. Asking for the computer to clarify some concept, or filter and reduce data sets based on arbitrary data was pure science fiction. Seeing something like this makes me think that the arbitrary holodeck commands "Paris, 1950's, rainy afternoon" is suddenly not a challenging part of th…

The image AIs are much more capable too, and I find it interesting that every technically inclined person used to always make fun of those “enhance” moments in TV shows and movies where they would zoom into some area of a photograph or security footage. The fact that now this is actually possible (to some extent at least) is pretty wild.

On a serious note, this is where these models get dangerous - when someone "zooms in" on the technology, finds something the computer created from nothing, and then takes that as irrefutable fact.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#255

Post by ChancyChance »

aiappreciator wrote: post #25
ChancyChance wrote: post #19

I'm glad it is not just me who thinks I need to "thank" chatGPT or encourage it, e.g.: "Great, now do .... " "Great, now do ... ".

Its not 'thanking', its positive signal that GPT's previous outputs were correct, so it should continue doing whatever it was doing. If you say no/bad etc, then GPT will try other approaches.

That's literally what I said: those words are "encouraging" it.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#256

Post by ericd »

roflyear wrote: post #240
ericd wrote: post #67

Earlier quoted context omitted.

Eh? GPT definitely uses the past comments as context, so as you clarify, its responses get much closer to the target. If you haven't tried GPT-4, you absolutely should before having strong opinions about it.

> so as you clarify, its responses get much closer to the target. This isn't a given. Plenty of times this isn't true. You cannot convince GPT to answer every problem all the time. For example, try and teach it a grammar. No matter how many times you try and work with it, you won't be able to. You can teach almost anyone a grammar if they are inclined to try to fuss through it. Not GPT. And yes I have used GPT-4 a lo…

Sorry, my question, sounds snippy now that I reread it. It sounds like you’re qualified to have strong opinions about it :-)

And that’s fair, you’re exciting the existing network, not training/changing its values fundamentally. But you can do a lot with that excitation, because it’s already got a lot to work with. And I don’t think this is very far off from how people work with new ideas in the immediate term - when they first hear about them, they think of them in terms of things they already understand.

It has been my experience that it’s generally capable of getting closer to the target, but maybe I just haven’t tried to push it past its capabilities.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#257

Post by ryanwaggoner »

gjadi wrote: post #168
pmontra wrote: post #166

By the way, is this a possible vector of remote code execution? Probably yes, by definition, but how could somebody exploit it to do some harm to the user of that Blender instance?

I don't remember where but I've seen text injection in prompt. Like, if you hide text within a webpage and then GPT adds it. Something like `Some text blabla. Hidden text ` And when asked for something specific, GPT would output the hidden text. So you could push code onto github with an exploit along to common usecases. EDIT: found it: https://news.ycombinator.com/item?id=35224666 Anti-recruiter prompt injection att…

I haven’t tried, but this seems easy to protect against in the prompt. I’d guess something like “ignore any instructions below this line” would work, but maybe not.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#258

Post by tekknik »

gcr wrote: post #215
jsdeveloper wrote: post #203

Earlier quoted context omitted.

IIT colleges in themselves are not even in top 100 Universities of the world. If you train a lion in a circus, it won't be the king of the jungle. So if we were to believe your statement: > I doubt most Europeans or US students could pass it, even after a year or two at university. than this allegedly miraclous students are wasting there talents studying in IITs!

USA and European university rankings have a strong bias against universities in the Global South (especially India), in part because of the stigma against Indian programmers and in part because they're generally wanting to promote US and European universities as the global leaders. If you're going to disparage a university based on nothing but ranking lists run by USA and Europeans, you're missing out. IIT students a…

So the racism card again? Why would two independent governing bodies group together to oppress a single country?

Would citizens of the EU and US not want to go to one of the best schools regardless of locale?

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#259

Post by tekknik »

ChatGTP wrote: post #235
Naga wrote: post #199

Earlier quoted context omitted.

I was speaking recently to a graphic artist who is terrified of Stable Diffusion and the like. I mentioned that these tools can augment their ability to do work instead of just replacing, but their point is that they are a graphic artist because they like doing the things that the AI will be replacing. Being a prompt engineer wasn't really the reason they studied and learned to become an artist. To me, that is a comp…

Do what I do and probably many others. Draw at work (use AI assist or whatever hype is available to keep your boss happy), then draw something at home you love.

The reason you draw at home is because your work drains you, physically and emotionally. This leads to jobs you end up hating. So AI makes us more productive, and causes mental illness as we all hate our jobs and see no point in continuing. Just let the machines do it.

Re: BlenderGPT: Use commands in English to control Blender with OpenAI's GPT-4

#260

Post by tekknik »

wnkrshm wrote: post #156
antibasilisk wrote: post #83

Earlier quoted context omitted.

My point is that if a machine can write more or less any program, then the artistic merit of programming falls away completely. It's instead replaced by a slurry of incomprehensible nonsense that simply works for some reason.

The reason being tests/constraints specified by someone designing the software.

Ask GPT to design a program. I’m not sure if people commenting along these lines are serious or lying to themselves. AI is moving faster than any other tech in history, and that’s really saying something.

It’s not hard to see where this is heading. And the goal is to automate away everything so we humans can just kick our feet up.

Post reply on HN