Cool -- I did something similar with the goal: Imagine and simulate an instrument that doesn't exist and ended up with this -- it even created the assets or prompts for other AIs to make assets where it couldn't, including the model
Using ChatGPT to generate a GPT project end-to-end
41–50 of 225 posts
Re: Using ChatGPT to generate a GPT project end-to-end
#42You don’t mention it explicitly, but I assume you’ve manually copied and pasted all the code, as well as the various patches with updates? In my experience, that quickly makes new suggestions from ChatGPT go out of sync with the actual state of the code. Did you occasionally start the conversation over and pasted in all the code you currently had, or did this not turn out to be an issue for you?
I have found with GPT4, this isn't an issue, but you do have to watch it and let it know if it makes up some new syntax. Scolding it will usually get it to correct itself.
The bigger issue for me has been hallucinated libraries. It will link to things that don't exist that it insists do. Sometimes I've been able to get it to output the library it hallucinated though.
It also makes more syntax errors than a person in my experience, but that is made up for by it being really good at troubleshooting bugs and the speed it outputs.
Re: Using ChatGPT to generate a GPT project end-to-end
#43What value does a developer deliver when their entire process is done by an LLM? Is there no desire for a creative process?
TBH, programming has lacked creativity since complilers got within 90% as good as hand-rolled assembly.
Hand-rolled assembly wasn't really fun because you could type it and get a response instantly, rather than the creative good old days of mailing in punch cards and waiting weeks for a result.
Punch cards weren't fun either, because using a computer wasn't creative. Doing math by hand was.
Ad nauseum.
If you think that really fucking excellent portal-opening tools don't enable creativity, you just have a dim view of what creativity is.
Re: Using ChatGPT to generate a GPT project end-to-end
#44>It was more like handholding a fresh grad who had absorbed all of human knowledge but needed someone to tie various parts of that knowledge to create something useful.
10 INT but 0 WIS, that's a good mental model for LLMs.
Re: Using ChatGPT to generate a GPT project end-to-end
#45Cool -- I did something similar with the goal: Imagine and simulate an instrument that doesn't exist and ended up with this -- it even created the assets or prompts for other AIs to make assets where it couldn't, including the model https://pwillia7.github.io/echosculpt3/
A truly 3D instrument, interesting!
Re: Using ChatGPT to generate a GPT project end-to-end
#46It's good at writing new code, with sufficient prompting. But the big open question as of now for engineering orgs is - can it edit existing code like developers, just by instructions. Is there any hands on experience anyone has on copilot-x?
GPT-4 32k can fit a few thousand lines of code into a single prompt and output diff's, patches, and/or the fully modified code. For best results, pasting any relevant documentation into the prompt can help.
Is there word of ane outside big co's getting access to 32k ?
I got 8k access pretty quickly but no word whatsoever about 32k (and my current prompts + context already reach 8-9k tokens)
Re: Using ChatGPT to generate a GPT project end-to-end
#47What value does a developer deliver when their entire process is done by an LLM? Is there no desire for a creative process?
Someone has to type the prompt.
Re: Using ChatGPT to generate a GPT project end-to-end
#48What value does a developer deliver when their entire process is done by an LLM? Is there no desire for a creative process?
Artists are way ahead of you on this.
Re: Using ChatGPT to generate a GPT project end-to-end
#49Earlier quoted context omitted.
The dev gave the initial idea to the LLM. That's the creative process. Everything after that, arguably, is just technical details in order to realize the idea. Sure, implementation requires plenty of creativity, but of different kind.
Believe me, only a dev can get this working. Maybe in the future, LLM wizards will conjure all our technology, but at this point, having a working knowledge of all APIs from 2021 is an assistive technology, not a magical code-machine. I've used LLM to generate a lot of code recently on side projects. It's a 10x jump in productivity, but it can only reliably do 50-80% of the work, and the last tail needs editing, veri…
> [snip]
This is mind blowing. ‘Only 80%’ is a bonkers thing to say.
> For now.
The really scary part, right here.
Re: Using ChatGPT to generate a GPT project end-to-end
#50It's good at writing new code, with sufficient prompting. But the big open question as of now for engineering orgs is - can it edit existing code like developers, just by instructions. Is there any hands on experience anyone has on copilot-x?
Copilot without -x does this relatively well. But it's a hands-on process. I can't just give it some source files and say "go". But it can easily make you 10x. I often spend more time tab-completing than writing.
I'm still trying to figure out how to do this. Copilot is extremely helpful. But more often than not, it suggests completions which would steer the project in another direction.
It is extremely good once the code has been organised and an overall structure exists. But until then it can be a distraction.