Live data from Hacker News

Using ChatGPT to generate a GPT project end-to-end

github.com

131–140 of 225 posts

Re: Using ChatGPT to generate a GPT project end-to-end

#131
post #120

Every post that claimed using ChatGPT to achieve non-trivial tasks turned out to have non-trivial human intervention. > (from the original article) In fact, I found it better to let ChatGPT generate a toy-ish version of the code first, then let it add things to it step-by-step. This resulted in much better output than, say, asking ChatGPT to generate production-quality code with all features in the first go. This als…

ChatGPT is a junior developer whose knowledge is broad but shallow.

Re: Using ChatGPT to generate a GPT project end-to-end

#132
post #35

Good preview of the near future of software dev, but I’m also wondering of the trend of companies forbids use of AI generated code do to copyright ambiguity. I suppose pressure to reduce cost as and move faster will overcome that concern.

Besides copyright ambiguity, I think a big problem will be security: someone that knows the tech stack and the business model in detail of a bank app, for example, that was generated with ChatGpt would be able to use ChatGpt to generate for him the same (or similar) code. This would turn any ChatGtp app almost in an open source app, no? And once you know the details of the implementation it's easier to find the security holes in it.

Re: Using ChatGPT to generate a GPT project end-to-end

#133
post #120

Every post that claimed using ChatGPT to achieve non-trivial tasks turned out to have non-trivial human intervention. > (from the original article) In fact, I found it better to let ChatGPT generate a toy-ish version of the code first, then let it add things to it step-by-step. This resulted in much better output than, say, asking ChatGPT to generate production-quality code with all features in the first go. This als…

Ok but this is extremely new tech, all of that stuff will get better over time, and the AI will require less and less intervention.

I don't think so. Ultimately there's not enough information in prompts to produce "correct" code. And any attempt to deliver more information will result in a worse programming language, or as it is now, more iterations.

Re: Using ChatGPT to generate a GPT project end-to-end

#134

Earlier quoted context omitted.

Lmao neither of those things I mentioned really cost more than 50 million dollars.

I personally think the same as the other comment. Do you really think money is the bottleneck? Let’s assume Sam Altman felt that way. He couldn’t drum up that cash tomorrow if he wanted??? For the pinnacle of human invention. Twitter was purchased for way way more than 50 mil.

Yes? He's invested in GPT-4 which just came out. He needs to retrain a new model with higher context limit as well as build out memory systems probably with vector databases. OpenAI needs to continuously raise money and buy more hardware. I'm not sure what OpenAI is doing but they're obviously resource constrained, else they wouldn't be outpaced by competitors in text2img.

He probably doesn't want to give away more of his company since it's such an obvious winner.

Re: Using ChatGPT to generate a GPT project end-to-end

#135
post #133

Earlier quoted context omitted.

Ok but this is extremely new tech, all of that stuff will get better over time, and the AI will require less and less intervention.

I don't think so. Ultimately there's not enough information in prompts to produce "correct" code. And any attempt to deliver more information will result in a worse programming language, or as it is now, more iterations.

Seems like if it can eventually test that the output meets the criteria then it will excel.

Re: Using ChatGPT to generate a GPT project end-to-end

#136
post #125
post #121

I directed chatGPT to code https://chrome.google.com/webstore/detail/franz-ai-text-rewr... a chrome extension which rewrites any content in place on any website. not a single line of code was written by me by hand. but damn many prompts.

Sometimes it's really hard to say "damn many prompts" is better than writing on your own.

One of the most frustrating about this approach is that it feels asymptotic, you’re always approaching but never arriving at a solution. You start seeing diminishing returns on further prompting.

It’s great for scaffolding, but not that great for non-trivial end-to-end projects.

Re: Using ChatGPT to generate a GPT project end-to-end

#137

I had chat gpt 3.5 build a small web app for me too. I have since been building some tooling for this sort of GPT-assisted programming. https://github.com/paul-gauthier/easy-chat

How good was the process? I've had GPT3.5 teach me how to make a watchOS application to control a BLE device, and after a couple evenings I have one working on my watch right now. On the bright side, it gave some concrete hands-on guidance that I just wasn't been able to get from Apple documentation. It quickly gave me enough pointers to make things click in my head. While I've never wrote a single line for any Apple…

My experience was similar. I am most comfortable coding in python, and my html/css/js skills are not strong. I don't have the patience to stay current with frontend tools or to bash my way through all the stack overflow searching that it would require for me to code frontend stuff.

So with that context, I was able to have chatgpt do all of the heavy lifting of building a webapp. I was able to build my wish list of features like immersive reading with synchronized sound and word highlighting. Stuff that I probably wouldn't have had enough motivation to complete on my own.

But the architecture of the code is poor. It repeats itself and would be hard to maintain. I think much of this could be improved by spending more time asking gpt to refactor and restructure. The same way a senior developer might provide feedback to a junior dev's first coding project. I did some of this along the way, but that code base needs more if it were to be an ongoing project.

Re: Using ChatGPT to generate a GPT project end-to-end

#138
post #65

Earlier quoted context omitted.

Calm down. It is a language model . People have figured out how to predict the next word for a given prefix. That's very cool and it will definitely have a significant impact on software. But it is not artificial intelligence.

I am becoming somewhat of a broken record, but sigh.. To predict the next token you must reason or have some process that approximates it. “Given all these various factors, the most likely resolution to our conundrum is: …” Good luck doing that with any kind of accuracy if you lack intelligence of any kind. Language is a distraction. These things reason (badly, atm). It is totally unclear how far this goes. It could…

It clearly does not reason. Take a famous riddle and make a paradox change. It will not create a meaningful response.

But yes, there is a lot of knowledge embedded into our global use of language and it is fascinating to see how it can be reproduced by such a model.

Re: Using ChatGPT to generate a GPT project end-to-end

#139
post #133

Earlier quoted context omitted.

I don't think so. Ultimately there's not enough information in prompts to produce "correct" code. And any attempt to deliver more information will result in a worse programming language, or as it is now, more iterations.

Seems like if it can eventually test that the output meets the criteria then it will excel.

But when the code doesn't meet the requirements, the AI needs to know what's incorrect and what changes it needs to make, and that still requires a human. Unless you just put it into a loop and hope that it produces a working result eventually.

Re: Using ChatGPT to generate a GPT project end-to-end

#140
post #65

Earlier quoted context omitted.

Calm down. It is a language model . People have figured out how to predict the next word for a given prefix. That's very cool and it will definitely have a significant impact on software. But it is not artificial intelligence.

So you are 100% certain that no emergent properties can develop from a LLM that transcends the limitations of LLMs. I haven’t read any LLM literature, so I am honestly asking, do you know of anything close to a proof that such emergent properties cannot develop?

If course, there can be emergent properties. It will be fascinating to watch this research. But it is not going to develop another model that is even more capable.
Post reply on HN