Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Using ChatGPT to generate a GPT project end-to-end

github.com

Post reply on HN
Print view View original

151–160 of 225 posts

Re: Using ChatGPT to generate a GPT project end-to-end

#151

Post by killthebuddha »

seunosewa wrote: post #131
rapiz wrote: post #120

Every post that claimed using ChatGPT to achieve non-trivial tasks turned out to have non-trivial human intervention. > (from the original article) In fact, I found it better to let ChatGPT generate a toy-ish version of the code first, then let it add things to it step-by-step. This resulted in much better output than, say, asking ChatGPT to generate production-quality code with all features in the first go. This als…

ChatGPT is a junior developer whose knowledge is broad but shallow.

IMO this leaves out some salient details. For example, I'd say ChatGPT is a very, very good junior developer. The kind of junior developer that loves computer science, has been screwing around with miscellaneous algorithms and data structures its whole life, has a near-perfect memory, and is awake 24/7/365, but has never had to architect a data-intensive system, write future-proof code, or write code for other developers. Of course, these last three things are a big deal, but the rest of the list makes for a ridiculously useful teammate.

Re: Using ChatGPT to generate a GPT project end-to-end

#153

Post by stuckkeys »

ryanSrich wrote: post #123
ineedasername wrote: post #54

This is not really the same, but may be interesting to some: I subscribe to ChatGPT plus for a month to check out GPT-4. The rate limits were cumbersome though and it can be easy to waste a prompt, so I started to bootstrap: I would explain my problem to 3.5 and ask it to suggest comprehensive prompts to use with 4 to maximize my limited quota. It worked very well. In the long years to come the most advance AIs may b…

I use GPT-4 with ChatGPT daily for coding. Here’s what I’ve found works for making the most out the limited prompts OpenAI gives you. - When you first start, tell ChatGPT about the limitation. Example - “I’m only allowed to send you 25 prompts every 3 hours. As a result, I need you to keep track of the messages I send you. At the end of each response you give me, please tell me how many prompts I have left, ex: this…

Request for a message cap increase. I think they go up to 100 but it depends on what you are doing.

Re: Using ChatGPT to generate a GPT project end-to-end

#154

Post by QuantumGood »

Yiin wrote: post #112
hnlmorg wrote: post #66

Earlier quoted context omitted.

I see this as an example of the reverse: AI is still stupid enough that it takes humans a degree of skill to craft a request which generates the desired output.

From what I've seen, the problem is not with the GPT models, but the people themselves. Almost everyday I get multiple unstructured, unclear and often without required context requests from people that I need to iterate back and forth with additional questions to get a clear view what they're trying to achieve. The only thing GPT is "stupid enough" is that it's not prompted to ask questions back to clarify the reques…

I almost always ask it to also ask me clarifying questions.

Re: Using ChatGPT to generate a GPT project end-to-end

#155

Post by CamperBob2 »

rapiz wrote: post #133
MattRix wrote: post #129

Earlier quoted context omitted.

Ok but this is extremely new tech, all of that stuff will get better over time, and the AI will require less and less intervention.

I don't think so. Ultimately there's not enough information in prompts to produce "correct" code. And any attempt to deliver more information will result in a worse programming language, or as it is now, more iterations.

English is a programming language now. That is what is being demonstrated here. Code is still being written; it just looks more like instructions given to a human programmer.

Eventually, human languages will be the only high-level programming languages. Everything else will be thought of the way we currently think of assembly code: a tool of last resort, used only in unusual circumstances when nothing else will do.

And it looks like "Eventually" means "In a year or two."

Re: Using ChatGPT to generate a GPT project end-to-end

#157

Post by UncleMeat »

CamperBob2 wrote: post #155
rapiz wrote: post #133

Earlier quoted context omitted.

I don't think so. Ultimately there's not enough information in prompts to produce "correct" code. And any attempt to deliver more information will result in a worse programming language, or as it is now, more iterations.

English is a programming language now. That is what is being demonstrated here. Code is still being written; it just looks more like instructions given to a human programmer. Eventually, human languages will be the only high-level programming languages. Everything else will be thought of the way we currently think of assembly code: a tool of last resort, used only in unusual circumstances when nothing else will do. A…

English is a programming language once you stop looking at or storing the output of the LLM. Like a binary. I'm not seeing anybody store their prompts in a source repo and hooking it directly up to their build pipeline.

Re: Using ChatGPT to generate a GPT project end-to-end

#159

Post by Matticus_Rex »

hnlmorg wrote: post #66
ineedasername wrote: post #54

This is not really the same, but may be interesting to some: I subscribe to ChatGPT plus for a month to check out GPT-4. The rate limits were cumbersome though and it can be easy to waste a prompt, so I started to bootstrap: I would explain my problem to 3.5 and ask it to suggest comprehensive prompts to use with 4 to maximize my limited quota. It worked very well. In the long years to come the most advance AIs may b…

I see this as an example of the reverse: AI is still stupid enough that it takes humans a degree of skill to craft a request which generates the desired output.

Is that a useful range in which to use "stupid?" Humans are also stupid in that way.

Re: Using ChatGPT to generate a GPT project end-to-end

#160

Post by moffkalast »

bonzini wrote: post #158
moffkalast wrote: post #82

Earlier quoted context omitted.

GPT 4 tells me that on a daily basis because of the 2021 data cutoff.

So it never hallucinates APIs, theorems, biographies or places?

Well I did at one point compare the outputs for two biographies of not very well known people, 3.5 made up half of the data, 4 only said it doesn't know anyone by that name for both. I don't think I ever tried asking about any places or theorems specifically.

As for APIs, well I try to always provide adequate context with docs, otherwise it may still on occasion make up some parameter that doesn't exist or uses another library by the same name. Half the time it's really my fault by asking for something that just isn't possible in a last ditch effort to see if it can be done in some convoluted way. It sort of assumes "the customer is always right" even if it contradicts with what it knows is wrong I guess. It gets it right usually when it's at least mostly straightforward to implement something though.

Post reply on HN