Live data from Hacker News

Using ChatGPT to generate a GPT project end-to-end

github.com

211–220 of 225 posts

Re: Using ChatGPT to generate a GPT project end-to-end

#211

Earlier quoted context omitted.

"... and there are unknown, unknowns..."

Not exactly sure why you bring this up but tangentially this is actually a really good prompt to use with GPT. Ask it a question but tell it to list the known knowns, known unknowns and unknown unknowns before replying. The unknown unknowns part usually generates some interesting follow up questions.

I lit ask it ; tell me what I am not asking or propose BETTER SCHEMA, or table. and it usually suffices.

Re: Using ChatGPT to generate a GPT project end-to-end

#212

Earlier quoted context omitted.

Not exactly sure why you bring this up but tangentially this is actually a really good prompt to use with GPT. Ask it a question but tell it to list the known knowns, known unknowns and unknown unknowns before replying. The unknown unknowns part usually generates some interesting follow up questions.

I lit ask it ; tell me what I am not asking or propose BETTER SCHEMA, or table. and it usually suffices.

GIVE ME A BETTER SCHEMA FOCUSED OR SORTED BY X

SUMMARIZE THAT AND PRODUCE CSV FOR X

CONSTRAIN TO CALIFORNIA

CREATE TABLE FOR EACH COUNTY LIMIT 3

JOIN THAT WITH OTHER RESOUCES

Re: Using ChatGPT to generate a GPT project end-to-end

#213

Earlier quoted context omitted.

It also has a very broad knowledge of programming languages and frameworks. It's able to onboard you with ease and answer most of qour questions. The trick is to recognize when it's confidently incorrect and hallucinating API calls.

But that's the secret, it's always hallucinating

What do you mean when you say this? Most people use hallucinate to mean "writes things that aren't true". It clearly and demonstrably is able to write at least some code that is valid and write some things that are true.

Re: Using ChatGPT to generate a GPT project end-to-end

#214
post #200

Earlier quoted context omitted.

So what if you don't "just put it into a loop and hope" but actually make a complex AI agent with static code analysis capabilities, a graph DB, a work memory etc? I'm doing just that and it works surprisingly well. Currently it's as good as people with 2-3 years of experience. Do you really believe it's not going to improve? Now I'm making a virtual webcam so it has a face and you can talk to it on a Zoom meeting...

Do you have a presentable demo? LLM augmented by static code analysis sounds very interesting

I don't have GPT-4 API access yet... Using my ChatGPT Plus subscription so far. Will make a release once I get the API.

Re: Using ChatGPT to generate a GPT project end-to-end

#215
post #177

Earlier quoted context omitted.

What programming language do your stakeholders use to communicate their ideas during planning meetings? Unfortunately, mine can only speak English…

The issue in this is that they speak english, think english, want X in english. But in reality need Y. ChatGPT will not help with that.

The point is that the roles are reversed not that you give ChatGPT to the stakeholders. ChatGPT is a programmer you hire for $30/month and you act as its manager or tech lead.

This is pointless to argue though since it’s apparent there are people for which this just doesn’t fit into their workflow for whatever reason. It’s like arguing over whether to use an IDE.

Re: Using ChatGPT to generate a GPT project end-to-end

#216
post #213

Earlier quoted context omitted.

But that's the secret, it's always hallucinating

What do you mean when you say this? Most people use hallucinate to mean "writes things that aren't true". It clearly and demonstrably is able to write at least some code that is valid and write some things that are true.

These models don't have a frame of reference to ground themselves in reality with, so they don't really have a base "truth". Everything is equally valid if it is likely.

A human in a hallucinogenic state could hallucinate a lot of things that are true. The hallucination can feature real characters and places, and could happen to follow the normal rules of physics, but they are not guaranteed to do so. And since the individual has essentially become detached from reality, they have no way of knowing which is which.

It's not a perfect analogy, but it helps with understanding that the model "writing things that aren't true" is not some statistical quirk or bug that can be solved with a bandaid, but rather is fundamental to the models themselves. In fact, it might be more truthful to say that the models are always making things up, but that often the things they are making up happen to be true and/or useful.

Re: Using ChatGPT to generate a GPT project end-to-end

#217
post #213

Earlier quoted context omitted.

What do you mean when you say this? Most people use hallucinate to mean "writes things that aren't true". It clearly and demonstrably is able to write at least some code that is valid and write some things that are true.

These models don't have a frame of reference to ground themselves in reality with, so they don't really have a base "truth". Everything is equally valid if it is likely. A human in a hallucinogenic state could hallucinate a lot of things that are true. The hallucination can feature real characters and places, and could happen to follow the normal rules of physics, but they are not guaranteed to do so. And since the i…

I think this is a great way to think about it. Hallucinations are the default and an LLM app is one that channels hallucinations rather than avoids them.

Re: Using ChatGPT to generate a GPT project end-to-end

#218

Cool -- I did something similar with the goal: Imagine and simulate an instrument that doesn't exist and ended up with this -- it even created the assets or prompts for other AIs to make assets where it couldn't, including the model https://pwillia7.github.io/echosculpt3/

Seems like this type of spherical instrument exists and this seems like a mash up of this https://images.app.goo.gl/oW38YzoYMQUndH7Z9 And a hang https://images.app.goo.gl/TTJ9uLiiRYoNZNtX8

Re: Using ChatGPT to generate a GPT project end-to-end

#219

Earlier quoted context omitted.

That could end up in getting better and better special-purpose expert systems. How do you create better and better general-purpose AIs this way? What is more, when the AIs are more advanced, it might be challenging to create meaningful tests for them (outside of very specialized domains).

My point with the race analogy was you score it on the outcome (time) not a factor (horsepower). For your concern, just make the outcome broader. Someone will still say it’s not AGI as it does 100 different remote jobs, but just plan on ignoring them. Something that scares me is people don’t want to believe this is where we’re headed or it’s even possible. I say this because I think your concerns are easy enough to a…

The "easy" optimization targets I have mentioned (tokens/memory/etc.) seem to confuse you. Ignore them for the main point - how do you create good tests for a more advanced AI than you yourself are (or have control of)? For so many human fields of knowledge and ability it is already extremely hard to find meaningful tests to rank humans. No amount of letting an AI optimize on games with fixed and limited rules will automatically improve them on all the other abilities, which are not easily testable or even measurable. And that difficulty pertains for human intelligence trying to measure or test human intelligence. How much more difficult would it be for humans to measure or test super-human intelligence?

Re: Using ChatGPT to generate a GPT project end-to-end

#220

Earlier quoted context omitted.

I use GPT-4 with ChatGPT daily for coding. Here’s what I’ve found works for making the most out the limited prompts OpenAI gives you. - When you first start, tell ChatGPT about the limitation. Example - “I’m only allowed to send you 25 prompts every 3 hours. As a result, I need you to keep track of the messages I send you. At the end of each response you give me, please tell me how many prompts I have left, ex: this…

Request for a message cap increase. I think they go up to 100 but it depends on what you are doing.

Was there a form/email/person you contacted to do that? I can't find any such information online.
Post reply on HN