Earlier quoted context omitted.
Would be ridiculously inefficient, while also being nondeterministic and opaque. Impossible to debug, verify, or test anything, and thus would be unwise to use for almost any kind of important task. But maybe for a very forgiving task you can reduce developer hours. As soon as you need to start doing any kind of custom training of the model, then you are reintroducing all developer costs and then some, while the othe…
> Would be ridiculously inefficient, while also being nondeterministic and opaque. Impossible to debug, verify, or test anything, and thus would be unwise to use for almost any kind of important task. Not to defend a joke app, but I have worked in “serious” production systems that for all intents and purposes were impossible to recreate bugs in to debug. They took data from so many outside sources that the “state” of…
GPT is all you need for the back end
171–180 of 278 posts
Re: GPT is all you need for the back end
#172There seems to be an API key/secret in the source code: https://github.com/TheAppleTucker/backend-GPT/blob/main/back...
Re: GPT is all you need for the back end
#173And you will almost immediately run into the fundamental problem with current iterations of GPT - You can not trust it to be correct or actually do the thing you want, only something that resembles the thing you want. The description in this link puts some really high hopes on the ability of AI to simply "figure out" what you want with little input. In reality, it will give you something that sorta kinda looks like w…
I keep hearing this assertion, that GPT can be wrong, therefore it’s an unworkable technology. But it’s a bad comparison. LLMs aren’t trying to be computationally correct like a calculator or something, the value is in their ability to semantically process a question. The other issue is assuming that the existing way of doing things is always correct. Engineers frequently get things wrong. If an AI model can complete…
This is a straw man, I did not say any such thing. I am just pointing out the limitations that people like the author of this article seem to be blissfully unaware of.
Also I would argue that your premise of AI vs a Jr eng is pretty bad. Junior engineers are not writing things to 85% correctness. If they are, they should be let go basically immediately. That's a 15% error rate. I would posit that even the worst human programmers have error rates well below 1% for code that actually ships.
Re: GPT is all you need for the back end
#174I have been thinking of something a bit more on the middle. Since there are already useful service APIs, I would first try the following: 1. Describe a set of “tasks” (which map to APIs) and have GPT choose the ones it thinks will solve the user request. 2. Describe to GPT the parameters of each of the selected tasks, and have it choose the values. 3. (Optional) allow GPT to transform the results (assuming all the AP…
Re: GPT is all you need for the back end
#175And you will almost immediately run into the fundamental problem with current iterations of GPT - You can not trust it to be correct or actually do the thing you want, only something that resembles the thing you want. The description in this link puts some really high hopes on the ability of AI to simply "figure out" what you want with little input. In reality, it will give you something that sorta kinda looks like w…
So, just like people then?
Re: GPT is all you need for the back end
#176Re: GPT is all you need for the back end
#177Even if this is not 100% serious, it is really starting to feel like the ship computer from star trek is not too far away.
The closer we seem to get the farther we actually are. We're far away from AGI, if we even can reach it with our current approaches, but the latest iterations of "AI" are really good at making people believe it'll be there in 2 years
You literally have no way to make that determination.
Re: GPT is all you need for the back end
#178Earlier quoted context omitted.
>We're far away from AGI, if we even can reach it with our current approaches, but the latest iterations of "AI" are really good at making people believe it'll be there in 2 years This is an incredibly bold prediction that isn't supported by the opinions of the majority of people in the field and certainly doesn't have any real backing other than your gut.
Have you seen anybody that works on the field claim that AGI is around the corner? Even the idea that LLMs can eventually get there isn't taken seriously.
Re: GPT is all you need for the back end
#179Art is where an approximation is fine and you can fill the holes with "subjectivity", but engineering is where missing a bolt on a bridge could collapse the whole thing. AI is adequate for art. It is NOT suitable for engineering. Not unless you build a ton of handrails or manually verify all the code and logic yourself.
This should not be surprising: There is a large intersection between engineering and mathematics. And mathematics is art.