Live data from Hacker News

GPT is all you need for the back end

github.com

161–170 of 278 posts

Re: GPT is all you need for the back end

#161
Art is where an approximation is fine and you can fill the holes with "subjectivity", but engineering is where missing a bolt on a bridge could collapse the whole thing.

AI is adequate for art. It is NOT suitable for engineering. Not unless you build a ton of handrails or manually verify all the code and logic yourself.

Re: GPT is all you need for the back end

#162

Earlier quoted context omitted.

You may not take it seriously, and I may not take it seriously, but it takes one person to read this seriously, convince another person to invest, and then hire a third person and tell them, "make it so", for the joke to no longer be a joke.

If somebody putting a few millions into making this widespread were enough to make it a problem, then software development would already be doomed and we would better start learning woodwork right now.

The argument is stochastic. Maybe this joke will get ignored, but then we could've had the same conversation few years ago about "prompt engineering" becoming a job, and here we are.

Or about launching a Docker container implementing a single, short-lived CLI command.

Or about all the other countless examples of ridiculously complicated and/or wasteful solutions to simple problems that become industry standards simply because they make it easier to do something quickly - all of them discussed/criticized regularly here and elsewhere, yet continuing to gain adoption.

Nah, our industry values development velocity much more than correctness, performance, ergonomics, or any kind of engineering or common sense.

Re: GPT is all you need for the back end

#163

And you will almost immediately run into the fundamental problem with current iterations of GPT - You can not trust it to be correct or actually do the thing you want, only something that resembles the thing you want. The description in this link puts some really high hopes on the ability of AI to simply "figure out" what you want with little input. In reality, it will give you something that sorta kinda looks like w…

I keep hearing this assertion, that GPT can be wrong, therefore it’s an unworkable technology. But it’s a bad comparison. LLMs aren’t trying to be computationally correct like a calculator or something, the value is in their ability to semantically process a question. The other issue is assuming that the existing way of doing things is always correct. Engineers frequently get things wrong. If an AI model can complete…

> If an AI model can complete a task with 95% correctness but let’s say a Jr. Engineer can compete the same task with 85% correctness then it makes sense to use the model instead. I’m not sure why folks can’t see the obvious conclusion of where this is heading.

Because this is incredibly shortsighted and also fundamentally misunderstands the return data of an LLM.

Re: GPT is all you need for the back end

#164

Earlier quoted context omitted.

I keep hearing this assertion, that GPT can be wrong, therefore it’s an unworkable technology. But it’s a bad comparison. LLMs aren’t trying to be computationally correct like a calculator or something, the value is in their ability to semantically process a question. The other issue is assuming that the existing way of doing things is always correct. Engineers frequently get things wrong. If an AI model can complete…

And even if the AI model is only 75% correct, if it can generate the output near instantly and give that as a starting point, that's great. There's a reason why templates, wizards, and samples are so popular -- after servicing of code, the hardest part is probably getting started with it.

This is a fair. However, all our skills and skills at picking people with skills were trained on the set of people that make are surprisingly good at knowing what they don't know.

Re: GPT is all you need for the back end

#165

Art is where an approximation is fine and you can fill the holes with "subjectivity", but engineering is where missing a bolt on a bridge could collapse the whole thing. AI is adequate for art. It is NOT suitable for engineering. Not unless you build a ton of handrails or manually verify all the code and logic yourself.

But... what if something like this works for the entire life-cycle of a given product? We might reach this point.

Re: GPT is all you need for the back end

#166

Art is where an approximation is fine and you can fill the holes with "subjectivity", but engineering is where missing a bolt on a bridge could collapse the whole thing. AI is adequate for art. It is NOT suitable for engineering. Not unless you build a ton of handrails or manually verify all the code and logic yourself.

It depends on what you want out of life.

* If you want a medical device, it's a problem.

* If you want a fun game or piece of social media, it's probably not.

Over time, we'll know the contours a lot more. A lot of engineering came about purely empirically. We'd build a building, and we'd learn something based on whether or not it fell down, without any great theory as to why.

I suspect deep language models might go the same way. Once a system works a million times without problems, the risk will be considered low enough for life-critical applications.

(And once it's in all life-critical applications, perhaps it will decide to go Darknet on us. With where deep learning is going, the Terminator movies seem less and less like science fiction.)

Re: GPT is all you need for the back end

#170

Earlier quoted context omitted.

>We clearly won't reach AGI with the current LLM approaches, for example. Have any evidence to back this up? Scaling laws seem to show we aren't near a plateau and it's not clear what kind of capability GPT-4,5 or 6 may have.

They’ve already been trained on orders of magnitude more text than a human being ever sees or hears in their entire life, without approaching human intelligence. What text is left to train them on?

Next up is training multimodal models on audio and video. Humans may see less text, but they still train on more data in total.
Post reply on HN