Live data from Hacker News

Testing GPT 4's code-writing capabilities with some real world problems

tylerglaiel.substack.com

661–670 of 677 posts

Re: Testing GPT 4's code-writing capabilities with some real world problems

#661
post #585

Earlier quoted context omitted.

Yes, we don’t all live in the US.

So you basically don't care about licensing. That's ok for your use case but risky for anything open source of that might be sold around the world.

Not really, there is absolutely no way to show, let alone prove, any of it is written by AI.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#662
post #310
post #256

Earlier quoted context omitted.

This is exactly why I'm so tired of these "can AI write code" think pieces. I assume people writing this crap aren't actual developers. Maybe its management fan-fiction.

see also "the future is no code!" fad of a couple of years ago

Never went away; been hearing about it since msft sold the idea to managers in regards to SharePoint... Fucking SharePoint. They can design their own forms and hook the data up to bits of automation. Like magic for muggles.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#663

Earlier quoted context omitted.

I see it the other way around the senior engineer is expensive and costs a lot 2 juniors are cheap. Who cares if their code is crap they produce it really fast so they find a bug, just fix it quickly. If anything the time a Sr. spends thinking about things to do things "right" is seen as a waste of time. Whereas the jr. will produce an enormous amount of buggy code but they can fix the bugs quickly by just throwing a…

Because as soon as you tilt from producing features to fixing bugs, you are losing traction and your competitors will win and now you are bankrupt. I've seen entire businesses collapse because of this mentality.

Yes, this is also why senior engs get payed so well. Actually if you are junior dev you basically cost money, imo. However a lot of companies hire those in hopes they will make their career and stay longer - especially startups do that, as they can slide on the company culture hook way more. Also they need them as senior engs require equivalents of "secretary" to handle less import things.

I don't mean to sound mean, senior devs are also secretaries of their cto and so on.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#664

Earlier quoted context omitted.

Disagree -- I think chatGPT will make juniors more palatable to hire. ChatGPT will basically give juniors a free pair programmer to baby-sit their work/progress. Why pay extra for senior devs when juniors can become much more efficient thanks to ChatGPT becoming stack-overflow on steroids. I think the wage gap between junior and senior will actually drop massively. I predict teams will keep 1-3 architect level positi…

I think it could go either way depending on the product. For example in app/game/web development where code quantity > quality, hire more juniors who can bust out code with ChatGPT all day. But if you're developing software for medical devices, vehicle control systems, HFT, etc. Then nobody's going to let some college grad using ChatGPT touch it. You'd hire senior engineers who can be responsible for the reliable ope…

Even in the gaming industry. Typically you have people developing an engine, common frameworks... tools that downstream work to lower branches - now I can just type to chatgpt rather than go through requesting/reviewing, see quicker where I mis-designed my "framework" etc... I am afraid it's gonna be not great for junior engs all together.

Every org has varying level of engineers. This technology will make cheap grind, well cheap. We see the progression. With the speed of changes it seems we should all be worried. (as why does it matter despite being last we fell a year after)

Re: Testing GPT 4's code-writing capabilities with some real world problems

#665
post #627

Earlier quoted context omitted.

I predict the wage gap will actually widen. StackOverflow-on-steroids can only give your so much, so seniors will still be in demand for what they do. It's just the competition between juniors will be fiercer so junior wages will drop.

I think dev wages will stagnate across the board. I think the simple existence of the fear of being replaced by never-tiring, always-working AI will subconsciously prime devs to be willing to work for less. Devs have been in a market with a significant shortage of skilled labor; can we say that remains true after GPT hits the mainstream even more than it already has?

Right now? It made a splash but who uses ai for building their software this very moment? Nobody knows how the industry will land on this. Adoption will take time - it's not gonna be a year.

I remember after ruby on rails first demo, next day people had their websites up in ror. Here we will see, but it will be a bigger shift.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#666

Earlier quoted context omitted.

Imagine an LLM tuned to eliminate misunderstanding and ask why at least 5 levels deep… Without fearing to irritate the boss or to create an impression of being not smart, both possibly harmful for human career but irrelevant to unthinking software tool.

I too like science fiction. People keep acting like it will be easy to bolt on things like eliminate misunderstandings onto LLMs and quite frankly I would be incredibly surprised if that happens any time soon.

Eliminating misunderstanding comes down to willingness to ask more questions if you have low confidence. The main reason this doesn’t happen is subordinates afraid to look stupid or lose jobs. None are concerns to an unthinking machine.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#667
post #611

Earlier quoted context omitted.

The unique hard-won skills are what AI can do on the cheap. The more high-level interesting stuff is just creativity, and creativity is a universal human trait. It’s amazing but low value (monetarily). As you often hear on HN, ideas are a dime a dozen it’s all about execution. Well we’re rapidly approaching the time when the execution is essentially free, and done faster and better than humans. A small team of four,…

Care to place a wager where I give your mythical unskilled team the best AI available today against me without AI and we’ll see who can solve a difficult engineering problem? Heck, even a moderately skilled team. Sorry no. AI is impressive but I’ve given it very precise prompts where I describe exactly what I want it to do because I’ve already solved it and the solution it generates is complete and utter horseshit be…

I mean, I was pretty clearly talking about the future, and not the present.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#668
post #401

Earlier quoted context omitted.

Why aren’t you thinking rather that instead of talking to you, “they” would already be talking to the LLM (likely trained on your code, among other data)—while you get 0 total billable workload in the first place?

The issue being that neither they, nor the LLM has the proper model for the problem domain and so don't ask the right questions when trying to extract business requirements. Additionally, this is "stateless" to an extent. There's no architectural plan for how it should work when you have an LLM do it. "We're using X now but there are plans to switch to Y in some number of months." This could lead to making an abstrac…

You don’t need to have a model if you are a sufficiently advanced autocomplete.

Re: Testing GPT 4's code-writing capabilities with some real world problems

#669

Earlier quoted context omitted.

I'm still waiting for the no-code tools that can replace me, the API Glue Coder. They've been promising those since the early 2000's, but I'm still employed. Some stuff has been automated by Zapier, IFTTT and the like, but most of the systems I'm integrating with don't have public APIs.

"I'm still waiting for the automobile that can replace me, the Horse Carriage Driver. They've been promising those since the 1880s, but I've still got passengers in my carriage every day!" Obviously it's a cheeky example, but this would not be the first time in history a previously well-established career was upended in a (relatively) short amount of time. I'm a FAANG dev, I've got skin in the game too and I'm trying…

But horse carriage drivers were never out of a job, because cars still needed people to drive them... (yes, people can drive their own car, but they can also drive their own carriage, so nothing is different there). In contrast, horses were out of a job; do you think we are more like horses than like the people who drive horses?

Re: Testing GPT 4's code-writing capabilities with some real world problems

#670

Earlier quoted context omitted.

don't fall into this mental trap. you can get into recursion quite easily here, and figuring out what to prompt can start from simple general questions - and there is no need for a developer at all, aside from the current limitations of copy/paste/run workflow has to be done manually

Everyone's focused on writing code - is the code even needed when a good enough AI exists? How many of us are writing code to extract 10% more efficiency out of humans, if they go so do we. Also if software development does survive, it's going to look very attractive to all the other unemployed people.

i think currently those 6-figure salaries are looking great for like most of humanity - I don't expect seismic shifts here.

but there is a funny mechanic at play certainly: once some dev work gets cheap as a commodity, demand surges suddenly since at a low enough price point and availability everyone wants to have some need solved that made no financial sense before.

Post reply on HN