This thing would make garbage-in-garbage-out a lot more wide spread … accelerating the ruin of info tech …
What ChatGPT and AI-Based Program Generation Mean for Future of Software
41–50 of 119 posts
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#42So... If it's so revolutionary, why can't I get it to solve level 1 advent of code problems? Like here is what it generates for the 2016 day 1 problem: def find_distance(instructions): x, y = 0, 0 direction = 0 # 0: North, 1: East, 2: South, 3: West visited = set() visited.add((0,0)) instructions = instructions.split(", ") for instruction in instructions: turn = instruction[0] distance = int(instruction[1:]) if turn…
You give an example about how chatGPT is wrong while there exists many examples about how chatGPT is right. And you think the some wrong examples invalidates the possibility of AI ever being better than you? The fact that it's often right is a horrifying omen of the future. chatGPT will not replace you. It is the precursor to the thing that will replace you.
Are you seriously accusing me of cherry picking?
Get it to write you an MD5 hashing algorithm in Rust. Go ahead, I'll wait. I tried and it genuinely couldn't, I asked it tons of different ways and wasted a ton of time before I had to go do it myself lol.
Cool, man. So why don't you get chatGPT to start writing you some software? Or optimize an algorithm? Hey, maybe it'll tackle the travelling salesman problem in polynomial time!
SO many economic and scientific opportunities that will make you wealthy and famous if it's as capable as you claim (eg. Doesn't just solve elementary problems by regurgitating shitty code).
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#43I just don’t feel threatened by AI at all. Maybe I’m not seeing the full picture, but the quality of your software necessarily depends on a constant re-evaluation of customer needs, business priorities, human values, etc. Lots of squishy stuff. Programming is not just taking product requirements and spitting out the correct algorithms.
chatGPT is not a threat. ChatGPT is an omen for the threat that currently exists in the future. A lot of people haven't really played with chatGPT in depth. This thing is next level. It's not just spitting out generic things, there is genuine understanding here and genuine creativity. Here's a snippet from a chatGPT conversation I had based on your post: ME: Give more examples of squishy stuff that software developer…
It's really good a boiling things down to the basics that's for sure, but it's very very basic isn't it?
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#44What kind of basic programming does one have to do to fee threatened by chatgpt? This tool does great at regurgitating basic coding but anything a little more complex is a mix of nonsense and confidence. Do people actually write “leet code” on a daily basis?
It solves real world problems for me on a daily basis; things I hired people for before. There are things like helping with white papers, emails and blog posts. But, to your point, I can give it a little bit of context, let’s say some old Django code we have running in production and ask it to add or change something, and it does, in seconds. Yesterday I had it mostly generate an api with 23 endpoints for a client project in a language & framework I am rusty at (long time ago) for which people on upwork were bidding 1500$ minimal. Took me less than an hour with chatgpt and including docker & docker-compose.
People don’t need to feel threatened; it is simply already replacing all the mundane programming and writing work we used to do; people who can only do that type of mundane work aka crud work (chatgpt can do it in any language or framework), integration, transformation, plumbing etc are already gone.
A lot of our (very well paid) work is taking data, transforming it, sending to some api, get the result, transform it and move to the next step. A few months ago this was just boring human work, now it’s just copy pasting the spec and out it falls. Sure you might need some fixes (as the article says), but not much and it learns (you add new knowledge to the prompt ‘memory’). I have been working with my own custom client on top of chatgpt for months now; it has a lot of custom prompting and effort to make sure it does as well as it can. This I can throw away in a few months when improvements come from their side.
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#45What kind of basic programming does one have to do to fee threatened by chatgpt? This tool does great at regurgitating basic coding but anything a little more complex is a mix of nonsense and confidence. Do people actually write “leet code” on a daily basis?
Same kind of basic programming that was "threatened" by no-code/low-code solutions before that.
It was never to that extend though; chatgpt can change/augment existing code. Nocode/low code solutions cannot do that (in a meaningful way).
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#46Earlier quoted context omitted.
> So... If it's so revolutionary, why can't I get it to solve level 1 advent of code problems? Because it's a nascent technology that hasn't been optimized for solving advent of code problems. It can, however, do a lot of other cool stuff.
Except it should have been trained on probably tens/hundreds of thousands of 2016 advent of code solutions posted on github and other sites, shouldn't it? It often starts hallucinating the input in the exact format advent of code gives, so I'm like 99.9% certain it has been trained on a large corpus of advent of code. Personally I use codex sometimes for debugging help so I agree it can do cool stuff. I just disagree…
What is in the training data and what the model was optimized to do are two totally different things. And even then, tens of thousands of solutions may not be enough to train the model for this specific problem domain.
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#47Earlier quoted context omitted.
You give an example about how chatGPT is wrong while there exists many examples about how chatGPT is right. And you think the some wrong examples invalidates the possibility of AI ever being better than you? The fact that it's often right is a horrifying omen of the future. chatGPT will not replace you. It is the precursor to the thing that will replace you.
Are you seriously accusing me of cherry picking? Get it to write you an MD5 hashing algorithm in Rust. Go ahead, I'll wait. I tried and it genuinely couldn't, I asked it tons of different ways and wasted a ton of time before I had to go do it myself lol. Cool, man. So why don't you get chatGPT to start writing you some software? Or optimize an algorithm? Hey, maybe it'll tackle the travelling salesman problem in poly…
[flagged]
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#48Earlier quoted context omitted.
The threat isn't just from AI, unfortunately, it's from an entire class of powerful people willing to throw their money behind AI instead of behind customer needs, business priorities, and human values.
And who will prompt the AI for these powerful people?
The few people that do the same thing now writing code from client specs or who explain and cut up client specs to their team of programmers. Not many people are good at that, and that won’t be AI for a while yet.
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#49So... If it's so revolutionary, why can't I get it to solve level 1 advent of code problems? Like here is what it generates for the 2016 day 1 problem: def find_distance(instructions): x, y = 0, 0 direction = 0 # 0: North, 1: East, 2: South, 3: West visited = set() visited.add((0,0)) instructions = instructions.split(", ") for instruction in instructions: turn = instruction[0] distance = int(instruction[1:]) if turn…
Seems pretty clear that this question was in its training set and it's regurgitating the answer for part (b). Seems far too coincidental to accidentally get the correct answer to wrong question. For me, it solved part (a) perfectly when I told it: "To solve this, write a Python 3 function that takes a string like `"R4, R3, R5, L3, ..."` and outputs the number of blocks to Easter Bunny HQ." The original question on it…
I mean, it's not N=1 though. Fails day 2 as well, and a bunch of other tasks I've tried to give it. It's weird how some of you are responding that I've cherry picked a single example, I've done a ton of stuff with chatGPT, you can check my comments on prior experimentation with stuff like mathematics and basic problem solving too. Probably spent like 20 hours with it, total?
It genuinely fails 100% of the time at coding anything non-trivial for me, and about half the time for simple stuff. Glad you've been having success though, maybe some people are just better at getting it to work, or it has certain domains it excels in, or your tasks are fairly simple.
Re: What ChatGPT and AI-Based Program Generation Mean for Future of Software
#50See it as augmentation and not a threat. People who went ‘into programming’ and learned the basics and then stood still will have issues, but chatgpt still needs senior or talented developers to do anything useful for now (like juniors, you need to tell it things step by step). But then it’s a great tool, saving a lot of time and money. Just wished it was not owned by a few rich peeps and that training costs will drop fast.