Live data from Hacker News

Debunking Devin: "First AI Software Engineer" Upwork Lie Exposed [video]

youtube.com

41–47 of 47 posts

Re: Debunking Devin: "First AI Software Engineer" Upwork Lie Exposed [video]

#41
post #31

Earlier quoted context omitted.

No one should do business, or collaborate academically, with anyone associated with the video or company again. To co-author with anyone involved with this is misconduct, and every University should be aware of that - they are liars, they cannot be trusted to do research. The VC's should retrieve all unspent cash and sue the founders. They can reflect on what they did looking at the canvas of the inside of their tent…

I disagree. There are no actual lies in the video itself, and I don't think that, for example, the engineer who is narrating the video is responsible for writing the description of the video (which is where the actual lie was). The person (probably in marketing) that made the false claim is at fault, and any manager involved who did not stop the lie is at fault. The software developers who are working on Devin's code…

I had an example at work recently where this happened - so I agree with you. You objected, which was right.

I rang the customer and explained the misunderstanding. I discussed the problem with the sales folks and it was agreed that this shouldn't have been said.

I feel ok about it, there was an exaggeration, I corrected it, we moved on.

That's where the difference is. If the developers and the narrator were unaware that these were lies then they should have been aware. If they were aware then they should have objected. I see no evidence that they objected.

Re: Debunking Devin: "First AI Software Engineer" Upwork Lie Exposed [video]

#45
post #33

From the youtube comment section: > I really hate how normalized faking it in demos has become I fully agree!

but that is the difference between raising millions or not of course founders are going to lie and make up faked tech demos feels like we are close to a Minsky Moment for AI bubble

What signals would look for and which delay would you expect from each to the actual pop?

PS: totally not asking to know when to sell my shovels, I mean NVIDIA stocks.

Re: Debunking Devin: "First AI Software Engineer" Upwork Lie Exposed [video]

#46

An extremely solid and convincing rebuttal. Sad. I wonder what the Devin team will say in response, if anything. Summarizing the video: • Devin is sold as being able to solve arbitrary Upwork tasks. In the video demo the problem it was asked to solve doesn't match the stated requirements of the customer (who asked for setup instructions, not code). • Devin is shown fixing errors in the source of a GitHub repo, but th…

Hearing this just makes me sick.

Like how fake you wanted to be.

Also > Devin does nonsensical shell commands like `head -n 5 foo | tail -n 5`

Why is Devin executing this code, like why?

Post reply on HN