Live data from Hacker News

An AI Vibe Coding Horror Story

tobru.ch

11–20 of 224 posts

Re: An AI Vibe Coding Horror Story

#11
post #3

Do you think if the agency hired a consultant to build this , a consultant couldn’t have made the same mistakes? Lack of security theater is a good thing for most businesses

Usually they would just use an off the shelf product and extend it, so they wouldn’t produce the absolute horror story described in the article, no.

I’m not even sure what your last comment means, are you contending that it is a good thing this company violated multiple laws with sensitive patient data?

Re: An AI Vibe Coding Horror Story

#12
post #10

Kinda crazy but hopefully the future holds a Clippy-esque thing for people who don’t know to set up CI, checkpoints, reviews, environments, etc. that just takes care of all that. It sorta should do this anyway given that the user intent probably wasn’t to dump everyone’s data into Firebase or whatever. I personally would like this as well since it gets tiring specifying all the guardrails and double-checking myself.…

This problem is unrelated to CI and dev practices etc, this is about trusting the output of generative AI without reading it, then using it to handle patient data.

Vibe coding is just a bad idea, unless you’re willing and able to vet the output, which most people doing it are not.

Re: An AI Vibe Coding Horror Story

#13
What would a responsible on-boarding flow for all of these tools look like?

> Welcome to VibeToolX.

> By pressing Confirm you accept all responsibility for user data stewardship as regulated in every country where your users reside.

Would that be scary enough to nudge some risk analysis on the user's part? I am sure that would drop adoption by a lot, so I don't see it happening voluntarily.

Re: An AI Vibe Coding Horror Story

#16
post #3

Do you think if the agency hired a consultant to build this , a consultant couldn’t have made the same mistakes? Lack of security theater is a good thing for most businesses

There's lack of security theater and there's:

> All "access control" logic lived in the JavaScript on the client side, meaning the data was literally one curl command away from anyone who looked.

They are not the same thing.

Re: An AI Vibe Coding Horror Story

#17

I did something similar to a local company here in Spain. Not medical, but a small insurance company. Believe it or not, yes, they vibecoded their CRM. I sent them an email and they threatened to sue me. I was a bit in shock from such dumb response, but I guess some people only learn the hard way, so I filed a report to the AEPD (Data protection agency in Spain) for starters, known to be brutal. I've also sent them a…

> [burofax is] a service that allows you to send a document with certified proof of delivery and confirmation of the date of receipt, and this confirmation has legal validity

Re: An AI Vibe Coding Horror Story

#18
post #10

Kinda crazy but hopefully the future holds a Clippy-esque thing for people who don’t know to set up CI, checkpoints, reviews, environments, etc. that just takes care of all that. It sorta should do this anyway given that the user intent probably wasn’t to dump everyone’s data into Firebase or whatever. I personally would like this as well since it gets tiring specifying all the guardrails and double-checking myself.…

This problem is unrelated to CI and dev practices etc, this is about trusting the output of generative AI without reading it, then using it to handle patient data. Vibe coding is just a bad idea, unless you’re willing and able to vet the output, which most people doing it are not.

Fully agentic development is neat for scripts and utilities that you wouldn‘t have the time to do otherwise, where you can treat it as intput/output and check both.

In these cases you don’t necessarily care too much about the code itself, as long as it looks reasonable at a glance.

Re: An AI Vibe Coding Horror Story

#19
post #10

Kinda crazy but hopefully the future holds a Clippy-esque thing for people who don’t know to set up CI, checkpoints, reviews, environments, etc. that just takes care of all that. It sorta should do this anyway given that the user intent probably wasn’t to dump everyone’s data into Firebase or whatever. I personally would like this as well since it gets tiring specifying all the guardrails and double-checking myself.…

This problem is unrelated to CI and dev practices etc, this is about trusting the output of generative AI without reading it, then using it to handle patient data. Vibe coding is just a bad idea, unless you’re willing and able to vet the output, which most people doing it are not.

It is related to CI and dev practices etc. A experienced developer using AI would add security/data protection, even when vibe coding.

Re: An AI Vibe Coding Horror Story

#20
post #6

Hard to believe... This activity should certainly land you in a German prison?!

since its a .ch domain, i believe its in swiss. In germany we have our DSGVO (GDPR), and you can report it too. If a breach happen, you have to inform all your customers. if its a first time and you tried to your own best, the punishment is not that hard, but since these are medical infos they should have known better.

Lets really hope they learned from their mistakes

Post reply on HN