We can't put a prematurely-worn brake line in jail either.
An algorithm cannot BE "careless", in the legal sense of the word. You are comparing apples and oranges. Carelessness (negligence) is a different problem than a design flaw.
An algorithm may be flawed, in which case blame lies with the companies involved in creating it and putting it in peoples' hands. Similarly, any mechanical component of a vehicle can be flawed -- and many can cause an accident if they fail. The companies responsible are legally liable already.
> In the end, we usually determine that the rights of individuals outweigh the utilitarian benefit
Cars. Airplanes. Vaccines. All of these benefit the majority at the expense of a few.
The idea that there is no liability here is absolute and utter NONSENSE. Minimally, Tesla can be sued for the flaw in their product and the harm it caused.