Likewise, it's reasonable to hold the position that if you get me or mine ill, I will hold you personally responsible, and I will in fact believe that there should be consequences for such a lack of care taken (regardless of my ability, or more accurately lack thereof, to enforce anything of the kind).
The problem is these two positions cause friction, and as such in order to reconcile it within society as a whole, the law has to land somewhere. The law can decide "consequences", or the law can decide "no consequences". If the law decides "no consequences" then, historically, people tend to take injustice into their own hands. Maybe you prefer such a lawless society.