It's not a matter of believability. It's a matter of simple logic. If -> Then.
If we leave other people alone then will you leave us alone? This is the condition. Not whether it is 'believable' or not. If your answer is yes, then welcome to voluntaryism.
If you want to put it as an
If -> Then statement than it becomes even easier.
If you don't regulate banks,
Then banks will crash and burn and the property of innocent people will be destroyed in the process.
If you don't regulate polluters,
Then they will poison the environment and innocent people will sicken and die the property of many innocent people will be damaged or destroyed.
If you don't regulate employers,
Then the employees will be harmed and killed by the unsafe working conditions they are compelled to work in.
If you don't regulate manufacturers,
Then then they will produce unsafe products that sicken, injure, and kill, innocent customers.
Deregulation is, in and of itself, an act of aggression with either the intent to harm or best case the reckless disregard of harm to innocent people.
And so you make it clear that doing harm is either your intent, or something you completely disregard in your designs. But you don't have the right to harm people by intent, and you don't have the right to harm people through reckless disregard for their safety.
You are not going to leave others alone. So you don't have the right to have your potential victims leave others alone.