I mean Emily Harris was his wife. And she seemed to resent his leadership but on the other hand she felt like a good soldier that he had to be the leader.
If all mankind minus one were of one opinion mankind would be no more justified in silencing that one person than he if he had the power would be justified in silencing mankind.