Exactly.
Social contract theory can be summarized in one of two ways: the slave's consent and the mobster's choice.
1. In the slave's consent there are three of us and two of us vote to enslave the third who voted against his enslavement. But because he voted he has consented. He would also have consented if he abstained from voting because he had the opportunity to vote and chose not to. So he is not a slave despite the chains and the whippings.
2. In the mobster's choice, the mobster tells the business owner "Pay the protection money or abandon your business and flee" knowing full well that all the other business districts are controlled by mobsters. Because the business owner stays, he consents to pay the protection money.
The only real consent or contract arises when the individual can choose on his own to stay right where he is without being forced to participate in government, but chooses to participate.
In both examples the individual fails to take up arms. The Mobster and the slavers achieve control without the use of force.