It's not a matter of being man enuf. Seems that a tough
man who can hold their own will not resort to hitting as the 1st
option. He/She will use wit to diffuse the situation. And he
will not let the situation disturb his mental psyche. So hitting
becomes a last resort (if he is the vengeful type).
For people who have learnt to to be less vengeful (e.g.
christians who know that such situations are but a passing vapour),
they will still use wit, but they will walk away when challenged to
violence because they know that God is the final arbitrator and
avenger and his wrath is unimaginable, and they will carry on with
their lives knowing this.
Thoughts of loosers. I am sure jesus too used violence in church
which was used for trading. So don't use it as an exuse.