For some loveless reason, you were forcefully being married. Not
even a sign of revoking it, even till after the ceremony. He
control you over the sake of baby and made you leave your ex -
Which I presume you had a sexual relation with him when you are
still with your ex? 
Few points which your husband is childish and immature: playing
committing suicide, possessiveness and insupportive.
This relation is not borned out of mutual love - rather for the
sake of children involved. It is perfectly alright to get married
with love without kids, than without love and with kids. - it is
dreadful. This relation is already shaking even before you both
were married, and made worst when the both of you were together. He
has found another girl whom he is chasing or have already chased -
he is MARRIED for god sake... no longer a boy-girl relationship,
which only further signalled that he is not ready to be in a
marriage yet.
1) Committment is not there
2) Mistrust is around.
3) Only feeling is responsible?
Responsiblity? Get married for responsible sake? Are you sure this
is the marriage you want? The Man you want to spend the rest of
your life with? Totally devoid of any single mote of love?

Kids... the kids are innocent party and the more you should protect
them from harm instead of throwing them, etc. They came into this
world, not knowing WHY they came - how could you bear to destroy
their lives? Just for the sake of arguement with your husband and
to spite him? Please spare thoughts for them. 
'Scolding him to get revenge... he hurting you physically...' this
marriage is in needs of professional help, the elements of
mantaining this marriage is not there and furthermore your husband
is not very supportive, together with your reckless actions - its
is MORE than just plain self reflection to work through. To
surmount it - you need assistance. PROFESSIONAL ones, not words and
comments from friends, relative, etc. 
Recognise it now and seek help, before it could be too late to do
anything. 