You are one foolish girl. Such situations
can be eliminated totally, but the lack of love wisdom really
kills. In the first place, why go to his house? A good friend still
doesn't matter that much - but when it comes to ex, it's very much
different.
House = privacy = breed intimacy.
If you see this link here, you will understand where your ex got
his courage and guts to make his advancement.
When he began his initial campaign, if you are not firm enough to
keep your stand, he sensed them and invaded further. The minute you
relent, you are dead and thus the sorry event of today.
Everyone has a devil within. Refusing sex when he is with you
shows that he respected you as his girlfriend and it is within his
mindset to. But the minute he drop this facade - he is reduced back
to a man, no longer a boyfriend. Why doesn't he wants sex if he
could possible get them? You are too naive. Not saying all men
would do as follow but when the dick holds stronger political
power, the mind follows suit.
Emotions are 24 times stronger than the rational
mind. (Emotions includes lust)
I am quite sure there may be some unresolved feelings between you
and him, which contribute to the lack of barrier and resistance. RP
mentioned you could reject him, but you didn't.
People here are too polite to say anything: Now you want to run
away from your current relationship because you don't know how to
face your bf. I will be brutely honest here: its may not be
them - it's most probably you.
The reason why he didn't ask why is NOT because he don't care -
probably this relationship to him is already meaningless in the
first place. You mentioned that you already initiated two break-up
in a week - either you both patched back almost immediately after
the first break-up or he didn't agree with it.
He would have knew beforehand that you wanted to go; there was
something wrong. A bruised male ego will never question as to
prevent inflicting of further pain. He may/may not know
something - but does it matter when you want to go? The
gulit that pricks you, so you feel that leaving the relationship
will cease the gulit within you?
You are leaving because you want to make yourself feel better, not
for the welfare of the relationship. How do you know he wants to let go of
this relationship? Have he known anything to make any proper
decision for the outcome of the relationship? It's you who
decides because you can't take it emotionally.
You did wrong, you should spill it out and leave the fate of the
relationship in his hands, not yours because your gulit will never
be release through deception. If he feels that he can't take it and
agreed to break-up, your gulit wouldn't remain and the result will
end up the same way. You then should learn your lesson, pick up
your pieces and move on.
If he wants to retain the relationship because he loves you? Will
you be able to make this second chance genuine? Or even then, you
still want to leave? Then, the reason may not be entirely the gulit
- it's your freewill and the strength of your love.
P.S: Are you a pisces? 
Cheers