I can totally understand how you feel coz your description
sounded just like how I used to be. Sometimes, I would become angry
too but not anymore. I 've learnt to live and let live. Other
peoples' mouths are in their faces. They can say wad they like. You
can't stop them. So the way to tackle them is building up your own
self-confidence. Once you feel very secure, you won't even bother
wad is said behind your back coz you zhuo de wen, zhan de zhi ma.
Let other people judge for themselves whether the rumours about you
are true or not. Ching zhe zhi ching!
If there's no truth in wad's said about you, the rumours will stop
automatically. especially when you dun react, people will get bored
talking about you and stop by themselves! 
