It won't be "brown", but if you haven't masturbated in a very
long time, your semen will appear yellowish as it is highly
impregnated (pardon the pun) with sperm. I agree that if you have
brown sperm you need to seek medical attention, it could be that
your vas deferens has been accidentally wired to your large
intestine.... 
