Well, one time, my filming/camera equipment had them shift away
pretty fast.
Being likely to be poked in the face with a 3kg alloy tripod is no
joke. 
Frankly, it has also got to do with the way you carry yourself. If
you are not similar in age, dressing or behaviour as them, they
usually pay you little attention.