I think maybe they are being polite. The pastor usually asks new
people to raise their hands. If you raise your hand, you will be
showered with attention. If you don't, I think people just accept
that perhaps you don't want the attention and give you space.