By around the 6th to 9th month, they should be able to have the
strength to hold their own heads up.
Anytime before that, best to support the head with your
hands.
And for goodness sake, never ever play those "throw the baby up and
catch them" games when they are 1 year old and less
No vigourous shaking of the body too before they are one year
old.