I will suggest you have a hear to heart session with your son
and talk about the issue at hand. If the feelings towards going
further in the sexual relationship is mutual, i say go ahead with
it. Incest maybe a taboo in our social society, but it is not wrong
you both parties choose to go into it together. You don't really
have to care about what others think.
But i must warn you that your son is at the age of exploration. As
he get past his 20 year old mark, he may start to yearn for woman
around his age. You have to prepare to either:
1) let go of him totally
2) use each other as a sexual-comfort tool.
do consider that.