If it was me, I would change my name. I would try to distance myself from that man as much as possible.