If I were in your situation, I would do everything to protect my children also. When it comes to them and their safety, making sure they grow up to make the right choices and be responsible, happy, successful little people, legalities are only thought of once. Why do you think there are so many pictures of missing mothers and their own children on the milk cartons? Mothers are doing whatever they can to protect their children. I give you kudos for dealing with this they way you are rather than taking off with them. Their dad needs help. It wouldnt help him to not be able to see his kids, it may even push him over the edge. I would compromise as you are. Let him get back on his feet. You say you can talk to him, what has he said about your concerns about the other people? Does he deny them? Does he understand your concern? Being their father, it seems he would want his kids safe also, but alcoholism is a terrible disease and can cloud judgement. Kids learn what they see growing up, I am a true believer in that due to the fact that my father was abusive, HIS father was abusive, and my two older brothers are the same. They saw my dad being that way, they thought it was the way they were supposed to be and it was "normal"...sad. Does he have family that would help him?