If he is abusing you then make a police report yourself and get a restaining order. Take a tape recorder to ever meeting and record all the conversations. Get a video camera to record the times he is drunk. Once he has return the child and you see he is drunk, call the police and get them his licence plate number and let them know he is drunk and driving.
Get your evidence together and ensure you document everything. Get back to court and file to change visitation to supervised. Get your childs theropy report as evidence.
ACT NOW !