If you left town with your child, and you went far away (not just to the next town, I'm talking AWAY - like thousands of miles away) I have serious doubts that this man would spend a whole lot of time looking for you. Why? Because my guess is he wasn't doing burglary in an imitation of Cary Grant in "To Catch A Thief". My guess is he did burglary to maintain his drug habit. He won't want anything to get in the way of that - including a multi-state hunt for you. (I know these things, because long ago, I had a crazy, ex-con bf too. He was full of big talk, but really lazy on the follow thru if dope got in the picture).
However, like IIAL mentioned, you wouldn't be able to apply for state aid for your child, either, and since you're only 19, that's going to be a problem.
Hopefully, if you stay and go to court, you can show the judge that you have a wonderfully stable environment and support system for you and your child, and find as much evidence as you can get your hands on as to the instability of the baby's father. If push comes to shove, try to get supervised visitation, so at least you can feel safe he won't take off with her in some overwrought drama.
Oh, and I'd wait and let HIM try and establish paternity, because he might not even want to cough up the money for the test. You could get lucky.