A child exists in this world because he helped create him. He can't get out of his obligation to that child just because he doesn't want to pay.
Your question, however, is whether he can give up his rights. Yes, he can absolutely give up his parental rights. But not his parental obligation.
What do you mean by "he seems to be winning"?