If he fails to appear for a criminal case, or a warrant is issued for his arrest because of whatever crime he committed (I presume he attacked you), then he could be arrested. If you fail to appear at any restraining order court hearing and were under subpoena, you might be subject to criminal sanctions yourself. Might the restraining order be dropped, sure. But, if he committed a crime against you it may well come to pass that the court will issue such an order anyway. And, before you run back and tell the court that it was all a mistake you might want to consult an attorney because you might be confessing to a perjury or making a false police report if you suddenly decide to change your story.
And, do you have any idea how many victims of domestic violence say the same things that you have? Many ... some of which are now dead. I strongly recommend you speak with an advocate or counselor before you seek to remove the only thing that might protect you from further abuse.