That's the crux of the matter, actually. If it does take points off of your license, you will lose it. If not you won't. Big Brother doesn't tend to care whether you're actually hurting anybody. (I must agree, by the way, that it's not good for your hearing.)
Check the law that you're supposedly violating. If it says something like "offensive music" you could argue that you're innocent because the law doesn't specify what music is to be considered offensive. I remind you that I'm not a lawyer and don't live in your state, and you see if there are cases cited around the statute to see if there's any help. Check the library for a copy of the statutes.