I don't believe you posted your state.
How you can 'fire' your PD depends on your state.
In CA, you can ask, during your next court hearing, for a 'Marsden' Motion - the court will decide whether you have grounds to fire that particular atty & whether you should be assigned a new PD or panel attorney.
That method may get you a new PD/panel atty or, alternatively, you can advise the PD you want to go 'pro per' & you'll represent yourself at trial.
However, that will probably spark the Judge to inquire as to why you are going IPP and it will develop into a Marsden Hearing, anyway.
(The Judge should clear the court, especially the Prosecutor, from the court while you discuss this, per Marsden Hearing procedures.)
What are you charged with ?
The burden is on the Prosecutor to prove any & every element of a offense involving a DMV violation.
If you're charged with a suspended license, then the Prosecutor should have ordered a 'packet' from DMV which shows suspensions and all notices to you, written or verbal. Your atty should have examined that and can take a copy of it to show you.