No, not at all. A situation could be severe enough where the IRS would take steps to have a court restrict someone from having a passport if they owed back taxes, but it would have to be a very severe situation. In a situation that severe, one would NOT be granted an installment plan.