A recipient who becomes unhappy with their payee can request that someone else be appointed to serve as payee. It is always best to have a replacement payee in mind. SSA must provide assistance in locating a payee if you are unable to do so or have no local contacts in the community. Each SSA office must maintain a list of individuals and agencies in their area who are willing to provide payee services.
REPRESENTATIVE PAYEE RESPONSIBILITIES - Your representative payee must use your social security funds to meet your basic needs for food, clothing and shelter. Any funds remaining at month’s end must be saved in an appropriate bank account. Your payee must keep your funds in a separate account and keep separate records about the use of your funds. These records must be turned over to SSA for review upon SSA request. Your payee cannot tell you where you must live, how you must live, or what you can or cannot do with funds provided to you. Your representative payee must make reports to SSA about changes in your situation that may affect your monthly benefit. These include change of address, marriage, or divorce. You are also responsible for making these reports to SSA.
CAN I BECOME MY OWN "PAYEE?" - If you believe that you no longer need the assistance of a payee to manage your funds, you can ask SSA to pay you directly. You should provide evidence supporting your request. This evidence can be a letter from your doctor or counselor stating that you are able to manage money and provide for your own basic needs. You may also want to show SSA that you have been maintaining your own checkbook and/or ensuring that your bills are being paid in a timely manner.
This comes from the website I posted. I suggest if you are unhappy with your payee, call SSA and ask if they have a form to fill out or if you can just write a Letter to change payees.
Just because no Judge has ruled you incompetent, doesn't mean your able to handle your own finances. If you think you can ( again ) request it from SSA .