Yes. Especially considering you are a California resident when in the US, it gives you even less of an excuse to not wear your seat belt.
Using your argument, a postal worker, garbage truck driver, and any of the other exempted classes of drivers would be able to defend a seatbelt ticket when off duty based on the fact they don't have to wear it all day long while working.
Have your wife remind you of all the laws in California you have to follow that might slip your mind; write a note and stick it on the refrigerator; put a reminder in your phone, ipad, or whatever else you might use. Iphones have a neat thing that you can set the reminder to be based on leaving or entering some specific geographical area. If you could utilize that, when you get back to California, it would automatically remind you you have to wear your seat belt.
Since all cars I am aware of have a seat belt warning light and audible indicator, I really cannot even begin to grasp your argument. That noisy little light is usually adequate to remind most people to buckle up.