Just to play the devil's advocate for a moment, and I will use a famous case that everyone is familiar with as my example.
Jared Fogel was suspected of child porn and more and the police had a warrant to search his house. Lets pretend that instead of being a rich guy he was a paycheck to paycheck guy, and had his rent money, in cash, in his home. His wife and children were totally innocent and in no way even remotely suspected of committing any crimes, but the police took the rent money, eventually causing his wife and children to be evicted from their home.
Would that have been acceptable behavior by the cops or would that have been unfair to the innocent spouse and children?
Or another example. Lets say your adult son, who does not live with you does something wrong. The police cannot find him and they know you are his parents so they get a warrant to search your home to make sure that he is not there. If they find cash there and they take it, is that right?