When you have finished doing your business (number 2) in the toilet, do you wash hands after pulling boxers and pants up?

This may seem a silly question, but wouldn't it be more clean to wash your hands before pulling up your pants, because then you are getting those germs back onto your trousers, and if you want to pull up your trousers, it doesn't feel good knowing you touched your trosers with dirty hands in the toilet. Also, even worse if you do your belt up before washing your hands and say later in the day you want to adjust your belt (which you don't wash in the washing machine) it would be disgusting. I wash my hands before and after I pull up my trousers, when doing a number 2, just to make sure. And when you take your trousers off you pull them from the waist, the part which is dirty, same when you put on your trousers. So would you wash your hands when you take off/put on your trousers/pants/skirt or whatever. I know this is a different question, but you know these thoughts suddenly come into your head, as you get older. When I was younger I didn't ever think about this, I would just pull up my trousers, wash my hands and get out. Thats because you're always running about and playing as a kid and I can't ever remember thinking about this until earlier this year. I aint worried about getting a disease, but it's just come to my attention all of a sudden. It's just that it feels unclean to pull pants up first. Please give me your view on this as we all do this on a daily basis.

thanks.