When I dive in freshwater, which is most of the time, I don't rinse. Although if I've managed to coat the thing in mud as well it's more of a spray rinse then soak to try and get it all off. When diving in salt water I like to dunk at the end of the day and usually work the buttons a bit too.
I don't leave my housing unattended in rinse tanks if there are other people around. And if I want to leave it in for an extended soak I usually remove the camera first, which means I'm already home and the soaking is happening in my bathtub.