That's basically what I do, too. However, I have noted damage to the surface of the lenses. Not really able to state that it is related to accompanying me on dives because I tend to be a bit hard on my glasses anyway. Nevertheless, it is possible that the coating on the lenses are "bubbled" off in a process somehow related to the major pressure changes involved. Doubt the problem is water-related, per se, and as I said, may not even be dive related.
Working with abrasives daily as I do, and also being big, rough and clumsy, I'm pretty hard on eyeglasses myself.
I do toss an old plastic bottle of water in the truck to rinse the salt off my glasses and camera lens. Salt X-stalls are not friendly to any lenses. Usually we freeze several bottles of water to throw in the truck for rinsing and rehydration.