I am the same way. No watch on I feel naked.But if I don't have my watch on I'll immediately head back in and get it.
I have been using a Casio Log Memory divers watch since 2000. Pretty much bulletproof other than battery changes. I just started using the Atmos Mission 1 for diving plus I have worn it as a day to day watch. A little bigger than the Casio but works well. I still prefer the Casio for day to day wearing.