It's up to you to determine what your criteria for buddy selection are, so I'm not going to bash you for it. If I applied the same rule, it would probably eliminate 95% of the people I buddy with (both friends & instabuddies), and I would have missed out on diving with some great divers (including most if not all of my instructors) and people. Like you I also enjoy the peace & serenity of a solo dive, but there are plenty of times when it's nice to have a good buddy along too
Personally I don't believe that someone who doesn't drink is automatically a good buddy, any more than I believe that someone who does is a bad buddy. I can't understand the logic behind your statement "If find myself diving with people who are drinkers, I go into the water with the knowledge that I am on my own if anything goes wrong" as it implies that they couldn't or wouldn't help you
Frankly I think you're letting your own morals colour your judgement, but that's your call