We were actually talking about this a lot this weekend, about the differences between warm and cold water diving. I dive cold water and low viz all the time. It's a pain in many ways. Heavy, clumsy exposure protection, tons of weight, thick hoods, heavy gloves. Heavy gear. Shorter bottom times due to thermal stress. And low viz, although I have to say, I dive in Puget Sound, where there is so much life that you see fun stuff even when you dive with your nose in the bottom.
I have no contempt for people who decide cold water diving isn't for them. But, as everyone else has said above, I'd give it another try in better-fitting gear before you write it off altogether. The biggest reason is that diving is a sport where good skills both make you safer AND make the whole experience more fun, whether you're in warm water or cold. Being comfortable enough in cold water to get out there once a month or so and keep your skills fresh will make your tropical trips far more enjoyable.
