Tobago (as in Trinidad and Tobago) is off the beaten track and rarely mentioned, but might meet a lot of your criteria. I have been to Trinidad some time ago (work.. not pleasure, but very pleasurable and a truly unique Caribbean experience). I'd love to go back and explore Tobago and the diving.
Why Tobago is a Standout Caribbean Dive Destination