I certified a few years back in Antigua (online course and then we were visiting a friend, so I took the pool/open water sections there) - we were on the west side of the island for those dives, and they were beautiful and full of life. Eagle rays, etc. were everywhere. Haven't been there for about 10 years or so, though, but hoping to go back. We used a little beach shop called "Jolly Divers" and they were great.
Puerto Rico is our home during the winter, and the SW area (Parguera/Lajas), Vieques and Culebra Islands to the east, and Desecheo Island are all really fun and beautiful dives.
We dove the Exumas with the Aggressor out of Nassau and OH was it sweet. Huge coral heads, ample life, and more dive locations than we'd ever be able to do in a lifetime. Ended with a trip to one of the blue holes there and it was really amazing.
For the future, we are beginning to research the Virgin Islands (both US and British) to see about spending some under water time there, as we've heard good things.