i did a shore dive years ago on the East End. There was a place called 'blowholes'. There were some coral gardens that extended out from shore several hundred feet and led to a wall about 500 feet off shore. We didn't go out to the wall (marked at the time by a buoy) but there was a bunch of stuff in the coral gardens.
We decided to do it on a whim although we brought our dive gear with us so maybe a pre-planned whim. We rented tanks from a shop just up the road and jumped in. The entry was a bit tricky as there was sharp volcanic rocks and several urchins to mind, but we got in and out without incident. Obviously, it can only be done with good weather, which we had and there are better dives to be had, but for a $5 tank, it was a well worth the effort.
Have fun