The fine is $10k for anchoring in the reserve, and I don't know if a fee based fine is structured for anchoring in the RNA outside of the HUA, but you will receive a ticket from the Park Service.
I suggest studying up on what a reserve is, what the RNA and HUA are, and the regulations for snorkling and diving in the park and sanctuary regulations. Last time I was in the reserve, there were only a few buoys up (they expect to make a buoy maintenance run later this month), but I installed all of the buoys in the park in May, so they should be all fine and ready to use. A permit is required to enter the reserve, it is no cost, call the sanctuary office to obtain it. When you pay your park fees at the dock (overnight use of the docks or beach or pier is not allowed) be sure to see the RNA regulations and mooring buoy locations on the big map in the Porte Cochere. You may not stay on the moorings overnight, but will be required to anchor within the HUA. The holding ground in the inner harbor is not the best, the sand is very fine, but outside on the west wall of the fort isn't too bad. I've drug anchor there in 50 knot winds, but it isn't too bad during normal conditions.
The park rangers are very nice, they are happy to help you with park regulations, which is a list as long as my arm. They are not responsible for regulations in the Sanctuary, that information must be obtained from the Sanctuary website.