Mike:
That assumes he won't just go on about his dive solo and be happy with that. Some people would, if only to avoid feeding into something perceived as a manipulative effort at control.
SMAE:
Good to get a better handle on the actual problem; you don't feel safe diving buddy less under the conditions, with the gear & training you have. That paves the way to consider some options, some of which others have brought up.
1.) Dive with a different buddy. You could even dive as a threesome, but have an advance talk with the 'good' buddy, and if your husband chooses to swim off, let him go, and you two left have a good dive with 'proper' (whatever you deem that to be) buddy practices.
2.) Dive with a group in good conditions, as if often done in the Caribbean, and stick close to the guide. Not only will your husband likely also be following the guide around, but the guide an others will likely be in fairly close proximity to you, so you are not alone, although no one may be as close as you want a buddy to be. It's not completely equivalent to buddy diving, but it is different from being in the ocean alone.
3.) You've got the dive count; take a solo course (e.g.: SDI Solo Diver), get the added gear, and start solo diving. He can come along. If he sticks with you, you buddy dive. If he takes off, you solo dive (and to some extent, I guess he does, too).
3 Possible solutions that provide for a reasonable margin of safety for you to enjoy your recreational scuba diving.
Richard.