DiverDurf, ENORMOUS kudos to you for thinking about these things. You're way ahead of me; at 9 dives, I was still trying to SURVIVE underwater.
The first thing to do is to get properly weighted. If you are using rental gear, which changes each time you go out, this is very difficult to do. Once you have your own equipment, you will be able to make progress on this much faster. You want enough weight to be able to stay down at the end of the dive, with a nearly empty tank, but not so much that you are too heavy and have too much air in your BC to compensate. How to do a proper weight check should have been covered in your OW class, but it isn't difficult, and you can do it at the beginning of your dive, if you know the tank you are using. (If it's an Al80, you want just enough weight to be neutral at the surface, and then add five pounds.)
Once you have the weight right, then you have to distribute it for proper balance. Most new divers put all their weight in integrated pouches, or on weight belts. If you are carrying very much weight, this is likely to make you balance feet down, and the only way you can fix that is to swim. What you are looking for is a static balance (in other words, a balance created from the fixed parts of your weight and buoyancy) that allows you to sit still in the water in a horizontal position. This is complicated by the fact that your body posture influences your balance to a signfiicant degree. If you are diving with your head down, that will tend to drive the front of you down; if you are diving with your hips flexed, so that your knees are beneath you, that will tend to tilt you feet down. The ideal posture is a flat body from shoulders to knees. Your hands can be clasped underneath you, or out in front of you; it doesn't matter that much, so long as the position is consistent.
Once you have your posture solid and your weight balanced in a horizontal position, then you can begin to work on the frog kick. I would HIGHLY suggest you find someone local to you who knows the kick, and can pattern you through it on a park bench or something as a first step. Florida is full of cave divers, and cave divers ALL know the frog kick, so you shouldn't have too much trouble finding someone to help with this. (I say this because, when I took GUE Fundamentals -- which is where I learned my frog kick -- I first tried to do it completely backwards, bringing the TOPS of the feet together. It took my instructor getting underwater with me and patterning my fins through the kick THERE for me to get it. You can ingrain the wrong kick very thoroughly and very quickly, if you are doing it wrong and no one is there to tell you about it.)
Good luck with this, and again, my compliments and my thanks for being concerned enough about the environment through which you pass, to want to learn what you can to help preserve it.