Welcome to the board.
Buoyancy control is a learned art and takes time to master. New divers tend to be way overweighted so my first suggestion is to do a good weight check. Being overweigted makes controlling your buoyancy a lot more difficult, same goes with underweighting. Remember that your weight needs change from the beginning of the dive to the end so if possible, do your weight check with a low (500 psi is my preference) tank. Keep in mind your weight needs will change from fresh water to salt and anytime you add or remove equipment. I log my weight needs every time I dive, noting the place and type of equipment I am using. It makes weight selection easier the next time.
My next suggestion is to slow down and reduce the amount by which you react and WAIT A FEW SECONDS. New divers tend to make an adjustment, many times a way to big of an adjustment and if nothing happens instantly, they do it again. The problem is that there is a significant lag time between when you make a change and when it becomes appearent that the change has had the desired effect. It goes something like this. You add air, nothing happens, you quickly add more air, nothing happens then all of a sudden you start heading up quickly- the lag time has ended and to make matters worse, all that air you added to your BC is expanding quickly giving you even more lift so you dump air, nothing happens, you dump a lot more air, nothing happens- then the lag time catches up to you again and you are heading down fast sooooo you add a bunch more air and the cycle continues. Try adding/venting small amouts and waiting several second before deciding to make another adjustment. You will be happy to know that buoyancy contol is the harder at 20 ft or less than at any other depth so if you master it there, deeper is actually easier.
Try not to wiggle, fidget or move when you are trying to hover. Any slight movement of your hands and especially your feet (remember those big fins you have on?) will cause you to move, possibily in a direction you don't want to go.
It takes practice and experimentation to master buoyancy. Find a buddy and a safe shallow place and practice. You will soon get the hang of it.