The bottom line on gas consumption is that you HAVE to breathe enough to get rid of the carbon dioxide your body is making -- and how much CO2 you make is directly related to how much you move.
Many others in this thread have recommended slowing down and swimming less. Not only will it help your gas consumption, but you will also begin to see a lot of critters you miss when you are moving. Sea life makes extensive use of camouflage for survival, and if you move too fast, you won't spot things that are trying not to be spotted. Once you begin to key in on shapes, colors and movement, you will find that even a small area of reef often has more on it than you can really absorb in a dive.
But not all movement underwater is for the purpose of propulsion (and in your case, your father was doing the same swimming you were, but using less gas). A LOT of movement on the part of novice divers is simply to combat instability. If your tank is sliding around on your back, you are likely to be using your hands to avoid turning turtle. If your gear is put together so that you tend to adopt a feet-down position in the water, then when you swim, you push yourself upward in the water. The only way to avoid surfacing is to keep your buoyancy negative enough to counteract the upward kick. But then, of course, if you STOP kicking, you sink . . . so people with this problem swim constantly and cannot stop to look at anything.
If I were to recommend a few simple things to cut your gas consumption, they would be these:
1. Get your overall weighting close to correct. A pound or two too heavy is not a big deal, but ten pounds is.
2. Work on your posture underwater. Lots of people want to bend at the hips (the position in which you sit in a chair), which tends to rotate you feet-low. Get a nice straight line from the shoulders to the knees. It will help your stability.
3. Once you have #2 down, balance your equipment. Move weight around until you can hover in a horizontal position without much sculling. This will allow you to dive truly neutral, which massively reduces your energy expenditure.
4. Make sure your BC fits well and holds the tank steadily in the middle of your back. That will help get rid of the hand-waving and sculling.
5. Only when all the rest of those things are done, is it time to think about your breathing pattern. Breathing on scuba should be mildly deeper and slower than breathing on land, but not huge breaths. What you want to avoid is a rapid, shallow breathing pattern, which wastes gas.