Like a lot of folks just learning, I started out overweighted and reduced that weight as I've gone along. What's made the most difference for me is getting familiar with the concept of breathing off the top of my lungs vs the middle or the bottom. I think of it as 4 levels of breath - top, middle, relaxed, and bottom. (Maybe with more experience it will become 5 or 6 levels?) Starting out, I always kept my lungs topped off (as a runner and mountaineer this is second nature when doing something exciting). I could also breathe out hard, and this is how I could control my buoyancy early on. So I used a good bit of the inflator at this stage. As I got more comfortable underwater, I started to breathe normally - like I would walking leisurely. I shed a couple lbs of lead and could control my buoyancy even better than before. I still wondered at instructors and DMs that wore no weights at all, but thought it was just their 5% body fat build that let them be so lucky. After more dives, I found I could relax my breathing even further like I was sitting on the couch or meditating. I shed a couple more pounds and my buoyancy control got even better. I kept shedding weight since every drop in weight had so far improved my buoyancy control. On my last few dives, I found myself underweighted ever so slightly and had to struggle to maintain my safety stop (15 fsw, all air out of BCD, exhaling as much as possible and breathing from the very bottom of my lungs, with 900 psi still in my tank). I also had to really, really empty my lungs to descend at the start of those dives. I took this as a sign that I'm pretty close to the correct weighting for me at my current level (and I've added 2 lbs back in the dives since then and so far I'm happy).
All told, I've dropped 8 lbs of lead from where I started, and I can now generally start descending by breathing out and might add one to three tiny taps on the inflator as I reach depth and control my depth by lungs while at depth. I might adjust my BCD once or twice in a typical dive, almost always letting out air rather than adding as we get shallower. I almost always dump any remaining air before ascending to the safety stop and can control my depth there by breath. As a bonus, I'm pretty confident now that I can complete a dive either a couple lbs heavy or a couple lbs light if I have to.
From the past couple years of diving and breathing practice, I find I'm now more conscious of my breathing in all aspects of my day. And surprisingly (for me at least) I can run or exert myself at that middle breathing level just as effectively as the top level. Who knew I was overworking at breathing all these years?