If I have a bladder, then I use both. If I dive without a bladder, then just my lungs. They broke my bladder in the Philippines and I just dove without it. No one complained about my buoyancy except for one guy. He was pissed that mine was better than his and he had the use of a bladder! Go figure.
Use all your tools. My lungs are as much of a tool in diving as is any bladder. I use the bladder for coarse adjustments and my lungs for fine adjustments. This largely goes out the window when I'm on my rebreather, but not completely. In that case, a super breath will trigger my ADV (Automatic Diluent Valve) and add air. Of course, I can always exhale through my nose to vent any excess in my breathing loop. However, I have to add/subtract from my BC all the time on a rebreather which I rarely have to do while on OC.
This is the way I dive. This is how I teach it. If anyone doesn't understand or like it, then they are free to dive in any manner they want. I get compliments on my students' trim and buoyancy all the time because it's so easy that they look good from the start. In any event, just be safe and in control however you do it.