Welcome to ScubaBoard, the world's largest scuba diving community. Registration is not required to read the forums, but we encourage you to join. Joining has its benefits and enables you to participate in the discussions.
Benefits of registering include
Breathing to deeply is the most common one but I'm always the guy with the most air at the end of the dive.
Adding this to your comment about using your breath a lot for buoyancy control, and I'd be willing to bet good money that you are retaining CO2. It is known that some people are tolerant to elevated CO2 while diving -- I'm pretty sure I am one of them. When I do dives like some of the Florida caves, where there is significant exertion, I have come out on occasion with a pounding headache and major nausea, and it doesn't go away quickly. This is CO2, and it's not fun.
I'd recommend trying a couple of dives where you really think about your breathing, and make it deeper and get rid of most of the pause at end inhalation and end expiration. You can also do more adjusting of your buoyancy with your BC, making sure you only use your breath for a couple of seconds, at most. See if this solves the problem.