Forgive the following if you already know this.
Let's just assume for the sake of discussion that you are using a single aluminum 80 as your tank.
An AL80 is 1.5# negatively buoyant when full. It is 4.4# positively buoyant when empty.
If you are weighted perfectly then that means with an empty BCD and a nearly empty tank (i.e. at the end of a dive) you will be neutral. Backing up to the start of the dive, that means you would be 5 - 6# negative with a full tank.
If you are wearing a wetsuit, it will compress some, which means you'll be even more negative when get down to whatever depth you're diving.
All that is a long-winded explanation of why you would be at least 5 or 6 # negative (more with a wetsuit) at the start of your dive.
If you are starting with an empty BCD and not adding ANY air to it, then you are either really good with your breathing, to continuously compensate for being 5 or more # negative, or you are constantly finning to hold your depth, oorrrr.... you are not carrying enough weight and you are ending the dive too light.
If you are using a wetsuit, you'd be more than 5 or 6 # negative and if you are using a tank that is bigger than an AL80, you'd be another increment more negative. With a 100, you'd start off 8# negative, just for example.