If your the right weight at the start of a dive you cant possibly be to heavy at the end of it, unless your refusing to let go of that porthole your carrying.
That assumes you finish the dive with your tank(s) empty. Otherwise, you still have the weight of the unused gas which must be compensated for in some way.