That would be my guess as well. The OP is wearing multiple layers, and air can get in beteeen easily. I wonder if the problem is still there after thirty minutes of diving. With the tank somewhat lighter then, it should be worse, but if the air from the suit, BCD, etc is then gone, re-descending...