I don't know if anyone mentioned this, but if you have a sizable amount of air in your wing, and you go vertical, I guess the air bubble will be a couple of feet closer to surface, unless by going vertical your feet go down instead of your head going up. So if the air bubble rises with the change in attitude, it's now bigger and more buoyant.
I was going to say that you're almost certainly finning a bit without knowing it, but if you really crossed your legs, that usually does the job.
I've been diving for many years, been a DM for several of those, and assisted with many peak performance buoyancy classes. Those helped me to learn about about my personal weighting. Even after this experience, it seems every time I really take time to fine tune my weighting it turns out I'm a bit overweighted and diving just a bit negative, maybe a lb or so. Most recreational divers I see are substantially overweighted and substantially negative when diving, and this ingrains a habit of constantly working just a bit to stay neutral. I think there's a bit of basic human security in feeling a slight pull of gravity.