For example....
Here is a picture of me about to dive in Puget Sound in 2010. As you can see, I am a fairly big guy. That was my first time diving under those conditions, and I mistakenly wore my heaviest undergarment--I was sweating at the end of our dives. I estimated how much lead I would need, and when we did the weight checks, my estimate was woefully short. I joked that there might no be enough lead in Seattle to sink me.
I don't remember what I ended up with, but it was not as much as 28 pounds.
View attachment 760978
My real reason for the picture is the woman I dived with. As you can see, she is petite and very slender. You would not think she would need much lead at all, but I was shocked by how much she used. (I don't remember.) She was no beginner. She went by TS&M on ScubaBoard, and SB veterans will attest to the fact that she was a highly respected diver, fully cave certified. I also dived with her in tropical locations, and the same was true there as well--she needed far more lead than anyone would guess. She absolutely needed it.
So each of us is different, and we need to weight according to our own needs. If I were to work with you on your weighting, I would start with about half of what you say you use now and start playing with it as others have described.