Yes, diving has taken many directions from skin diving. Remember that GUE isn’t all about caves, but deep open water dives as well where the deco obligations. Don't want to rocket up to the surface. We don't want panicking recreational divers shooting to the surface.
@boulderjohn has commented about a joint PADI/DAN study looking at air embolism deaths (correct me John if I misrepresent what you said or get anything wrong) where people were not able to perform emergency ascents in a speed appropriate fashion.
Given the reality that people often don't go beyond OW/AOW for training, they don't refresh their skills, and that some divers don't receive decent training to begin with, I'm a big believer in proper weighting/balanced rigs. Excessive weight is a problem. Especially when people lose their weight belts or weight pockets and up they go.
Now sure if you hurt your leg at the same time your wing fails (I think multiple problems at the same time is God's way of telling you your time is up - only kidding), where is your buddy? If you are diving solo, what is your redundant buoyancy source? You don't just dive with redundant gas and call it good (though I'm sure many people do).
And yes, we do tend to wear horse blinders for the diving we do. I'm not a freediver. I don't harvest on dives (I would hope those folks would have redundant buoyancy).
For single tank diving off a kayak, I can see having a weight belt. But for doubles or sidemount, no.