I've heard that, which is why I've ordered an XS Scuba 4/6/3 (4mm torso, 6mm hood, 3mm trimmable face seal). It has a zipper up the side, which I'm hoping makes doffing/donning significantly less entertaining for onlookers...Donning or doffing the vest with the wetsuit underneath it might be pretty difficult...
[my vest is a Waterproof Canis 3mm/5mm hood model]