The undergarments provide support for the suit, and there's a lot of air between the fibers. That volume provides lift that must be countered by mass (e.g., lead) to be neutral. If you totally flood the suit, that lift is gone (I've tested it) -- and yet you still have all that lead, so you'll be very negative without compensating somehow. So yes, it could be "meaningful".I'm intrigued now as to whether flooding the drysuit, and thus saturating the undergarment with water, may cause a (partial) loss of buoyancy that the undergarment provides, and how meaningful that might be?
Fortunately, the odds are that you'll still have a functioning wing that can serve that need. If not, then a buddy, DSMB, or dropping some lead will likely be required to get you off the bottom. It's quite difficult to swim up when more negative than about 15 lbs, and muscles don't work well in very cold water.