I use the same most of the time, as I age I have been loosing my cold tolerance, (65 now) I use heavy, expedition weight wool as a base and waterproof mesh tech 3D and yesterday with those I added a waffle fleece shirt and after an hour started feeling the cold, using up air means less air in the suit. With the neoprene I’m always warmer at the end.
One of the things I like about the Ultra besides the warmth is that it dives a little more like a wetsuit, it doesn’t pinch like a Nova (any shell suit) with the end of dive squeeze, it’s just a more comfortable suit while diving.