Did you have the mask adjusted for that hood in the past? If not, the strap may have been too tight, which can deform the mask and destroy the seal.
I have done dives in water nearly that cold with a leaking mask. Even if you are comfortable with mask clearing, having to do it constantly in ice water is a stressor. When you add other stresses to that one, including being a novice diver and nervous about depth, you have a recipe for a bad outcome, and I think it's a good thing that you didn't continue to push and try to get the deep dive done.
As far as vertigo goes, I empathize! I had horrible problems with vertigo for the first several years that I dove, whenever I was in midwater without a visual reference. It took a long time to learn the orientation cues that allow me to function in that setting, and I still don't like it very much. If looking down into the blue abyss bothers you, then stick to dives where you can maintain some kind of reference, whether that's an anchor line or a reef or a sloping shoreline. When you are much more comfortable in the water, you can challenge yourself with some forays into blue water, and see how it goes.