Thank you for sharing your experience. I have never experienced vertigo, but nevertheless can relate to what you describe very well. I once was caught in a siltout at the bottom of an extremely muddy lake, in absolute darkness, and lost visual and tactile contact with the bottom. My buddy and I were pointing our fairly strong dive lights at each other probably within meters of each other, but neither one could see anything through the cloud of silt. Even though I rationally knew that as long as I kept my buoyancy under control, there was no danger, I felt a near-panic coming on, causing my breathing rate to go through the roof. If I can't see, have no idea where the bottom is or what direction the shore lies, I get an irrational and unwarranted fear of sinking deeper or "getting caught in midwater." One of my instructors told me to get negatively buoyant in these kinds of situations (we are talking no-deco dives, btw), but when I'm disoriented like that, I feel extremely reluctant to let myself sink deeper into the unknown that I can't see or feel. Of course, I could simply go up, but I think that's bad habit and I'd rather train myself to sort out icky situations at depth and keep myself composed.
One thought that cropped up when I read your account was whether you think the use of scooters might have exacerbated the problem? I dove Whytecliff this past summer and from what I remember, we reached the wall after a very brief swim. I didn't feel the need for extra propulsion in order to reach a nice area with more depth than one could ask for (I went to 135 ft and below me was nothing but black water) and the only limiting factor were our NDLs (we were diving no-deco profile and single tanks.) I also remember being able to follow up the wall to very shallow depths in the 30-foot range to complete a swimming safety stop. Of course I'm not second-guessing your dive profile, as a diver who's never used a scooter but always been curious about them, it be interesting to learn about your rationale for using them at that particular location. Thanks again for sharing your insightful story with us!