By the time you reach the point where your feet feel cold your core temp is already down and you are on the road to becoming hypothermic.
When I was younger my buddies and I used to do a ton of free diving (including alot of work along Brant Rock) we were too cheap/poor to afford proper exposure protection and a combination of not wanting to be the the first "wimp" out of the water and the desire to bag one more bug lead to us often getting very cold. I was often barely able to stand when we emerged from the water and would feel uncoordinated and a combination of dizziness and vertigo. We would also be very tired a few hours later. Stay in a little longer next time and you'll get really dizzy.
For scuba diving, once you get that cold your body's circulation is all messed up and won't be offgassing very well. On a shallow dives this is not as much of a problem, but, for deep dives it's very dangerous.
Just for kicks, bring a thermometer along next time and take your temp before and after you dive.
Although I dive dry now (year round), I freedive in a seaquest 7mm cold water jumpsuit w/ vest and attached hood - pretty warm suit, I bought it at NAS, I suggest you talk to those guys about upgradding your exposure protection.