Exposure protection is entirely a matter of personal tolerances. Off Cozumel in Dec. 2011, with water temps around 80, I was wearing a dive skin and was plenty warm. In the Cenotes, with water temps in the mid-70's, I wore a 3/2 full with hood and was plenty warm. For the same 80 degree dives off Cozumel, my wife wore a 5mm full, and added a hood, booties and gloves for the cenotes.
Fit also plays a huge role. If your wetsuit is too loose, it will allow quite a lot of water to flow between the suit and your skin, and thus will not keep you warm. You might very well feel colder in a poorly fitting 5mm than in a properly fitting 3mm.
The head is very vascular, and as a result it's a huge heat sink. If you get cold easily, add a hood. On our first cenote dives, my wife felt cold even in a 5mm full plus a 5mm jacket. I bought her a hood, and now she's warm in just the 5mm full plus the hood, booties and gloves. If the hood doesn't do it, consider a hooded vest. If you're still cold, then it's time to consider a heavier wetsuit, one of the battery powered core warmers, or a dry suit.
As mentioned, the more wetsuit you wear, the more weight you'll need. But don't skimp on thermal protection just to decrease the weight you're carrying. Just keep it in mind when you're planning.