ES, you're not going to get more bottom time out of a tank if you're cold.
Matt's correct in that if you're correctly weighted *for your current rig* (meaning whatever suit you're wearing and whatever you're carrying (i.e. pony bottle, camera rig, etc.), and you're correctly trimmed, you *should* have no significant difference in bottom time whether you're wearing a bathing suit or 7mm. Certainly there shouldn't be a big difference between a 3mm and a 5mm.
On the other hand, if your core temp is down and you're chilled? Yes, you will likely see a difference in air consumption and you're much more likely a) to feel too tired to dive overall; b) to want to thumb the dive because you're cold; c) to take a DCS hit. Staying warm is important, even in relatively warm water - even 80 degree water is still almost 20 degrees colder than normal human body temp and if you remember from OW class, water conducts heat 25 times faster than air. Even 80 degree water can really chill you by the end of a 4 dive day if you're not in enough neoprene and staying warm between dives.
Make sense?