I think gsm is grams per square meter?, but that doesn't really tell a lot because of different materials.
My experience is that I had a tailor measure me once and went with that. I got the extra room. When I first got my suit I thought it felt tight and wish I had gotten more room but it broke in after a while. I have lost ~ 10 or so lbs since I ordered and am still very happy that I got the extra room.
YMMV
99.9% of my diving is cold water. 55F is what I consider warm. If you dive cold, I would probably get the extra room. It sounds like you do.