Especially on 'tourist' dives I have seen far too many people who seem to think that once they have done a safety stop that's it, the dive is over, and they shoot to the surface. I have even seen people inflate their BC at the end of the safety stop and go up like a Polaris missile and then laugh about it.
It's entirely the wrong thing to do, if I am shore diving I will slowly swim in as far as I can, in no hurry to surface, if I am boat diving then after the safety stop I will drift up as slow as I can. If you have a shot line or an anchor line you can use that to keep your ascent slow, and use it as a reference. It should be easy if the sea is calm. If you have a chop on the sea you need to be careful and might not be able to control it so well.
P