Your "feelings" and your "wants" don't rationalize what is not the best method here. You can chose to do what you want but doesn't make it the best way to do it ESPECIALLY on long surface swim.
It isn't about speed or race, it is about efficiency and getting to the drop point in the most efficient and direct method.
It is a sign of inexperience in the type of diving that requires long surface swims. It is a sign of somebody who is outside of his range of comfort.
I'm going to agree with above. Swimming on your back is far from a sign of inexperienced.
So if you like to chat with your buddy all of a sudden you are an inexperienced, you want a nice leisurely swim looking at the sky so your inexperienced, or perhaps you just like to do surface swims on your back your inexperienced.
Outside realm of comfort is just plain silly.
If you excuse me I have to go tell 95 percent of NE divers that they are inexperienced because they like to do their surface swims on there back.