But you forget Koh Tao, there are a few there as well.The "cattle boats" are mostly in Phuket. Other places in Thailand are with "normal" boats. Also one think to consider is the use of speed boats ! If the sea is choppy it is just a torture !
I agree speedboats can be awful when there is any form of swell