This is not really suprising a swimmer, even waving a dive sausage, is an amazingly small target. ELTs or EPIRBs are helpful but few aircraft, except those specifically equipted for rescue, have the equiptment.
Flares, smoke, streamers, and dye markers help A LOT durring the day, and strobes...