No way. I (used to) travel long distances to dive (on my vacations from work prior to retirement) and didn't have the option to wait for better weather and extend my trip. Anyway that was before I retired and lived far from good diving destinations.
Nowadays I don't have that sort of high pressure schedule, and living in Europe makes the flights a lot shorter and cheaper but generally speaking, regardless of the forecast weather, if there's a boat headed to a dive site, I'll be on it.
You make it sound like no one else has to deal with traveling long distances and getting blown out. I used to drive long distances to dive all around the Great Lakes or to NC for wreck diving. I was regularly blown out 30-50% of the time on those trips. A group of buddies and I once drive 15 hours to NC for a 4-day wreck diving trip. We never splashed once. It happens. I will always happily find something else to do onshore than take risks to go out when the vast majority are not running. YMMV.