What I have never had is people using my tanks by mistake. I won't let it happen, and honestly I've never had someone try to use my tank unless we agreed that what they were going to do.
Maybe I am an anomaly, maybe I'm lucky but I don't think so. You can try and convince me that this happens all the time, but that is not my experience, not once. My experience is that most folks are not diving nitrox, and if they are, they are careful. In CA so many divers dive their own tanks it's hard to find rentals on some boats....I had no idea... but you think those folks are going to get their tanks mixed up?
Many California dive boats occasionally host dive shop groups from out of area and will supply tanks on request. California is probably a bad example, though, because these boats also usually have on-board compressors, so it's only one tank per diver.
Where it's just a ride to the dive site sort of boat in Florida, however, some boats will provide tanks for divers without them (lots of visiting divers to Florida that don't bring their own tanks) and lack on-board compressors, so each diver will have two tanks for a two-dive trip.
Now I know you are ever-vigilant and would never let anyone use your tank accidentally, but let's take a less vigilant diver. Maybe the diver gets seasick, or has some vertigo or something from the first dive and decides to sit out the second dive. He takes a nap since there's not much else to do on a dive boat when you're not feeling well and diving makes you tired. Napping during a surface interval is hardly a phenomenon and it's likely no one would bother to wake him up if he's indicated he's sitting out the next dive.
So now the tourist divers are getting ready for their second dive, and one of them notices his second tank is empty or has a low fill. That diver spies your unmarked nitrox tank that looks the same as all the others and decides, heck he'll never know 'cause he's sleeping, and swaps tanks with yours. Excuse me, not yours, I meant the diver who is less vigilant than you. For all the tourist diver knows, you've rented the same tank he has because they look the same, except for that piece of masking tape with some numbers on it. He has air, so you have air. You're not diving the second dive, so what's the worry?
He grabs your tank, dives, and dies. (Not you, of course, because you are ever-vigilant, I was referring to that other, less-vigilant diver who got seasick and took a nap.)
All it might have taken to save a life is one sticker with NITROX boldly displayed in green and yellow. That's all.
No one says "this happens all the time". Lots of dive accidents don't happen all the time. But dive accidents that are preventable by simple cautionary measures are stupid accidents. And this sort of accident certainly can happen.