I usually shore dive, and lock everything in my car (hiding it, of course) then keep a copy of my car key on cave line around my neck. Never had a problem, but I haven't dove in any secluded places, either.
One precaution, though. Keys with an electronic chip are not suitable for diving...