You're forgetting Brian, that the standards are so vague no one knows where the line is. Is 5% out of trim ok? Is 15%? 20%? 50%? Who knows.
Here's a fundamental problem with people having the "standards" versus knowing the skill requirements.
An instructor is supposed to exercise "judgment and discretion" to ensure the standards are met. Your "mastery" of a skill is not always objectively obvious.
It's evaluated by an instructor who is supposed to know how to and be able to reasonably gauge your competency - because of his evaluation experience... And as it is applied to your performance that is a judgment call. No standard can accurately define something like that.
It's the same problem we have in the law today - everyone wants to increase the number of laws, the complexity of them to cover every contingency.... Yet All we have done is made a mess by doing that. Similarly in judging an athlete's performance three judges could give 3 different scores in 5 different evaluating criteria- all 3 judges are experts and all 3 see the skill set of the performer differently.... It's not ever possible for it to be wholly objective in evaluating human performance.
---------- Post added March 20th, 2015 at 12:01 PM ----------
Vague is not a term I'd use to describe the standards of the NSS or NACD - I haven't looked at any other agency standards though for cave.
But standards can't define a perception of mastery - there is no magic formula- it's up to the instructor to be the gatekeeper of reasonableness.
Maybe they are failing in some places but there is no written clarification that could be a substitution that would work any better if the instructor pool is flawed to begin with.
The question is fundamentally an instructor trainer failure, and seeing what agencies have the most number of "problematic" instructors is a good place to begin a discussion. There really aren't that many full cave instructors around.